2100 NVIDIA USA
2100 NVIDIA USA

Director, Software Architecture

TLDR

Drive AI data center and networking tech with hands-on leadership, delivering scalable, high-impact solutions at the intersection of architecture and delivery.

NVIDIA is seeking a Director of Software Architecture to lead and accelerate the evolution of next-generation AI data center and networking technologies. This role is designed for a hands-on, execution-driven leader who pushes boundaries, translates vision into reality, and delivers high-impact solutions at scale. You will operate at the intersection of innovation, architecture, and delivery—shaping the future of AI networking and infrastructure.

What you will be doing:

  • Drive identification, evaluation, and rapid adoption of emerging technologies, ensuring strong alignment with strategic roadmap and measurable business outcomes.
  • Lead the design and delivery of advanced networking applications, leveraging data plane programming and modern networking protocols to solve complex, large-scale challenges.
  • Architect solutions across AI data center environments, integrating GPU-based systems, hardware acceleration, and high-performance networking.
  • Act as a thought leader and industry influencer—engaging directly with customers, publishing technical content, and representing NVIDIA at key conferences and forums.
  • Define and execute a bold architectural vision for NVIDIA networking in close collaboration with cross-functional software and hardware leaders.

What we need to see:

  • M.Sc. or PhD. in Computer Science, Computer Engineering, Electrical Engineering, or equivalent practical experience.
  • 12+ years of deep experience in software architecture, systems design, and applied research.
  • 8+ years of proven leadership, building and driving high-performing engineering teams in fast-paced environments.
  • Strong expertise in AI inference technologies, frameworks, and large-scale distributed systems.
  • Hands-on experience with networking protocols (e.g., TCP/IP, RDMA, RoCE, InfiniBand) and data center networking architectures.
  • Deep familiarity with AI DC architectures, hardware acceleration technologies, and SDKs (e.g., DOCA, CUDA or similar).
  • Experience with AI data center design, including compute, networking, and AI storage systems.
  • Exceptional communication and influence skills, with a demonstrated ability to align stakeholders and drive decisions across complex organizations.

Ways to stand out from the crowd:

  • A track record of aggressively prototyping, validating, and scaling new ideas into production.
  • Strong foundations in system software, including operating systems and low-level architecture.
  • Experience with hyperscale cloud and AI data center environments.
  • Expertise in AI storage systems, high-performance computing (HPC), and end-to-end accelerated infrastructure.

NVIDIA offers a uniquely dynamic environment where top talent thrives on innovation, ownership, and impact. Join a rapidly expanding organization where bold ideas turn into industry-defining technologies.

NVIDIA is a leading innovator in computer graphics and accelerated computing, specializing in Artificial Intelligence and High-Performance Computing across diverse markets such as gaming, automotive, and industrial AI. We develop cutting-edge simulation technologies and GPU solutions that empower everything from digital twins to autonomous systems, making us a central player in shaping the future of technology.

Founded
Founded 1993
Employees
500+ employees
Industry
computer hardware
Funding stage
Public
Stock ticker
Publicly traded (NVDA)
Total raised
$4.1B raised
View company profile

This job is no longer available

Pro members saw this job first

New jobs unlock for everyone after 24 hours. Startup Jobs Pro shows them right away, with instant alerts and salary filters. From $7/month.

Get Pro