Senior Software Architect, AI Systems and Networking

Job description

An applied research team within NVIDIA’s Networking Systems & Software Architecture group is solving some of AI’s hardest infrastructure problems. The team builds systems-level software that moves data between GPUs, nodes, and storage at the speed modern AI demands—spanning low-level transport optimization, hardware-software co-design, and communication frameworks that plug directly into production AI stacks. The team's charter expands into emerging domains including quantum computing interconnects.

The Senior Architect role is to own modules and projects end-to-end—from scoping research questions to shipping production code. It calls for a recognized expert who drives technical decisions, pulls in ideas from research and industry, and regularly prototypes new approaches to prove a point. The work lives at the boundary of applied research and production engineering!

What you will be doing:

• Architecting and implementing high-performance communication and memory management libraries for distributed AI

• Driving hardware-software co-optimization with GPU, DPU, NIC, and switch teams through GPUDirect RDMA, NVLink, and next-generation interconnects

• Profiling and optimizing data movement across GPU memory, system DRAM, NVMe, and network fabrics

• Integrating networking capabilities into AI serving stacks such as vLLM, SGLang, and TensorRT-LLM

• Contributing to and maintaining open-source projects, mentoring engineers, conducting design reviews, and prototyping experimental technologies to evaluate their viability

  This is an excerpt. Read the full job description on Nvidia careers →