Senior Software Engineer, Generative AI Systems

Job description

NVIDIA is seeking a highly motivated Software Engineer to join our growing AI and Generative AI engineering team. In this role, you will contribute to the design, development, and evaluation of large-scale AI systems powering next-generation applications in LLMs, agentic AI, retrieval-augmented generation (RAG), and intelligent automation.

You will work closely with cross-functional teams to build scalable AI infrastructure, develop robust evaluation methodologies, and improve the reliability, safety, and performance of production AI services. The ideal candidate combines strong software engineering fundamentals with hands-on experience in machine learning systems, distributed infrastructure, and modern GenAI workflows.

What You’ll Be Doing:

• Design and develop scalable infrastructure for large-scale ML training, inference, and Generative AI systems.
• Build distributed systems and cloud-native platforms supporting GPU clusters, fault-tolerant training, and high-performance AI workloads.
• Develop evaluation frameworks for LLMs and agentic AI systems, including hallucination detection, safety validation, robustness testing, and tool-calling reliability.
• Architect and optimize retrieval-augmented generation (RAG) pipelines, knowledge management systems, and scalable AI data workflows.
• Build backend services, APIs, and production AI infrastructure using technologies such as FastAPI, Kubernetes, Docker, and modern cloud platforms.
• Develop automated benchmarking, orchestration, and asynchronous processing systems for enterprise AI applications and evaluation platforms.
• Collaborate cross-functionally with research, product, and engineering teams to improve scalability, reliability, observability, and developer productivity across AI systems.
This is an excerpt. Read the full job description on Nvidia careers →