Senior Perception Engineer, Obstacle Foundation Models - Autonomous Vehicles

Job description

Intelligent machines powered by artificial intelligence—computers that can learn, reason, and interact with people—are transforming every industry. GPU-accelerated deep learning provides the foundation for machines to perceive, reason, and solve complex problems. NVIDIA GPUs run deep learning algorithms that simulate aspects of human intelligence. They act as the brain of computers, robots, and self-driving cars. These machines can perceive and interpret their surroundings.

We are seeking an exceptional Senior Perception Engineer to help design and productize NVIDIA’s next-generation autonomous driving perception stack. You will work on the core 3D obstacle perception pipeline, contribute to architecture and algorithm design, and remain deeply hands-on with implementation, including modern transformer-based, multi-modal, and vision-language techniques where they add real value.

What you'll be doing:

• Develop and improve the technical build, architecture, and roadmap for 3D obstacle perception to support end-to-end autonomous driving. Use innovative CNN and transformer-based architectures when appropriate.
• Design and implement advanced 3D perception models using multi-camera inputs and/or multi-sensor fusion (camera, radar, lidar) for obstacle detection and tracking, including opportunities to explore BEV and transformer-based 3D perception.
• Build efficient, production-grade deep learning models by defining objectives with the team. Select and prototype architectures, run experiments, and follow training and evaluation guidelines. Use techniques like large-scale pretraining, distillation, and parameter-efficient fine-tuning (e.g., LoRA).
This is an excerpt. Read the full job description on Nvidia careers →