SOC AI Application Engineer — AI Services, Agents and Knowledge Systems
Nvidia · Shanghai, China
About this role
Nvidia is hiring a mid-level AI Engineer in the machine learning function based in Shanghai, China. The posting calls out experience with Python, TypeScript, React, FastAPI.
- Role
- AI Engineer
- Function
- machine learning
- Level
- mid
- Track
- Individual contributor
- Employment
- Full-time
- Location
- Shanghai, China
- Posted
- Apr 30, 2026
More roles at Nvidia
Job description
from Nvidia careersThe NVIDIA System-On-Chip(SOC) Design team is looking for a top AI Engineer with curiosity about SOC design automation, RTL integration, and chip build and assembly now. If you are interested in using AI to upgrade the conventional SOC Design flow, come and join us. We need you to be passionate about AI+Hardware. You are expected to help us to build AI application-layer services which would boost HW execution team's work efficiency, includes : assistants, retrieval and Q&A; workflow automation; and develop AI agent for SOC Design-related tasks. You will be shipping and operating AI services (APIs, orchestration, RAG, evaluation), evaluating and using modern frameworks and tools, such as LangChain (and similar stacks), RAG pipelines, and coding-agent / IDE-centric workflows (e.g. Claude Code-class assistants, reusable skills / playbooks for agents).
What you’ll be doing:
Design, implement, and operate LLM-backed services: APIs, async jobs, streaming responses, and integration with internal tools and data sources.
Build RAG and knowledge systems: chunking, embeddings, vector retrieval, reranking, access control, and quality/latency tuning.
Apply agent and orchestration patterns with frameworks like LangChain (or comparable): tool use, multi-step plans, memory, and guardrails—aligned with how SOC Hardware team works.
Improve developer and engineer experience with AI-assisted coding and repeatable “skills”: prompts, procedures, and small utilities that teams can run consistently (including patterns like Claude Code + structured skills).
This is an excerpt. Read the full job description on Nvidia careers →