Staff Software Engineer, Inference
CoreWeave · Sunnyvale, CA | Bellevue, WA · Technology
About this role
CoreWeave is hiring a staff-level Software Engineer based in Sunnyvale, CA | Bellevue, WA. The posting calls out experience with Python, C, CUDA, Spring. Compensation is listed at $188,000–$275,000 per year.
- Role
- Software Engineer
- Function
- software engineering
- Level
- staff
- Track
- Tech leadership
- Employment
- Full-time
- Location
- Sunnyvale, CA | Bellevue, WA
- Department
- Technology
More roles at CoreWeave
Job description
from CoreWeave careersWhat You’ll Do:
Inference Platform Team
The Inference team builds and operates CoreWeave’s Kubernetes-native inference platform, powering low-latency, high-throughput AI workloads at massive scale. The team is responsible for request routing, scheduling, GPU resource management, and system-wide optimizations that drive performance, efficiency, and reliability across real-time inference systems.
About the role:
As a Staff Software Engineer (IC5) on the Inference team, you will act as a technical leader driving architecture, performance, and reliability across multiple services and teams. Your day-to-day will involve leading cross-team design initiatives, optimizing inference performance (latency, throughput, and GPU utilization), and improving system reliability at scale. You will work deeply in distributed systems and Kubernetes-based infrastructure, focusing on areas like scheduling, batching, and memory optimization. This role requires hands-on technical leadership and the ability to influence engineering direction across the organization.