mid software engineering Infrastructure Engineer ic Hybrid · Posted Feb 13, 2025
$230,000 – $490,000
USD per year

About this role

OpenAI is hiring a mid-level Infrastructure Engineer in the software engineering function based in San Francisco, CA (hybrid). The posting calls out experience with Azure, Kubernetes, CI/CD, Machine Learning. Compensation is listed at $230,000–$490,000 per year.

Role
Infrastructure Engineer
Function
software engineering
Level
mid
Track
Individual contributor
Employment
Full-time
Location
San Francisco, CA
Work mode
Hybrid
Department
Scaling
Posted
Feb 13, 2025
AI Summary
Design and operate GPU fleet infrastructure systems including job scheduling, cluster management, and CI/CD pipelines at massive scale. Requires hyperscale compute experience, strong programming skills, Kubernetes expertise, and public cloud (Azure) background. Interface with researchers to optimize workload performance and reliability.

More roles at OpenAI

Software Engineer, Model Inference
San Francisco, CA · mid
Azure CUDA PyTorch
Research Engineer / Research Scientist, Post-Training
San Francisco, CA · mid
Machine Learning OpenAI Reinforcement Learning
Software Engineer, Compute - Storage
San Francisco, CA · mid
Rust Kubernetes Terraform
Solutions Engineer, Pre-Sales
San Francisco, CA · mid
Python JavaScript LLMs
Forward Deployed Software Engineer - SF
San Francisco, CA · mid
Full Stack PostgreSQL API Development
All OpenAI jobs →

Job description

from OpenAI careers

This role will support the fleet infrastructure team at OpenAI. The fleet team focuses on running the world’s largest, most reliable, and frictionless GPU fleet to support OpenAI’s general purpose model training and deployment. Work on this team ranges from

  • Maximizing GPUs doing useful work by building user-friendly scheduling and quota systems

  • Running a reliable and low maintenance platform by building push-button automation for kubernetes cluster provisioning and upgrades

  • Supporting research workflows with service frameworks and deployment systems 

  • Ensuring fast model startup times though high performance snapshot delivery across blob storage down to hardware caching 

  • Much more!

About the Role

As an engineer within Fleet infrastructure, you will design, write, deploy, and operate infrastructure systems for model deployment and training on one of the world’s largest GPU fleet. The scale is immense, the timelines are tight, and the organization is moving fast; this is an opportunity to shape a critical system in support of OpenAI's mission to advance AI capabilities responsibly.

This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees.

In this role, you will:

  • Design, implement and operate components of our compute fleet including job scheduling, cluster management, snapshot delivery, and CI/CD systems.

    This is an excerpt. Read the full job description on OpenAI careers →
All software engineering jobs software engineering in San Francisco, CA Jobs in San Francisco, CA software engineering salaries software engineering career path
All OpenAI Jobs Browse software engineering roles mid positions