mid Software Engineer ic · Posted Jul 10, 2026

About this role

Amazon is hiring a mid-level Software Engineer based in Palo Alto, CA. The posting calls out experience with LLMs, NLP, ETL, Machine Learning.

Role
Software Engineer
Function
software engineering
Level
mid
Track
Individual contributor
Employment
Full-time
Location
Palo Alto, CA
Department
Software Development
Posted
Jul 10, 2026
AI Summary
Build ML training and real-time inference systems for Amazon Ads, predicting ad relevance at scale. Design LLM inference infrastructure, optimize model performance, and develop ML data pipelines. Work with applied scientists to implement end-to-end solutions from experimentation to production.

Job description

from Amazon careers
Build the large-scale ML training and real-time inference systems that deliver highly relevant ads to shoppers across all Amazon platforms worldwide — from advanced machine learning models to next-generation LLM inference infrastructure powering GenAI workloads at Amazon Ads scale. If you're energized by ML engineering at massive scale with direct business impact, this is your team.

The Sponsored Products and Brands (SPB) Ad Response Prediction team partners engineers and scientists to build the ML infrastructure — from training through inference — that predicts which ads are most relevant to shoppers across every Amazon surface. You'll pioneer LLM inference infrastructure, optimize model performance at scale, and implement end-to-end solutions in a fast-moving, collaborative environment with a strong entrepreneurial spirit and bias for action.

Key job responsibilities
- Enhance the scalability, automation, and efficiency of large-scale ML training and real-time inference systems
- Pioneer the development of LLM inference infrastructure to support next-generation GenAI workloads at Amazon Ads scale
- Work closely with applied scientists to optimize machine learning model performance and implement end-to-end solutions from experimentation through production
- Design and build ML data pipelines leveraging techniques in machine learning, data mining, information retrieval, statistics, and NLP
- Drive operational excellence for ML infrastructure — monitoring, automation, and continuous improvement of model serving systems

About the team
The Sponsored Products and Brands (SPB) team at Amazon Ads is re-imagining the advertising landscape through generative AI technologies, revolutionizing how millions of customers discover products and engage with brands across Amazon.com and beyond. We are at the forefront of re-inventing advertising experiences, bridging human creativity with artificial intelligence to transform every aspect of the advertising lifecycle from ad creation and optimization to performance analysis and customer insights. We are a passionate group of innovators dedicated to developing responsible and intelligent AI technologies that balance the needs of advertisers, enhance the shopping experience, and strengthen the marketplace. If you're energized by solving complex challenges and pushing the boundaries of what's possible with AI, join us in shaping the future of advertising.

Basic Qualifications

- 5+ years of non-internship professional software development experience
- 5+ years of programming with at least one software programming language experience
- 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience as a mentor, tech lead or leading an engineering team

Preferred Qualifications

- 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

More roles at Amazon

Global H&S Audit Manager, AWS Health & Safety
Herndon, VA · manager
AWS Networking Agile
Senior Category Manger, Power and Utilities, Global Procurement Organization (GPO)
London, United Kingdom · senior
Sr. Manager, Product Management-Tech, Amazon Customer Service
Toronto, Canada · senior
Facilities Coordinator III, NA AMOC, NA AMOC
San Jose, Costa Rica · mid
Incident Response
Logistics Specialist, ATL Logistics
Covington, GA · mid
AWS Networking Cloud Computing
All Amazon jobs →
All software engineering jobs software engineering in Palo Alto, CA Jobs in Palo Alto, CA software engineering salaries software engineering career path
All Amazon Jobs Browse software engineering roles mid positions