ML Compiler Engineer II - Neuron Kernel Interface , Annapurna Labs
Amazon · Boston, MA · Software Development
mid
Machine Learning Engineer
ic
3+ yrs Bachelor's
· Posted Apr 10, 2026
$158,100 – $213,800
USD per year
About this role
Amazon is hiring a mid-level Machine Learning Engineer based in Boston, MA. The posting calls out experience with Python, AWS, TensorFlow, PyTorch and roughly 3+ years of relevant work. Listed education preference: a bachelor's degree or equivalent. Compensation is listed at $158,100–$213,800 per year.
- Role
- Machine Learning Engineer
- Function
- machine learning
- Level
- mid
- Track
- Individual contributor
- Employment
- Full-time
- Location
- Boston, MA
- Work mode
- On-site
- Experience
- 3+ years
- Education
- Bachelor's degree
- Department
- Software Development
- Posted
- Apr 10, 2026
AI Summary
Develop and maintain compiler tooling for AWS Neuron, optimizing deep learning models across PyTorch, TensorFlow, and JAX. Build fuzzers and specification synthesis for LLVM-based compiler. Requires strong C++/Python skills and compiler development background.
More roles at Amazon
Data Center Security Manager , AMER East
Ashburn, VA · manager
AWS Networking Security
Sr. Customer Solutions Manager
Seattle, WA · senior
Express AWS Performance Optimization
Manufacturing Engineer, Amazon Leo
Redmond, WA · mid
System Design
Manufacturing Engineer, Amazon Leo
Redmond, WA · mid
System Design
Sr. FPGA Engineer, Amazon Leo
Redmond, WA · senior
Python Git CI/CD
All Amazon jobs →
Job description
from Amazon careersThe AWS Neuron Compiler team is actively seeking skilled compiler engineers to join our efforts in developing a state-of-the-art deep learning compiler stack. This stack is designed to optimize application models across diverse domains, including Large Language and Vision, originating from leading frameworks such as PyTorch, TensorFlow, and JAX. Your role will involve working closely with our custom-built Machine Learning accelerators, including Inferentia/Trainium, which represent the forefront of AWS innovation for advanced ML capabilities, powering solutions like Generative AI.
Key job responsibilities
As a ML Compiler Engineer II on the Neuron Compiler Automated Reasoning Group, you will develop and maintain tooling for best-in-class technology for raising the bar of the Neuron Compiler's accuracy and reliability. You will help lead the efforts building fuzzers and specification synthesis tooling for our LLVM-based compiler. You will work in a team with a science focus, and strive to push what we do to the edge of what is known, to best deliver our customers.
Strong software development skills using C++/Python are critical to this role.
A science background in compiler development is strongly preferred. A background in Machine Learning and AI accelerators is preferred, but not required.
In order to be considered for this role, candidates must be currently located or willing to relocate to Seattle (Preferred), Cupertino, Austin, or Toronto.
Key job responsibilities
As a ML Compiler Engineer II on the Neuron Compiler Automated Reasoning Group, you will develop and maintain tooling for best-in-class technology for raising the bar of the Neuron Compiler's accuracy and reliability. You will help lead the efforts building fuzzers and specification synthesis tooling for our LLVM-based compiler. You will work in a team with a science focus, and strive to push what we do to the edge of what is known, to best deliver our customers.
Strong software development skills using C++/Python are critical to this role.
A science background in compiler development is strongly preferred. A background in Machine Learning and AI accelerators is preferred, but not required.
In order to be considered for this role, candidates must be currently located or willing to relocate to Seattle (Preferred), Cupertino, Austin, or Toronto.
Basic Qualifications
This is an excerpt. Read the full job description on Amazon careers →