Senior Product Manager - Tech, GenAI, Amazon Rufus
Amazon · London, United Kingdom · Project/Program/Product Management--Technical
About this role
Amazon is hiring a senior-level Product Manager based in London, United Kingdom. The posting calls out experience with LLMs, Tableau.
- Role
- Product Manager
- Function
- product
- Level
- senior
- Track
- Individual contributor
- Employment
- Full-time
- Location
- London, United Kingdom
- Department
- Project/Program/Product Management--Technical
- Posted
- May 8, 2026
More roles at Amazon
Job description
from Amazon careersAmazon's Rufus AI team is building the future of conversational shopping. Rufus helps hundreds of millions of customers find and discover products through natural language, and behind every response is an automated quality measurement system powered by LLM-as-a-Judge (LLMAJ) technology. We are seeking a Sr. Product Manager-Tech to own the quality governance, global scaling, and operational excellence of this judge portfolio. You will work alongside Language Engineers who build and tune judges, Product Managers who define quality criteria and evaluation standards, Data Scientists who operate evaluation pipelines, and Engineering teams who build the infrastructure that runs evaluations. This is a high-autonomy role: you own your domain end-to-end and are expected to drive decisions, not just track workstreams. This role sits at the intersection of AI evaluation, product management, and applied tooling. You will own the governance framework for a portfolio of dozens of LLM judges that power critical evaluation metrics used for release decisions, competitive benchmarking, and leadership reporting. You will drive the localization of judges from en-US to 5+ international marketplaces, facilitate model evaluation and debugging workflows, and build purpose-built tools and agents to automate governance operations at scale. Key job responsibilities - Own the LLMAJ governance framework: judge…