Senior Product Manager, TPU Inference

Job description

At Google, we put our users first. The world is always changing, so we need Product Managers who are continuously adapting and excited to work on products that affect millions of people every day.

In this role, you will work cross-functionally to guide products from conception to launch by connecting the technical and business worlds. You can break down complex problems into steps that drive product development.

One of the many reasons Google consistently brings innovative, world-changing products to market is because of the collaborative work we do in Product Management. Our team works closely with creative engineers, designers, marketers, etc. to help design and develop technologies that improve access to the world's information. We're responsible for guiding products throughout the execution cycle, focusing specifically on analyzing, positioning, packaging, promoting, and tailoring our solutions to our users.

The mission of the TPU Inference team is to help Google Cloud customers, from AI labs to major enterprises, serve their AI/ML models efficiently and at scale. As part of one of Google Cloud’s fastest-growing businesses, we’re positioned at the frontier of AI development, designing and deploying the production systems of customers operating at a global scale. We are a small but mighty team – join us for a unique opportunity to shape the future of TPU!

The AI and Infrastructure team is redefining what’s possible. We empower Google customers with breakthrough capabilities and insights by delivering AI and Infrastructure at unparalleled scale, efficiency, reliability and velocity. Our customers include Googlers, Google Cloud customers, and billions of Google users worldwide.

We're the driving team behind Google's groundbreaking innovations, empowering the development of our cutting-edge AI models, delivering unparalleled computing power to global services, and providing the essential platforms that enable developers to build the future. From software to hardware our teams are shaping the future of world-leading hyperscale computing, with key teams working on the development of our TPUs, Vertex AI for Google Cloud, Google Global Networking, Data Center operations, systems research, and much more.

Responsibilities

• Drive partnership with open source developer projects communities, ensuring TPU is natively supported, optimized, and adopted upstream.
  
• Identify and remove barriers to entry for Cloud customers serving on TPU.
• Deliver the industry’s best price-performance for TPU, ensuring customers can achieve optimal performance and efficiency.
• Anticipate market shifts to ensure the TPU inference stack remains exceptional.
• Collaborate with Google Cloud platform teams (e.g., GKE, Vertex AI) to define well lit paths and reference solutions.

Minimum qualifications:

• Bachelor's degree or equivalent practical experience.
  
• 8 years of experience in product management or related technical role.
  
• Experience in managing and launching technical systems, platforms, or infrastructure products.

Preferred qualifications:

• Experience enabling and growing developer ecosystems, open-source communities, or platform-level architectures.
• Deep technical understanding of AI/ML infrastructure, AI accelerators, and accelerator software stacks.
• Strong business foundation with the ability to synthesize market trends, engaging strategies, and technical inputs.