Senior Software Development Engineer - AI / Data Science

Job description

from IBM careers

Introduction

At IBM Software, we transform client challenges into solutions. Building the world’s leading AI-powered, cloud-native products that shape the future of business and society. Our legacy of innovation creates endless opportunities for IBMers to learn, grow, and make an impact on a global scale. Working in Software means joining a team fueled by curiosity and collaboration. You’ll work with diverse technologies, partners, and industries to design, develop, and deliver solutions that power digital transformation. With a culture that values innovation, growth, and continuous learning, IBM Software places you at the heart of IBM’s product and technology landscape. Here, you’ll have the tools and opportunities to advance your career while creating software that changes the world.

Your role and responsibilities

Platform Design & Engineering

•       Design, build, and maintain a scalable AI Platform that supports multiple engineering teams in delivering natural language conversation, RAG-based retrieval, and AI-driven data solutions.

•       Develop core platform services including LLM routing, model abstraction layers, prompt management, and inference orchestration across cloud and on-premise infrastructure.

•       Architect and implement RAG pipelines — including vector store integration, document ingestion, chunking strategies, and retrieval optimization — enabling teams to ground AI responses in enterprise data.

•       Build secure, governed data access patterns that allow AI agents and models to query complex structured and unstructured data sources safely and efficiently.