AI Platform Dev Ops Engineer

Job description

Role Summary We are seeking an experienced Cloud Platform Engineer to join our core platform team. In this role, you will be responsible for building, securing, and automating our enterprise Cloud Platforms on AWS. You will go beyond basic pipeline creation by designing and maintaining the underlying infrastructure and CI/CD frameworks that enable our data teams to operate and scale efficiently. Job Responsibilities • Cloud Platform Infrastructure (IaC): Deploy and maintain scalable and secure Cloud workspaces for AI enablement on AWS infrastructure (VPC, PrivateLink, IAM, S3, Lambda, EKS, and Fargate) using Terraform • Architecture guidance: Provide architectural oversight and technical guidance to engineering teams • Unity Catalog Implementation: Automate the governance layer, including metastore configuration, external locations, and access controls within Unity Catalog. • Security Compliance: Ensure the platform adheres to enterprise security standards by managing implementing cloud infrastructure and data protection automated security controls. • Workspace Lifecycle Management: Use Terraform for end-to-end workspace provisioning, ensuring consistent setup across Dev, Acc, and Prod environments. • Governance Cost Control (Policies): Design and implement policies and guardrails to enforce standards • Identity Access Automation: Automate assignment of permissions using Terraform. Manage Service Principals for pipelines and map groups to specific Workspace roles…