AI Inference Engineer

Perplexity · San Francisco · AI

mid machine learning AI Engineer ic · Posted Jun 10, 2024
AI Summary
Develop and optimize AI inference APIs for real-time deployment of large-scale ML models. Requires experience with PyTorch/TensorFlow, LLM architectures, inference optimization techniques like quantization and continuous batching, and GPU programming with CUDA.
Upgrade to Pro to unlock AI summaries →

We are looking for an AI Inference engineer to join our growing team. Our current stack is Python, Rust, C++, PyTorch, Triton, CUDA, Kubernetes. You will have the opportunity to work on large-scale deployment of machine learning models for real-time inference.

Responsibilities

  • Develop APIs for AI inference that will be used by both internal and external customers

  • Benchmark and address bottlenecks throughout our inference stack

  • Improve the reliability and observability of our systems and respond to system outages

  • Explore novel research and implement LLM inference optimizations

Qualifications

  • Experience with ML systems and deep learning frameworks (e.g. PyTorch, TensorFlow, ONNX)

  • Familiarity with common LLM architectures and inference optimization techniques (e.g. continuous batching, quantization, etc.)

  • Understanding of GPU architectures or experience with GPU kernel programming using CUDA

 

All Perplexity Jobs Browse machine learning roles mid positions