Model Serving and Routing Engineer

This role focuses on building dependable and efficient serving and routing systems for AI agents, ensuring model execution meets business operational standards. The position involves developing inference services, optimizing performance through scheduling and caching, and implementing robust observability and failure recovery mechanisms. Success is measured by predictable model access for agents and researchers, alongside improved cost and latency metrics for task completion.