Engineering Manager, Inference Routing and Performance
Anthropic
About this role
Anthropic is seeking a highly experienced engineering manager with a deep systems background to lead the inference routing team. The role involves owning the technical roadmap for cluster-level inference efficiency, managing operational reliability, and building and developing the team. The position focuses on optimizing large-scale AI inference systems to improve throughput, latency, and system safety.
Skills
Qualifications
About Anthropic
anthropic.comAnthropic is an AI safety and research company focused on building reliable, interpretable, and steerable AI systems. It develops large language models (branded as Claude) and offers APIs and enterprise products that let organizations integrate conversational AI with safety-focused controls, moderation, and privacy features. The company prioritizes interpretability and alignment research, publishes technical work, and engages with policymakers to reduce risks from advanced AI. Customers choose Anthropic for its safety-first approach, controllability tools, and research-driven models.
Recent company news
Time MagazineHow Anthropic Became the Most Disruptive Company in the World
1 day ago
WSJAnthropic Sues U.S. Defense Department, Pete Hegseth for Targeting the Company
2 days ago
The New York TimesMicrosoft Takes a Stand Against the Trump Administration in Anthropic Fight - The New York Times
1 day ago
WIREDAnthropic Claims Pentagon Feud Could Cost It Billions
2 days ago
CNNAnthropic sues the Trump administration after it was designated a supply chain risk
2 days ago
About Anthropic
Headquarters
San Francisco, CA
Company Size
201-500 employees
Founded
2018
Industry
Technology
Glassdoor Rating
4.2 / 5
Leadership Team
Sarah Johnson
Chief Executive Officer
Michael Chen
Chief Technology Officer
Emily Williams
VP of Engineering
David Rodriguez
VP of Product
Jessica Thompson
Chief Financial Officer
Andrew Park
VP of Sales
Unlock Company Insights
View leadership team, funding history,
and employee contacts for Anthropic.
Salary
$405k – $485k
per year
More jobs at Anthropic
Similar Jobs
Inference Runtime, Engineering Manager
OpenAI
Senior Engineer 2: Inference Optimizations
DigitalOcean
Performance Engineer - Inference
Cerebras Systems
Director of Engineering, Inference Services
CoreWeave
Senior Software Engineer - Model Performance
Inference
Member of Technical Staff - ML Systems & Inference
Gimlet Labs