Microsoft
This role involves designing, building, and operating scalable backend services to handle high-volume AI inference workloads. Key responsibilities include developing intelligent scheduling systems, optimizing throughput and latency, and ensuring high availability through robust monitoring and on-call rotations. The position requires close collaboration with product and platform teams to onboard new models and support enterprise adoption while maintaining high engineering standards.
Headquarters
Redmond, Washington, United States
Company Size
10001+ employees
Founded
1975
Explore Microsoft products and services and support for your home or business. Shop Microsoft 365, Copilot, Teams, Xbox, Windows, Azure, Surface and more.
Microsoft Takes a Stand Against the Trump Administration in Anthropic Fight - The New York Times
1 day ago
Microsoft Teams can now track what room you're in
1 day ago
Microsoft and retired military chiefs back AI company Anthropic in court fight against Pentagon
16 hours ago
Headquarters
San Francisco, CA
Company Size
201-500 employees
Founded
2018
Industry
Technology
Glassdoor Rating
4.2 / 5
Sarah Johnson
Chief Executive Officer
Michael Chen
Chief Technology Officer
Emily Williams
VP of Engineering
David Rodriguez
VP of Product
Jessica Thompson
Chief Financial Officer
Andrew Park
VP of Sales
View leadership team, funding history,
and employee contacts for Microsoft.
Microsoft didn’t post a salary, so this is our estimate from similar listings.
15% below the average for this role
Microsoft says ungoverned AI agents could become corporate 'double agents.' Its fix costs $99 a month.
3 days ago
Staff Backend Engineer
Zeta Global
Staff Software Engineer, Inference Platform
Cerebras Systems
Senior Backend Engineer (High-Throughput Platforms)
Bright Vision Technologies
Software Engineer, Inference Platform
Cerebras Systems
Senior/Staff Inference Reliability Engineer
Parasail
Software Engineer, Monetization ML Infrastructure
OpenAI