Software Engineer, Model Serving System

This role involves building and optimizing the end-to-end path for Microsoft AI models to run reliably in production on the Microsoft Azure cloud platform. The position focuses on distributed model serving systems, inference engine optimization, and benchmarking to ensure models are shippable, measurable, and evaluable. The engineer will collaborate with various teams to streamline the path from model release to production availability.