Inference Research Intern

The Inference Research team is dedicated to building the next generation of efficient, scalable, and reliable serving systems for large foundation models, directly contributing to the mission of advancing open and transparent AI. As a research intern, you will dive into the complexities of distributed inference, compiler-aware optimization, and novel inference-time computation strategies to co-design and implement cross-layer optimizations across models, systems, and hardware. Projects aim to unlock unprecedented performance and scale for foundation models, enabling faster serving, larger model deployment, and robust evaluation under realistic serving workloads.