ML Inference Engineer

This role focuses on optimizing generative media models for ultra-low-latency and high-throughput environments by designing novel frameworks and an in-house inference runtime. The engineer will drive model performance for diffusion models and implement optimizations using tools like torch.compile and custom CUDA kernels. Collaboration with model partner teams is essential to integrate models into the platform.