Inference Infrastructure Engineer

This role involves designing, deploying, and operating production AI inference systems, determining optimal model placement, parallelism, and serving strategies across GPU hardware. The position requires benchmarking, debugging, and automating inference infrastructure to make serving expertise programmatic and reliable. You will own the outcomes of model lifecycle management, concurrency limits, and incident resolution while working within a small, senior engineering team.