Model Serving Engineer

A Model Serving Engineer at Bright Vision Technologies designs, builds, and operates high-performance inference platforms for serving large machine learning models in production. The role focuses on optimizing GPU utilization, implementing autoscaling strategies, and ensuring system reliability across diverse workloads like LLMs and vision models. Candidates will collaborate with ML and product teams to integrate serving solutions with observability platforms and drive durable reliability improvements.