Evaluation Engineer

This role involves building and maintaining the evaluation stack used to assess frontier image and video models, including automated benchmarking, LLM-as-judge pipelines, and human evaluation. The position requires designing comprehensive evaluation metrics across various modalities and ensuring the reliability and stability of the evaluation systems. The role also focuses on benchmarking models against competitors and identifying qualitative shortcomings in model outputs.