Evaluation Engineer

This role focuses on building the evidence and evaluation frameworks to determine whether AI agents are ready for useful work within business workflows. The position involves designing tasks, creating evaluation environments, and developing data pipelines to distinguish correct actions from plausible responses. Success in this role enables the team to measure agent quality, reliability, and cost while tracing failures back to actionable causes.