Agentic AI Evaluation Engineer

A specialist in the Agent Evaluation team at Comcast is responsible for validating conversational AI agents by designing evaluation pipelines, defining quality metrics, and managing test datasets before release. The role involves building automated and human-in-the-loop systems to ensure agents meet product expectations while partnering with engineering teams to integrate evaluation into CI/CD workflows. Collaborators will conduct experiments to drive improvements in agent performance and documentation.