Evals & Quality Lead

This role owns the end-to-end evaluation and quality measurement for Pencil's AI-driven advertising creative agents, ensuring output meets client standards. The position involves defining core quality metrics, designing judging methodologies, and maintaining a representative golden dataset to drive product improvements. Additionally, the role is responsible for presenting quality evidence to customers and managing the public evals site.