LLM Evaluation Lead

This role focuses on owning the diagnostic loop for LLM-based clinical services, designing experiments to isolate root causes of failure modes, and testing candidate fixes to verify improvements. The position involves developing the evaluation roadmap and quality bar for AI services, utilizing evaluation platforms to build golden sets and regression suites, and partnering with clinical reviewers and product managers to prioritize and address critical issues. The role also includes mentoring team members, supporting clinical guideline updates, and documenting diagnostic playbooks to ensure consistent and scalable evaluation practices.