Strategic Leadership

This role focuses on developing and executing a comprehensive strategy for LLM evaluation, encompassing quality, costs, performance, and responsible AI considerations. The position involves overseeing large-scale, cross-functional evaluation programs and driving the engineering product roadmap for automated evaluation pipelines. It requires utilizing data science skills to design experiments, analyze data, and derive actionable insights to enhance LLM systems and user experience. The role also entails implementing Responsible AI principles, contributing to LLM research, and collaborating with various teams to ensure seamless integration of evaluation processes.