Incubator for Artificial Intelligence
The Incubator for AI (i.AI) is seeking AI Evaluation Engineers to implement evaluation methods and run experiments across AI products, focusing on model-level assessment of accuracy, bias, and safety. Team members will embed within product development teams to design robust evaluations that inform product decisions and measure the impact on public service delivery. This role involves collaborating with technical and non-technical stakeholders to turn evaluation findings into practical recommendations for improving government services.
Our mission is to pioneer transformative applications of AI to build a better Britain
Headquarters
San Francisco, CA
Company Size
201-500 employees
Founded
2018
Industry
Technology
Glassdoor Rating
4.2 / 5
Sarah Johnson
Chief Executive Officer
Michael Chen
Chief Technology Officer
Emily Williams
VP of Engineering
David Rodriguez
VP of Product
Jessica Thompson
Chief Financial Officer
Andrew Park
VP of Sales
View leadership team, funding history,
and employee contacts for Incubator for Artificial Intelligence.
Right around the average for this role
Evaluation Specialist Sr
Aptive Pest Control
Lead the development of metrics and evaluation methodologies to measure the quality, accuracy, and usability of AI systems. Design and analyze online and offline experiments to quantify product improvements and identify opportunities for optimization. Build scalable data pipelines, dashboards, and analytical tools that enable continuous quality monitoring. Apply statistical analysis, machine learning, and data mining techniques to extract insights from large-scale datasets. Partner with engineering, research, and product teams to shape technical direction and prioritize investments using data-driven recommendations. Investigate quality regressions, identify root causes, and propose measurable improvements. Shape best practices for AI evaluation, experimentation, and responsible AI measurement across multiple products, mentoring scientists in their adoption. Communicate technical findings clearly to both engineering and business stakeholders. Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research) OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics, predictive analytics, research) OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research) Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 9+ years related experience (e.g., statistics, predictive analytics, research) OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research) OR equivalent experience. 5+ years experience creating publications (e.g., patents, libraries, peer-reviewed academic papers). 2+ years experience presenting at conferences or other events in the outside research/industry community as an invited speaker. 5+ years experience conducting research as part of a research program (in academic or industry settings). 3+ years experience developing and deploying live production systems, as part of a product team. 3+ years experience developing and deploying products or systems at multiple points in the product cycle from ideation to shipping.
Microsoft
QA / AI Evaluation Engineer
Appnovation Technologies
Lead AI Scientist
Danaher Corporation
Technical Lead, Copilot Offline Evaluation Platform
Microsoft
Data Scientist – GenAI & AI Engineering
Experian