Member of Technical Staff - Evaluations

Reflection AI(1 month ago)

HybridFull TimeSenior$209,500 - $277,594 (estimated)Engineering

About this role

The Member of Technical Staff - Evaluations at Reflection is responsible for conducting comparative analyses to enhance understanding of model capabilities and refining evaluation systems and processes. This role involves developing frameworks that effectively measure reasoning, alignment, and usefulness while collaborating with various teams to translate insights into tangible model improvements. The position requires strong statistical analysis skills, familiarity with LLM evaluation methodologies, and the ability to work in a dynamic startup environment.

View Original Listing

Required Skills

Statistical Analysis
Experimental Design
LLM Evaluation
Comparative Analysis
Model Improvement
Evaluation Frameworks
Data Feedback Loops
Collaboration
Detail-Oriented
High Agency

About Reflection AI

reflection.ai

Reflection AI is a pioneering technology company focused on developing groundbreaking open intelligence solutions aimed at enhancing accessibility for users. The company is dedicated to building advanced autonomous systems that leverage artificial intelligence to drive transformative outcomes across various sectors. With a commitment to innovation, Reflection AI aims to make sophisticated intelligence tools and resources universally available, fostering collaboration and knowledge sharing.