Evaluations Engineer

Vals AI is seeking an engineer to own the leaderboards for evaluating large language models across diverse domains like law, tax, and coding. The role involves testing new model releases, analyzing error modes, maintaining the model library, and collaborating with research and communications teams to publish benchmark results. This position requires strong Python skills and the ability to work within a fast-paced, high-intensity startup environment.