Machine Learning Scientist

A Machine Learning Scientist at LMArena is responsible for designing and analyzing experiments to evaluate AI model behavior, focusing on dimensions such as reasoning, style, robustness, and user preferences. This interdisciplinary role entails collaborating with engineers and product teams to develop novel metrics and methodologies for model comparison, analyzing large-scale human interaction data, and ensuring the scientific integrity of evaluations for LMArena's leaderboard. The ideal candidate will have a PhD or equivalent experience in a relevant field, hands-on experience with large-scale models, and a strong foundation in machine learning and statistics.