Machine Learning Scientist

LMArena

3 months ago

Remote

Full Time

Senior

0 applicants

View Job Listing

Apply to 100+ jobs

About this role

A Machine Learning Scientist at LMArena is responsible for designing and analyzing experiments to evaluate AI model behavior, focusing on dimensions such as reasoning, style, robustness, and user preferences. This interdisciplinary role entails collaborating with engineers and product teams to develop novel metrics and methodologies for model comparison, analyzing large-scale human interaction data, and ensuring the scientific integrity of evaluations for LMArena's leaderboard. The ideal candidate will have a PhD or equivalent experience in a relevant field, hands-on experience with large-scale models, and a strong foundation in machine learning and statistics.

Skills

Qualifications

PhD or equivalent research experience in Machine Learning, Natural Language Processing, Statistics, or a related field

About LMArena

www.lmarena.ai

LMArena is an innovative platform designed for evaluating AI through human preferences. It allows users to compare various AI models, gather insights, and share their feedback to enhance AI development and research. The platform features a public leaderboard, providing a competitive edge for the best AI models based on user interactions and performance assessments. LMArena serves as a comprehensive resource for those looking to explore and engage with advanced AI technologies.