Machine Learning Scientist

LMArena(1 month ago)

RemoteFull TimeSenior$141,811 - $191,526 (estimated)Engineering

About this role

A Machine Learning Scientist at LMArena is responsible for designing and analyzing experiments to evaluate AI model behavior, focusing on dimensions such as reasoning, style, robustness, and user preferences. This interdisciplinary role entails collaborating with engineers and product teams to develop novel metrics and methodologies for model comparison, analyzing large-scale human interaction data, and ensuring the scientific integrity of evaluations for LMArena's leaderboard. The ideal candidate will have a PhD or equivalent experience in a relevant field, hands-on experience with large-scale models, and a strong foundation in machine learning and statistics.

View Original Listing

Required Skills

Machine Learning
Experiment Design
Data Analysis
Model Evaluation
Experimentation
Metric Development
Statistical Rigor
Collaboration
Python
PyTorch

+17 more

Qualifications

PhD or equivalent research experience in Machine Learning, Natural Language Processing, Statistics, or a related field

About LMArena

www.lmarena.ai

LMArena is an innovative platform designed for evaluating AI through human preferences. It allows users to compare various AI models, gather insights, and share their feedback to enhance AI development and research. The platform features a public leaderboard, providing a competitive edge for the best AI models based on user interactions and performance assessments. LMArena serves as a comprehensive resource for those looking to explore and engage with advanced AI technologies.