Senior LLM Quality Analyst

MagicSchool(1 month ago)

RemoteFull TimeSenior$120,000 - $185,000Engineering

About this role

As a Senior LLM Quality Analyst at MagicSchool, you will collaborate with the Trust, Safety, and Quality team to ensure the highest standards for AI outputs tailored for educators and students. Your responsibilities will include designing and executing prompt engineering experiments, maintaining response quality reporting dashboards using Metabase, and evaluating AI model performance from an educational perspective. The role requires strong analytical skills, experience in data analysis, and ideally a background in K-12 education or the EdTech industry.

View Original Listing

Required Skills

Data Analysis
Prompt Engineering
Experiment Design
Performance Reporting
Dashboard Maintenance
SQL
Analytical Skills
BI Tools
Critical Thinking
Communication Skills

+9 more

About MagicSchool

www.magicschool.ai

MagicSchool is a leading AI platform designed specifically for educators, students, and schools, dedicated to amplifying educator impact and unlocking student potential. Trusted by over 6 million users globally, it offers 80+ AI tools that significantly reduce teacher workload, allowing educators to save up to 10 hours a week and combat burnout. MagicSchool transforms the educational experience with resources that empower personalized learning and provide essential training, all while ensuring robust security and data protection for users. With a commitment to innovation in prescriptive analytics and integration with existing learning management systems, MagicSchool is at the forefront of reshaping modern education.