ApplyBlast uses AI to match you with the right jobs, tailor your resume and cover letter, and apply automatically so you can land your dream job faster.

Features

Auto Apply Resume Optimizer Cover Letter Optimizer Interview Prep

Company

Social Media

Need Help?

team@applyblast.com

Machine Learning Engineer, Agent Oversight at Scale AI - ApplyBlast

Machine Learning Engineer, Agent Oversight

Scale AI

3 months ago

New York, New York, United States

Onsite

Full Time

Senior

1 applicant

View Job Listing

Apply to 100+ jobs

About this role

The Machine Learning Engineer on the Agent Oversight team will own the end‑to‑end lifecycle of production agents, building observability tools, designing evaluation frameworks, and creating improvement loops to ensure reliable performance. The role involves developing ML systems for drift, anomaly, and misalignment detection, running rigorous experiments, and collaborating with cross‑functional partners to translate enterprise and government requirements into robust platform capabilities.

Responsibilities

Build observability into production agent behavior
Design and automate evaluation methodologies and metrics at scale
Develop and operate ML systems for drift, anomaly, and misalignment detection

Skills

About Scale AI

scale.com

Headquarters

San Francisco, California, United States

Company Size

501-1000 employees

Founded

2016

View Profile

Scale AI is a full-stack AI company that delivers reliable AI systems, high-quality training data, and AI application deployments for AI labs, governments, and Fortune 500 enterprises. Its offerings span data engineering and human-in-the-loop annotation for frontier model training, a GenAI Platform for enterprise AI adoption, and Scale Donovan for public sector and defense use cases. Scale serves industries including healthcare, energy, robotics, and national security, and is trusted by 90% of the world's leading generative AI model builders.