ApplyBlast uses AI to match you with the right jobs, tailor your resume and cover letter, and apply automatically so you can land your dream job faster.

Features

Auto Apply Resume Optimizer Cover Letter Optimizer Interview Prep

Company

Social Media

Need Help?

team@applyblast.com

Senior AI/ML Test and Evaluation Engineer at OpenTeams - ApplyBlast

Senior AI/ML Test and Evaluation Engineer

OpenTeams

1 month ago

Washington, District of Columbia, United States

Hybrid

Full Time

Senior

0 applicants

View Job Listing

Apply to 100+ jobs

About this role

The Senior AI/ML Test and Evaluation Engineer will design, implement, and operate benchmark execution and evaluation harnesses for AI models and agentic workflows. They will develop evaluation methodologies that combine automated metrics with structured human expert judgment, produce defensible evaluation reports, and document limitations and failure modes for senior stakeholders. The role involves hands‑on engineering on an open‑source toolchain and may require up to 15% travel to government facilities.

Responsibilities

Design and operate benchmark execution and evaluation harnesses
Develop evaluation methodologies combining automated metrics with expert judgment
Produce defensible evaluation reports for senior stakeholders

Skills

Qualifications

Bachelor's degree in Computer Science, Mathematics, Engineering, or related field

About OpenTeams

openteams.com

Headquarters

Austin, Texas, United States

Company Size

11-50 employees

Founded

2019

View Profile

OpenTeams helps enterprises build and own their AI infrastructure through open-source foundations, offering products like Nebari (a production-ready AI infrastructure layer), OpenTeams Nexus (a private enterprise AI hub), and OpenTeams Collab (a desktop app for agentic workflows). Their mission, 'AI You Own,' focuses on replacing rented AI subscriptions with fully owned, internally controlled AI environments where models, data, and workflows remain within the organization. Founded by Travis Oliphant (creator of NumPy and SciPy), OpenTeams serves industries including biotech, defense, aerospace, energy, and investment management.