ApplyBlast uses AI to match you with the right jobs, tailor your resume and cover letter, and apply automatically so you can land your dream job faster.

Features

Auto Apply Resume Optimizer Cover Letter Optimizer Interview Prep

Company

Social Media

Need Help?

team@applyblast.com

QA / AI Evaluation Engineer at Appnovation Technologies - ApplyBlast

QA / AI Evaluation Engineer

Appnovation Technologies

1 month ago

3.6 on Glassdoor

London, England, United Kingdom

Onsite

Full Time

Senior

0 applicants

View Job Listing

Apply to 100+ jobs

About this role

The QA / AI Evaluation Engineer will lead large‑scale evaluation efforts to measure factual grounding and accuracy improvements in AI‑generated answers. They will design and automate test frameworks, build metrics dashboards, and collaborate with engineering to verify fixes, while communicating results to both technical and non‑technical stakeholders. The role emphasizes statistical analysis, Python‑based data science, and integration of evaluation suites into CI/CD pipelines.

Responsibilities

Run large-scale evaluation batches and measure factual grounding
Build and maintain metrics framework for answer quality improvement
Automate regression and evaluation suites and integrate into CI/CD

Skills

Qualifications

Bachelor's Degree in a technical field

About Appnovation Technologies

appnovation.com

Headquarters

Vancouver, British Columbia, Canada

Company Size

201-500 employees

Founded

2007

View Profile

Appnovation is the Open Source AI Product Development Company, building production-ready AI products for enterprises from strategy through to delivery and support. Leveraging nearly two decades of open source expertise, they partner with global enterprises to design, build, and govern AI-powered products and platforms using their proprietary Evolve™ open source AI platform. Appnovation serves clients across industries including healthcare and pharmaceuticals, offering embedded engineering squads and end-to-end AI product development services.