ApplyBlast uses AI to match you with the right jobs, tailor your resume and cover letter, and apply automatically so you can land your dream job faster.

Features

Auto Apply Resume Optimizer Cover Letter Optimizer Interview Prep

Company

Social Media

Need Help?

team@applyblast.com

AI Applied Scientist at Wizard AI - ApplyBlast

AI Applied Scientist

Wizard AI

5 months ago

Remote

Full Time

Senior

0 applicants

View Job Listing

Apply to 100+ jobs

About this role

Applied Scientist at Wizard to own how we measure, understand, and improve the accuracy of our AI agent. This role sits at the intersection of applied ML, evaluation science, and product. You'll define what 'good' looks like for our agent, build the systems to measure it, and lead the science work to improve it, including fine-tuning the LLM judges that power our evaluation pipeline.

Responsibilities

Define and evolve accuracy metrics across the full shopping experience
Design and run experiments to measure improvements and regressions
Build and maintain evaluation datasets, benchmarks, and scoring frameworks
Improve the LLM judges that power our evaluation pipeline
Translate ambiguous product questions into clear, measurable hypotheses and analysis

Skills

Qualifications

PhD in Computer Science or equivalentExperience with LLMs, agents, ranking, or recommendationsHands-on experience with LLM-based systemsExperience with RAG, prompt engineering, fine-tuning, RLHFStrong experimentation foundations in A/B testing and causal inference