ApplyBlast uses AI to match you with the right jobs, tailor your resume and cover letter, and apply automatically so you can land your dream job faster.

Features

Auto Apply Resume Optimizer Cover Letter Optimizer Interview Prep

Company

Social Media

Need Help?

team@applyblast.com

Research Engineer, AI Evaluations at Karya - ApplyBlast

Research Engineer, AI Evaluations

Karya

3 days ago

3.9 on Glassdoor

Bengaluru, Karnataka, India

Hybrid

Full Time

Senior

0 applicants

View Job Listing

Apply to 100+ jobs

About this role

Karya's AI Evaluations team measures how well AI models serve people in languages and contexts global benchmarks miss. As a Research Engineer, you will design, build, and run evaluations end-to-end across eval design, model deployment, statistical analysis, and engineering. The work spans ASR, TTS, machine translation, and chat, with newer frontiers in agentic and multimodal evaluation.

Responsibilities

Design benchmarks, rubrics, and metrics for AI model evaluations
Deploy and serve models through APIs and self-hosted GPU inference
Analyze evaluation data using statistical methods and validate automated judges

Skills

About Karya

karya.in

Headquarters

Bangalore, Karnataka, India

Company Size

51-200 employees

Founded

2022

View Profile

Karya designs and delivers end-to-end pipelines across data collection, evaluation, and AI deployment, with a focus on India's linguistic, cultural, and operational complexity across domains like healthcare, agriculture, and education. They produce foundational datasets and evaluation benchmarks — including large-scale conversational speech datasets across 22 official Indian languages — while building dignified digital work for low-opportunity communities. Karya operates as both a data services provider and a mission-driven organization contributing to AI systems that better reflect the languages and contexts in which they are used.