AI/ML Evaluation Engineer - Global Solutions Provider (Mexico)

Truelogic Software

4 months ago

4.2 on Glassdoor

Remote

Full Time

Medior

0 applicants

View Job Listing

Apply to 100+ jobs

About this role

The AI/ML Evaluation Engineer at Truelogic is responsible for enhancing the accuracy and reliability of AI systems by developing evaluation pipelines, metrics, and datasets. This technical role requires expertise in Python and SQL to analyze outputs from large language models (LLMs) and implement LLM-as-Judge evaluations, while collaborating closely with AI engineers, data scientists, and product managers to establish quality standards. The engineer will also automate workflows, diagnose model performance issues, and generate comprehensive reports on evaluation findings.

Skills

About Truelogic Software

www.truelogic.io

Truelogic Software is a leading nearshore software development company focused on providing tailored solutions for American businesses. With over 21 years of experience, the company specializes in staff augmentation, managed teams, and consulting, effectively integrating elite tech and creative talent from Latin America into client teams. Truelogic is dedicated to accelerating digital transformation through agile methodologies, innovative design, and data-driven insights, serving a wide array of industries including finance, healthcare, and entertainment. Their commitment to quality and collaboration has made them a preferred partner for organizations ranging from startups to Fortune 500 companies.