AI/ML Evaluation Engineer - Global Solutions Provider (Mexico)

Truelogic Software(2 months ago)

RemoteFull TimeMedior$82,591 - $112,098 (estimated)Operations

About this role

The AI/ML Evaluation Engineer at Truelogic is responsible for enhancing the accuracy and reliability of AI systems by developing evaluation pipelines, metrics, and datasets. This technical role requires expertise in Python and SQL to analyze outputs from large language models (LLMs) and implement LLM-as-Judge evaluations, while collaborating closely with AI engineers, data scientists, and product managers to establish quality standards. The engineer will also automate workflows, diagnose model performance issues, and generate comprehensive reports on evaluation findings.

View Original Listing

Required Skills

Python
SQL
LLM Evaluation
Data Analysis
Automation
Benchmarking
Reporting
Collaboration
Dataset Management
Metric Calculation

+6 more

About Truelogic Software

www.truelogic.io

Truelogic Software is a leading nearshore software development company focused on providing tailored solutions for American businesses. With over 21 years of experience, the company specializes in staff augmentation, managed teams, and consulting, effectively integrating elite tech and creative talent from Latin America into client teams. Truelogic is dedicated to accelerating digital transformation through agile methodologies, innovative design, and data-driven insights, serving a wide array of industries including finance, healthcare, and entertainment. Their commitment to quality and collaboration has made them a preferred partner for organizations ranging from startups to Fortune 500 companies.