AI/ML Evaluation Engineer - Global Solutions Provider (Brazil)

Truelogic Software(2 months ago)

RemoteFull TimeMedior$78,438 - $106,722 (estimated)Operations

About this role

An AI/ML Evaluation Engineer at Truelogic is responsible for driving the accuracy and performance of AI systems by building evaluation pipelines and metrics, and automating evaluation workflows using Python and SQL. The role involves collaborating with AI engineers, QA, and data scientists to define quality standards while analyzing large datasets for biases and inconsistencies. The engineer will also produce clear reports and document processes related to the evaluation of large language models (LLMs) and maintain ground-truth datasets for benchmarking.

View Original Listing

Required Skills

Python
SQL
LLM Evaluation
Metrics Definition
Dataset Management
CI/CD Integration
Data Analysis
Reporting
Collaboration
Documentation

+6 more

About Truelogic Software

www.truelogic.io

Truelogic Software is a leading nearshore software development company focused on providing tailored solutions for American businesses. With over 21 years of experience, the company specializes in staff augmentation, managed teams, and consulting, effectively integrating elite tech and creative talent from Latin America into client teams. Truelogic is dedicated to accelerating digital transformation through agile methodologies, innovative design, and data-driven insights, serving a wide array of industries including finance, healthcare, and entertainment. Their commitment to quality and collaboration has made them a preferred partner for organizations ranging from startups to Fortune 500 companies.