AI/ML Evaluation Engineer - Global Solutions Provider (Colombia)

Truelogic Software(2 months ago)

RemoteFull TimeJunior$54,282 - $73,661 (estimated)Operations

About this role

An AI/ML Evaluation Engineer at Truelogic is responsible for enhancing the performance and reliability of next-generation AI systems through the development of evaluation pipelines, metrics, and datasets. This role entails writing Python and SQL scripts to assess outputs from large language models (LLMs), designing scoring rubrics for evaluations, and automating workflows for continuous integration and delivery. Collaboration with AI engineers, QA, data scientists, and product managers is critical to establish quality standards and ensure model outputs align with real-world expectations.

View Original Listing

Required Skills

Python
SQL
LLM Evaluation
Data Analysis
Metrics Calculation
Dataset Management
Automation Pipelines
Collaboration
Documentation
Statistical Concepts

+6 more

About Truelogic Software

www.truelogic.io

Truelogic Software is a leading nearshore software development company focused on providing tailored solutions for American businesses. With over 21 years of experience, the company specializes in staff augmentation, managed teams, and consulting, effectively integrating elite tech and creative talent from Latin America into client teams. Truelogic is dedicated to accelerating digital transformation through agile methodologies, innovative design, and data-driven insights, serving a wide array of industries including finance, healthcare, and entertainment. Their commitment to quality and collaboration has made them a preferred partner for organizations ranging from startups to Fortune 500 companies.