Software Engineer 1 - AI Quality

Boomi (13 days ago)

RemoteFull TimeJunior$54,441 - $73,852 (estimated)Engineering

About this role

A Software Engineer in AI Quality at Boomi focuses on ensuring the quality, reliability, and performance of Generative AI features and Agentic applications. The role involves defining testing strategies and evaluation frameworks, improving AI output evaluation, and contributing to quality standards for AI-driven products. This position is suited for an entry-level engineer who will grow skills in software engineering and AI quality practices.

View Original Listing

Required Skills

Python
Prompt Testing
Output Validation
Behavioral Testing
Evaluation Frameworks
Test Automation
Functional Testing
Integration Testing
CI/CD
API Interactions

+5 more

Qualifications

Bachelor's Degree in Computer Science or Software Engineering

About Boomi

boomi.com

New Relic is a SaaS observability platform that helps engineering and ops teams monitor, analyze, and troubleshoot applications, infrastructure, and user experiences in real time. It offers application performance monitoring (APM), infrastructure and synthetic monitoring, distributed tracing, logs, real user monitoring, dashboards and alerting, plus a powerful query language (NRQL) for custom analytics. New Relic One centralizes telemetry from agents, OpenTelemetry, and many integrations to correlate metrics, traces, and logs and surface anomalies and root causes. Organizations use it to accelerate incident response, optimize performance, and gain end-to-end visibility across cloud-native and legacy environments.