AI Data Engineer
Veeva Systems(1 month ago)
About this role
This role focuses on ensuring the reliability, accuracy, and safety of Veeva AI Agents by designing and executing rigorous evaluation and validation methodologies. The position involves building and maintaining automated evaluation frameworks and high-fidelity datasets to test real-world and edge-case scenarios. It plays a key part in monitoring and analyzing AI agent performance and behavior over time. The role also requires clear communication of findings and risks to engineering and product stakeholders within a mission-driven, life sciences–focused organization.
Required Skills
- Evaluation Strategy
- Test Planning
- LLM Evaluation
- Data Quality
- Dataset Curation
- Prompt Engineering
- Bias Detection
- Safety Assessment
- Automation Pipelines
- Root Cause Analysis
+9 more
Qualifications
- Bachelor's degree in Data Science
- Bachelor's degree in Machine Learning
- Bachelor's degree in Computer Science
About Veeva Systems
veeva.comNew Relic is a cloud-based observability platform that helps engineering teams collect, store, and analyze telemetry — metrics, traces, logs, and events — from applications, infrastructure, and end‑user experience. It offers APM, distributed tracing, infrastructure monitoring, log management, real‑user and synthetic monitoring, dashboards, alerts, and many integrations to troubleshoot performance and reliability issues. The platform emphasizes a unified telemetry model and powerful query/visualization tools, plus AI/ML‑driven insights to speed root‑cause analysis and incident response. Delivered as SaaS with lightweight agents and APIs, New Relic is used by developers, SREs, and ops teams for full‑stack visibility.
Apply instantly with AI
Let ApplyBlast auto-apply to jobs like this for you. Save hours on applications and land your dream job faster.
More jobs at Veeva Systems
Similar Jobs
AI/ML Evaluation Engineer - Global Solutions Provider (Mexico)
Truelogic Software(2 months ago)
Test Engineer-AI/LLM
OPPO US Research Center(7 months ago)
Senior Data Quality Engineer, ML (India)
Code and Theory(1 month ago)
AI/ML Evaluation Engineer - Global Solutions Provider (Brazil)
Truelogic Software(2 months ago)
Senior AI Engineer, GenAI & ML Evaluation Frameworks - Grafana Ops, AI/ML | Canada | Remote
Grafana Labs(7 months ago)
Senior AI Engineer, GenAI & ML Evaluation Frameworks - Grafana Ops, AI/ML | USA | Remote
Grafana Labs(7 months ago)