Senior AI Engineer, GenAI & ML Evaluation Frameworks - Grafana Ops, AI/ML | USA | Remote
Grafana Labs(7 months ago)
About this role
A Senior Engineer for GenAI & ML Evaluation Frameworks at Grafana Labs will help mature the company’s capabilities for evaluating generative AI and LLM systems. The role supports building scalable evaluation infrastructure and aligning model behavior with product goals within Grafana’s AI teams. This is a remote-first position focused on cross-team collaboration and impact.
Required Skills
- GenAI Evaluation
- LLM Evaluation
- Prompt Engineering
- Structured Evaluation
- Dataset Management
- Tooling Development
- CI/CD Integration
- Metrics Definition
- Regression Tracking
- Automation
+2 more
About Grafana Labs
grafana.comGrafana Labs develops Grafana, an open-source, composable observability and analytics platform for visualizing metrics, logs, and traces from virtually any data source. The product provides flexible, customizable dashboards, alerting, and a plugin-driven ecosystem with integrations like Prometheus, Loki, Tempo, Elasticsearch, and cloud provider services. Grafana Labs also offers Grafana Cloud and enterprise editions that add managed hosting, scalability, security, and commercial support for organizations with production SLAs. Teams choose Grafana for its extensibility, strong open-source community, and developer-friendly UX for monitoring and troubleshooting.
Apply instantly with AI
Let ApplyBlast auto-apply to jobs like this for you. Save hours on applications and land your dream job faster.
More jobs at Grafana Labs
Similar Jobs
Senior Data Quality Engineer, ML (India)
Code and Theory(1 month ago)
AI/ML Evaluation Engineer - Global Solutions Provider (Brazil)
Truelogic Software(2 months ago)
Lead QA AI Engineer
Anaplan(1 month ago)
AI Engineer
Mirakl - French (7 months ago)
ML Ops Engineer
Achievers(6 days ago)
AI/ML Evaluation Engineer - Global Solutions Provider (Mexico)
Truelogic Software(2 months ago)