Senior AI Engineer, GenAI & ML Evaluation Frameworks - Grafana Ops, AI/ML | Canada | Remote

Grafana Labs(7 months ago)

RemoteFull TimeSenior$119,905 - $143,865Engineering

About this role

Senior Engineer on Grafana’s AI team focused on building and evolving internal evaluation frameworks for Generative AI and LLM systems. The role involves integrating best-of-breed tools, scaling automated evaluation pipelines, and aligning model metrics with product goals. This is a remote position (Canada time zones preferred) with opportunity to expand the role as the team and impact grow.

View Original Listing

Required Skills

Evaluation Frameworks
LLM Evaluation
Prompt Engineering
Structured Evaluation
Automation
CI/CD
Metrics Definition
Dataset Management
Tooling
Reproducibility

+2 more

About Grafana Labs

grafana.com

Grafana Labs develops Grafana, an open-source, composable observability and analytics platform for visualizing metrics, logs, and traces from virtually any data source. The product provides flexible, customizable dashboards, alerting, and a plugin-driven ecosystem with integrations like Prometheus, Loki, Tempo, Elasticsearch, and cloud provider services. Grafana Labs also offers Grafana Cloud and enterprise editions that add managed hosting, scalability, security, and commercial support for organizations with production SLAs. Teams choose Grafana for its extensibility, strong open-source community, and developer-friendly UX for monitoring and troubleshooting.