AI Evaluation Engineer

The AI Evaluation Engineer designs, builds, and operates evaluation systems to ensure GenAI solutions are accurate, safe, and production-ready. This fully remote role involves establishing automated evaluation frameworks, monitoring model performance, and implementing quality gates for LLM, RAG, and agentic applications. The position requires collaboration with product teams to translate business requirements into measurable quality criteria and support responsible AI standards.