IN_Senior Associate_LLM Observability Engineer_App Tech_Advisory_Pan India (early joiners)

As an LLM Observability & Performance Test Engineer at PwC, you will monitor, troubleshoot, and optimize AI-powered large language model applications to ensure they are performant, reliable, and cost-effective. This role involves designing performance test plans, implementing observability using tools like Datadog and LangChain, and collaborating with engineering teams to mitigate bottlenecks and ensure security compliance. You will conduct automated evaluations for metrics like hallucination detection and resource utilization while reporting actionable insights to stakeholders.