LLM Platform Engineer

A LLM Platform Engineer at Whatnot is responsible for designing and scaling the infrastructure that supports large language model (LLM) applications across the organization. The role involves collaborating with machine learning scientists to implement AI solutions, creating robust and scalable LLM evaluation frameworks, and developing retrieval systems to enhance LLM responses within the business context. Key tasks include building human-in-the-loop feedback pipelines, ensuring PII compliance, and bridging research to production for scalable AI deployment across various product areas.