Inference Performance Engineer

Baseten is seeking an Inference Performance Engineer to optimize and accelerate mission-critical AI workloads for leading companies. The role involves working across the full stack, from inference engines and runtimes to scheduling and routing, to improve model speed and efficiency. You will apply advanced techniques like speculative decoding and KV-cache management to enhance performance and reduce costs. This position is ideal for someone who thrives in a fast-paced startup environment and is eager to make significant contributions to the field of LLM inference.