Inferact
Inferact seeks a TPU performance engineer to optimize vLLM as a leading AI inference engine on Google TPUs. This role involves building compilers, runtime paths, and benchmarking infrastructure using tools like JAX, XLA, and Pallas to deliver frontier inference performance. The engineer will work at the intersection of systems, kernels, and hardware architecture to ensure correctness, low latency, and high throughput.
Inferact is a production AI inference platform built by the creators and maintainers of vLLM, designed to give organizations control over frontier inference workloads. It allows deployment on customers' own GPUs or Inferact's cloud infrastructure, with support for open weight models and optimization for cost, latency, and throughput. Inferact serves AI teams requiring enterprise-grade performance, security, and day-zero support for the latest frontier models.
Headquarters
San Francisco, CA
Company Size
201-500 employees
Founded
2018
Industry
Technology
Glassdoor Rating
4.2 / 5
Sarah Johnson
Chief Executive Officer
Michael Chen
Chief Technology Officer
Emily Williams
VP of Engineering
David Rodriguez
VP of Product
Jessica Thompson
Chief Financial Officer
Andrew Park
VP of Sales
View leadership team, funding history,
and employee contacts for Inferact.
5% above the average for this role