Inferact
Inferact seeks an AMD GPU performance engineer to optimize the vLLM inference engine specifically for the AMD accelerator ecosystem. The role involves building and tuning backends, kernels, and runtime paths using ROCm and HIP to ensure frontier-level performance. Candidates will focus on improving critical inference operations like attention and KV cache while contributing to benchmarking infrastructure.
Inferact is a production AI inference platform built by the creators and maintainers of vLLM, designed to give organizations control over frontier inference workloads. It allows deployment on customers' own GPUs or Inferact's cloud infrastructure, with support for open weight models and optimization for cost, latency, and throughput. Inferact serves AI teams requiring enterprise-grade performance, security, and day-zero support for the latest frontier models.
Headquarters
San Francisco, CA
Company Size
201-500 employees
Founded
2018
Industry
Technology
Glassdoor Rating
4.2 / 5
Sarah Johnson
Chief Executive Officer
Michael Chen
Chief Technology Officer
Emily Williams
VP of Engineering
David Rodriguez
VP of Product
Jessica Thompson
Chief Financial Officer
Andrew Park
VP of Sales
View leadership team, funding history,
and employee contacts for Inferact.
75% above the average for this role