Software Engineer, Model Performance Tooling

Baseten

2 months ago

Vancouver

Onsite

Full Time

Junior

0 applicants

View Job Listing

Apply to 100+ jobs

About this role

A Software Engineer, Model Performance Tooling at Baseten is responsible for developing automated benchmarking and diagnostic tools for high-performance computing and large language model (LLM) systems. This role involves performance benchmarking, infrastructure validation, and tool development to ensure systems are optimized for AI production readiness. The engineer will analyze the performance of GPU clusters, create real-time monitoring systems, and automate testing processes, while also gaining expertise in GPU orchestration and LLM inference.

Skills

About Baseten

www.baseten.co

Baseten is a cutting-edge platform designed for deploying artificial intelligence models in production efficiently. It enables businesses to serve optimized open-source and custom models through a robust and reliable model delivery network. By streamlining machine learning operations, Baseten simplifies the integration of AI into applications, allowing companies to leverage the power of AI without the complexities typically associated with model deployment. The platform is favored for its speed, reliability, and user-friendly interface, catering to organizations seeking to enhance their AI capabilities.