Software Engineer, Model Performance Tooling

Baseten(28 days ago)

VancouverOnsiteFull TimeJunior$95,160 - $146,400Engineering

About this role

A Software Engineer, Model Performance Tooling at Baseten is responsible for developing automated benchmarking and diagnostic tools for high-performance computing and large language model (LLM) systems. This role involves performance benchmarking, infrastructure validation, and tool development to ensure systems are optimized for AI production readiness. The engineer will analyze the performance of GPU clusters, create real-time monitoring systems, and automate testing processes, while also gaining expertise in GPU orchestration and LLM inference.

View Original Listing

Required Skills

Performance Benchmarking
Infrastructure Validation
Model Dev Experience
Tool Development
Deep Hardware Profiling
Monitoring & Observability
Continuous Integration
Optimization Automation
Systems Understanding
Automation Mindset

+4 more

About Baseten

www.baseten.co

Baseten is a cutting-edge platform designed for deploying artificial intelligence models in production efficiently. It enables businesses to serve optimized open-source and custom models through a robust and reliable model delivery network. By streamlining machine learning operations, Baseten simplifies the integration of AI into applications, allowing companies to leverage the power of AI without the complexities typically associated with model deployment. The platform is favored for its speed, reliability, and user-friendly interface, catering to organizations seeking to enhance their AI capabilities.