ApplyBlast uses AI to match you with the right jobs, tailor your resume and cover letter, and apply automatically so you can land your dream job faster.

Features

Auto Apply Resume Optimizer Cover Letter Optimizer Interview Prep

Company

Social Media

Need Help?

team@applyblast.com

Distributed Training Systems Engineer at Upsun - ApplyBlast

Distributed Training Systems Engineer

Upsun

1 month ago

Remote

Full Time

Senior

1 applicant

View Job Listing

Apply to 100+ jobs

About this role

This role focuses on optimizing foundation model training by profiling and eliminating bottlenecks across the entire stack, from data pipelines to GPU kernels. The engineer will design and build scalable distributed training systems using PyTorch for multi-node GPU clusters while implementing efficient low-level code and custom kernels. Additionally, the position involves developing monitoring and debugging tools to ensure high hardware utilization and rapid diagnosis of performance issues.

Responsibilities

Drive down wall-clock time to convergence by profiling and eliminating bottlenecks across the foundation model training stack
Design, build, and optimize distributed training systems for multi-node GPU clusters ensuring scalability and high utilization
Implement efficient low-level code and integrate it seamlessly into high-level training frameworks

Skills

About Upsun

platform.sh

Upsun (formerly Platform.sh) is a cloud application platform-as-a-service (PaaS) that gives development teams the flexibility to build, deploy, and run applications while maintaining centralized control over security, compliance, and spend. It supports over 10 runtime languages and nearly any framework, with multi-cloud deployment across AWS, Azure, Google Cloud, IBM, and OVHcloud. Upsun emphasizes self-service tooling, predictable pricing, built-in security and compliance, and 24x7 engineering support.