Software Engineer (Ray Data)

Anyscale(2 months ago)

RemoteFull TimeSenior$152,085 - $204,079 (estimated)Engineering

About this role

A Software Engineer on the Ray Data team at Anyscale is responsible for improving the performance and scalability of the Ray Data processing engine for AI workloads. This role focuses on enhancing multi-modal batch inference, ensuring efficient scaling throughout the data pipeline, and developing robust data loading solutions for production training. The ideal candidate should have extensive experience in building distributed systems and a passion for optimizing large-scale data processing in challenging environments.

View Original Listing

Required Skills

Improve Performance
Scale Ray Data
Data Pipeline Management
Data Loading Solutions
Fault Tolerance
Customer Collaboration
Distributed Systems
Data Processing
Database Internals
AI Workloads

+2 more

About Anyscale

www.anyscale.com

Anyscale is a cutting-edge platform designed for building and running AI applications with scalability and efficiency at its core. Powered by Ray, it enables AI developers to seamlessly manage all machine learning (ML) and artificial intelligence (AI) workloads, whether in the cloud or on-premises. Anyscale focuses on simplifying the complexities of deploying various workloads, from data processing to training and inference, ultimately facilitating faster development and operational reliability. The platform is particularly favored by organizations seeking to optimize their ML workflows while leveraging the expertise of the original creators of the Ray framework.