Software Engineer, Distributed Data Systems

Exa(1 month ago)

San Francisco, CA, CaliforniaOnsiteFull TimeSenior$150,000 - $300,000Engineering

About this role

A Software Engineer specializing in Distributed Data Systems at Exa will design and build the data infrastructure essential for a cutting-edge search engine serving AI applications. Responsibilities include architecting large-scale distributed data processing pipelines, implementing lakehouse architectures, and ensuring reliability across systems processing billions of pages and petabytes of data. The role requires hands-on experience with streaming data systems and familiarity with technologies like Ray, Spark, or ClickHouse, and offers autonomy in creating scalable solutions.

View Original Listing

Required Skills

Data Infrastructure
Lakehouse Architectures
Distributed Data Processing
Streaming Data Systems
Reliability Focus
Vector-native Storage
GPU-accelerated Processing
Data Pipelines
Real-time Indexing
Architectural Design

About Exa

exa.ai

Exa is a state-of-the-art AI search engine and web crawling platform that provides robust APIs for retrieving real-time and structured web data. With its deep research tools, SERP API, and customizable web crawling capabilities, Exa empowers developers and enterprises to integrate high-quality search functionality directly into their applications. The platform is designed to enhance AI workflows by delivering comprehensive, relevant information from across the web while ensuring data privacy and compliance. Trusted by industry leaders, Exa offers a scalable solution tailored for diverse applications and business needs.