Software Engineer, Distributed Data Systems

Exa

3 months ago

3.4 on Glassdoor

San Francisco, CA

Onsite

Full Time

Senior

3 applicants

View Job Listing

Apply to 100+ jobs

About this role

A Software Engineer specializing in Distributed Data Systems at Exa will design and build the data infrastructure essential for a cutting-edge search engine serving AI applications. Responsibilities include architecting large-scale distributed data processing pipelines, implementing lakehouse architectures, and ensuring reliability across systems processing billions of pages and petabytes of data. The role requires hands-on experience with streaming data systems and familiarity with technologies like Ray, Spark, or ClickHouse, and offers autonomy in creating scalable solutions.

Skills

About Exa

exa.ai

Exa is a state-of-the-art AI search engine and web crawling platform that provides robust APIs for retrieving real-time and structured web data. With its deep research tools, SERP API, and customizable web crawling capabilities, Exa empowers developers and enterprises to integrate high-quality search functionality directly into their applications. The platform is designed to enhance AI workflows by delivering comprehensive, relevant information from across the web while ensuring data privacy and compliance. Trusted by industry leaders, Exa offers a scalable solution tailored for diverse applications and business needs.