Web Crawling Engineer

Mistral AI(1 year ago)

HybridFull TimeSenior$169,391 - $226,373 (estimated)Engineering

About this role

The Web Crawling Engineer at Mistral AI designs and maintains large-scale distributed web crawling and data acquisition systems. The role focuses on building high-performance crawlers and infrastructure to collect, store, and process data from diverse web sources. It sits within a fast-moving AI company, contributing core data pipelines that support AI products and enterprise solutions. The position involves close collaboration with cross-functional teams and ongoing optimization of crawling performance and data quality.

View Original Listing

Required Skills

Go Programming
Rust Programming
Zig Programming
Web Crawling
Web Scraping
Data Extraction
Headless Browsing
Chrome DevTools
API Integration
HTML Parsing

+31 more

About Mistral AI

mistral.ai

Mistral AI builds frontier large language models and an enterprise AI platform that lets companies customize, fine‑tune, and deploy AI assistants, autonomous agents, and multimodal models. Their offering centers on open models, developer APIs, and professional services designed for secure, scalable integration into products and workflows. Mistral combines research-grade model development with tooling for building tailored assistants and autonomous agents for business use cases. They also publish research and consumer-facing apps that showcase their models in action.