Data Engineer
ExaSan Francisco, California, United States
Posted December 12, 2025
Full Time
About the Company
We build massive-scale infrastructure to crawl the web, train state-of-the-art embedding models to index it, and develop super high performant vector databases in Rust to search over it.
Job Description
We are building a search engine from scratch and need a Data Engineer to architect and build the data infrastructure that powers everything we do. You will have enormous autonomy in designing systems that scale to hundreds of petabytes.
Requirements
- Deep understanding of lakehouse architectures (Delta Lake, Iceberg, Hudi) and when to use them
- Experience building and operating large-scale distributed data processing pipelines
- Hands-on experience with streaming data systems (Kafka, Flink, or similar)
- Familiarity with Ray, Spark, or ClickHouse at production scale
- An obsessive focus on reliability and building systems that don't page you at 3am
Benefits
- Health Insurance
- Retirement Plan
- Paid Time Off
- Visa Sponsorship