Rust Systems Engineer - Inference
Together AISan Francisco, California, United States
Posted August 12, 2025
160000 - 240000 USD year
Full Time
About the Company
Together AI is a research-driven AI cloud infrastructure provider offering a purpose-built GPU platform for training and running advanced AI models. Serving leading SaaS companies and pioneering startups, Together AI champions open source AI and decentralized computing, advocating for transparency to drive innovation and societal benefits.
Job Description
Together AI is seeking a Rust Systems Engineer to join their Inference Engine team. This role focuses on optimizing and enhancing the performance of AI inference systems, collaborating with AI researchers and engineers to create cutting-edge solutions. The company is a research-driven AI company, offering an opportunity to shape the future of AI systems and significantly reduce their cost.
Requirements
- Demonstrated proficiency in Rust programming language and ecosystem
- Strong experience with Rust frameworks such as axum, tokio, jemalloc, serde, rayon, and crossbeam
- Deep understanding of concurrent programming and multiprocessing patterns
- Experience developing and optimizing orchestration and scheduling algorithms
- Knowledge of distributed systems principles and design
- Solid understanding of memory management and performance profiling
- Experience interfacing Rust services with RPC components
- Ability to optimize systems for performance, reliability, and resource efficiency
- Solid understanding of memory management and performance profiling.
Benefits
- Competitive compensation
- Startups equity
- Health insurance
- Other competitive benefits
