Distributed ML Systems Engineer- Inference
Together AISan Francisco, California, United States
Posted August 12, 2025
160000 - 230000 USD year
Full Time
About the Company
Together AI is a research-driven AI cloud infrastructure provider offering a purpose-built GPU platform for training and running advanced AI models. Serving leading SaaS companies and pioneering startups, Together AI champions open source AI and decentralized computing, advocating for transparency to drive innovation and societal benefits.
Job Description
Together AI is seeking a Distributed ML Systems Engineer to design and build scalable machine learning systems for accelerated AI initiatives. This role involves developing large-scale, fault-tolerant distributed systems and collaborating with AI researchers and infrastructure teams to ensure robust and efficient systems. The position offers the chance to work with AI researchers and contribute to impactful solutions.
Requirements
- 3+ years of experience in building large-scale, fault-tolerant, high-performance distributed systems
- Strong programming skills in one or more of Python, Go, Rust, or C/C++
- Excellent understanding of low-level operating systems concepts
- Experience with cloud computing platforms (AWS, GCP, Azure etc.) and large-scale infrastructure
- Strong problem-solving skills
Benefits
- Competitive compensation
- Startup equity
- Health insurance
- Other competitive benefits