We are building an open platform to fuel and accelerate AI breakthroughs globally. The Research Engineer, Pre-Training will design and implement novel pre-training approaches to create powerful foundation models.
Requirements
- Research experience with a focus on pre-training and building large language models
- Strong ML fundamentals and first principles thinking
- Experience with programming languages such as Python and frameworks such as JAX, PyTorch or TF
- Ability to prototype and deploy pre-trained models in production environments
- Strong problem solving, analytical, communication, and collaboration skills
Benefits
- Cash pay
- Equity
- 401(k)
- Health benefits
- Monthly wellness & education stipend
- Daily onsite lunches and snacks