Head of Evaluation and Oversight Research
Scale AISan Francisco, California, United States • Seattle, Washington, United States • New York, New York, United States
Posted September 5, 2025
260000 - 350000 USD year
Full Time
About the Company
Scale AI accelerates the development of AI applications by providing the best data and tools. The Scale Generative AI Platform customizes powerful base models using enterprise data, while the Scale Data Engine offers comprehensive solutions for collecting, curating, annotating, and evaluating high-quality data. Trusted by leading tech companies and government agencies, Scale stands out with its world-class RLHF, safety, and alignment technologies.
Job Description
Scale is a leading data and evaluation partner for frontier AI companies, focusing on research in evaluating and characterizing LLMs. The company seeks a Head of Evaluation and Oversight Research to lead a team of researchers and drive innovation in scaling oversight methods for advanced AI models. The role involves research, design, and collaboration with various research labs.
Requirements
- Track record of impactful research in machine learning (especially in generative AI, evaluation, or oversight)
- Significant experience leading ML research in academia or industry
- Strong written and verbal communication skills for cross-functional collaboration
- Experience building and mentoring research teams
- Publications at top-tier conferences (e.g., NeurIPS, ICML, ICLR, ACL, EMNLP, CVPR)
- Compliance with the U.S. Department of Labor's Pay Transparency provision
Benefits
- Comprehensive health, dental and vision coverage
- Retirement benefits
- Learning and development stipend
- Generous PTO