Machine Learning Scientist

LMArena is seeking Machine Learning Scientists to help advance how we evaluate and understand AI models. You'll help design and analyze experiments that uncover what makes models useful, trustworthy, and capable through human preference signals.

Requirements

• PhD or equivalent research experience in Machine Learning, Natural Language Processing, Statistics, or a related field
• Strong understanding of LLMs and modern deep learning architectures (e.g., Transformers, diffusion models, reinforcement learning with human feedback)
• Proficiency in Python and ML research libraries such as PyTorch, JAX, or TensorFlow
• Demonstrated ability to design and analyze experiments with statistical rigor
• Experience publishing research or working on open-source projects in ML, NLP, or AI evaluation
• Comfortable working with real-world usage data and designing metrics beyond standard benchmarks
• Ability to translate research questions into practical systems and collaborate across engineering and product teams
• Passion for open science, reproducibility, and community-driven research

Benefits

• Competitive salary and meaningful equity
• Comprehensive healthcare coverage (medical, dental, vision)
• The opportunity to work on cutting-edge AI with a small, mission-driven team
• A culture that values transparency, trust, and community impact