AI Engineer - Evaluations
Hippocratic AIPalo Alto, California, United States
Posted October 30, 2025
Full Time
About the Company
Hippocratic AI is a healthcare-focused artificial intelligence company that has developed a safety-oriented Large Language Model (LLM) designed to enhance accessibility and outcomes in global health. Founded by a team of medical professionals, researchers, and tech experts from renowned institutions, Hippocratic AI aims to bring deep healthcare expertise to every individual. The company has secured $278 million in funding from leading investors and is positioned to make significant strides in improving health through innovative AI solutions.
Job Description
Hippocratic AI is a company developing a safe, healthcare-focused Large Language Model for the generation of healthcare agents. They are seeking an AI Engineer – Evaluations to build systems to measure, validate, and improve the safety, efficacy, and empathy of their voice-based generative agents. The role involves designing evaluation frameworks, deploying evaluators, and collaborating with various teams to drive model improvement and improve real-world impact in healthcare delivery.
Requirements
- 3+ years of software or ML engineering experience
- Proficiency in Python
- Familiarity with LLM evaluation techniques (prompt testing, multi-agent workflows)
- Understanding of deep learning fundamentals
- Excellent communication skills
