LLM Platform Engineer

Join Whatnot as a LLM Platform Engineer to design and scale the core infrastructure that powers large language model applications across the company. You'll work with machine learning scientists to bring cutting-edge models into production and unlock new product experiences. This role requires building systems that make AI dependable and fast at scale.

Requirements

• Own the infrastructure powering LLMs across critical business surfaces– supporting growth, recommendations, trust and safety, fraud, seller tooling, and more.
• Create robust and scalable LLM evaluation frameworks to measure model performance, guide iteration, and prevent regression via CI/CD.
• Deploy RAG systems and MCP servers to more effectively ground LLM responses in Whatnot’s business context while enforcing rigorous PII controls.
• Design efficient human-in-the-loop feedback pipelines that can be used to inform scalable LLM evaluation
• Bridge the gap between research and production, helping to transform experimental ideas into scalable solutions
• Stretch beyond your comfort zone to take on new technical challenges as we scale AI across Whatnot’s ecosystem.

Benefits

• Flexible Time off Policy
• Company-wide Holidays (including a spring and winter break)
• Health Insurance options
• Work From Home Support
• Home office setup allowance
• Monthly allowance for cell phone and internet
• Care benefits
• Monthly allowance for wellness
• Annual allowance towards Childcare
• Lifetime benefit for family planning, such as adoption or fertility expenses
• Retirement
• 401k offering for Traditional and Roth accounts in the US
• Monthly allowance to dogfood the app
• Parental Leave