Cloud Inference Engineer

Modular is revolutionizing AI infrastructure by rebuilding the AI software stack from the ground up. We're seeking a Cloud Inference Engineer to build end-to-end distributed LLM inference deployments that are fully vertically integrated with the MAX stack.

Requirements

• 5+ years of experience working in backend engineering
• Experience working on high scale ML inference infrastructure (traditional AI or genAI)
• Experience with kubernetes and operating your own services
• Ability to create durable, reusable software tools and libraries that are leveraged across teams and functions

Benefits

• Premier insurance plans
• Up to 5% 401k matching
• Flexible paid time off
• Competitive compensation packages, including stock options
• Team building events