Product Manager, AI Platform

We're building the infrastructure for abundant intelligence and are hiring a Product Manager to own our AI platform roadmap. This role requires balancing customer needs for low latency and high throughput with operational realities of GPU utilization, cost efficiency, and platform reliability.

Requirements

• 5+ years product management experience with at least 3 years focused on AI/ML infrastructure, inference platforms, or developer tools
• Strong technical understanding of transformer architectures, inference optimization techniques, and production ML systems
• Experience building products for technical users deploying LLMs in production (ML engineers, research scientists, AI application developers)
• Track record of shipping features that improved inference latency, throughput, or cost efficiency—backed by quantitative metrics
• Deep familiarity with the inference ecosystem: serving frameworks (vLLM, TensorRT-LLM, TGI), model formats (GGUF, SafeTensors), and API standards (OpenAI-compatible endpoints)
• Understanding of GPU memory constraints, batching strategies, and the tradeoffs between latency-optimized vs. throughput-optimized serving
• Ability to translate complex technical concepts into clear customer value propositions
• Experience conducting competitive analysis in the inference market, including pricing elasticity, feature differentiation, and customer acquisition patterns
• Comfortable working with engineering teams to debug performance bottlenecks, analyze profiling data, and prioritize kernel-level optimizations
• Bonus: Experience with agent frameworks (LangChain, LlamaIndex, AutoGPT), compound AI patterns, or model fine-tuning workflows

Benefits

• Generous Paid Time Off
• 401k Matching
• Retirement Plan