Principal Consultant - GenAI LLM Ops Engineer

Genpact is looking for a Principal Consultant - GenAI LLM Ops Engineer to build, operate, and scale Large Language Model platforms and applications. The ideal candidate will own the end-to-end operational lifecycle and partner with Data Science, MLOps, Security, and Product teams to deliver robust, compliant, and efficient LLM-powered experiences.

Requirements

• Architect secure, reusable, and modular infrastructure-as-code (IaC) frameworks for GenAI and LLM operations
• Design, deploy, and maintain LLM serving infrastructure
• Implement model orchestration
• Build CI/CD pipelines for prompt catalogs, model configurations, guardrails, and evaluation suites
• Define and track LLM-specific SLOs
• Implement telemetry and A/B experiments
• Establish alerting & incident response playbooks
• Lead the development and standardization of CI/CD pipelines for AI/ML model deployment
• Ensure security, privacy, and regulatory compliance
• Manage prompt governance
• Define and enforce best practices for model versioning, governance and lifecycle management
• Troubleshoot and resolve issues related to LLM deployment, scaling, and performance

Benefits

• Competitive salary
• Health insurance
• Retirement plan
• Paid time off
• Opportunities for growth and development
• Diverse and inclusive work environment