Lead consultant - GenAI LLM Ops Engineer

Genpact is seeking a Lead Consultant - GenAI LLM Ops Engineer to build, operate, and scale Large Language Model platforms and applications. The ideal candidate will have experience in MLOps, DevOps, or AI/ML infrastructure roles and proficiency in scripting and programming languages such as Python, Bash, or similar.

Requirements

• Architect secure, reusable, and modular infrastructure-as-code (IaC) frameworks for GenAI and LLM operations
• Design, deploy, and maintain LLM serving infrastructure
• Implement model orchestration
• Build CI/CD pipelines for prompt catalogs, model configurations, guardrails, and evaluation suites
• Define and track LLM-specific SLOs (latency, response quality, safety violations, hallucination rate)
• Implement telemetry (traces, logs, metrics, prompt/response analytics) and A/B experiments
• Establish alerting & incident response playbooks
• Lead the development and standardization of CI/CD pipelines for AI/ML model deployment
• Ensure security, privacy, and regulatory compliance
• Manage prompt governance
• Define and enforce best practices for model versioning, governance and lifecycle management
• Troubleshoot and resolve issues related to LLM deployment, scaling, and performance
• Stay updated with advancements in MLOps, LLMs, and GenAI technologies

Benefits

• Diverse and inclusive work environment
• Opportunities for career growth and development
• Competitive salary and benefits package
• Recognition and rewards for outstanding performance