Principal Consultant - GenAI LLM Ops Engineer
GenpactGurgaon, Haryana, India
Posted March 6, 2026
Full Time
About the Company
Genpact is an advanced technology services and solutions company that delivers lasting value for leading enterprises globally.
Job Description
Genpact is seeking a Principal Consultant - GenAI LLM Ops Engineer to build, operate, and scale Large Language Model platforms and applications. The ideal candidate will have experience in MLOps, DevOps, or AI/ML infrastructure roles and be proficient in scripting and programming languages such as Python, Bash, or similar.
Requirements
- Architect secure, reusable, and modular infrastructure-as-code (IaC) frameworks for GenAI and LLM operations
- Design, deploy, and maintain LLM serving infrastructure
- Implement model orchestration and build CI/CD pipelines
- Define and track LLM-specific SLOs and implement telemetry and A/B experiments
- Ensure security, privacy, and regulatory compliance
- Manage prompt governance and define best practices for model versioning, governance, and lifecycle management
- Troubleshoot and resolve issues related to LLM deployment, scaling, and performance
Benefits
- Comprehensive health insurance
- Retirement savings plan
- Paid time off
- Flexible work arrangements
- Opportunities for professional growth and development