Principal consultant GenAI LLM Ops Engineer

Lead Data Scientist Ready to turn bold ideas into real-world impact? At Genpact, we don’t just adapt to change, we lead it. AI and digital innovation are transforming the way businesses work, and we’re at the forefront of it. Genpact’s AI Gigafactory , our industry-first accelerator, exemplifies how we scale advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. Whether tackling complex challenges through large-scale models or agentic AI , our breakthrough solutions tackle companies’ most complex challenges. If you thrive in a fast-moving, innovation-driven environment, love building and deploying cutting-edge AI solutions, and want to push the boundaries of what’s possible, this is your moment. Genpact (NYSE: G) is an agentic and advanced technology solutions company. We leverage process intelligence and artificial intelligence to deliver measurable outcomes. With a strong partner ecosystem and decades of client trust, we provide innovative solutions that transform how businesses run. Powered by a team with an active learning mindset and client centricity at its core, we deliver lasting value for the world’s leading enterprises. Get to know us at and on LinkedIn , YouTube , X , and Facebook . Job Description Inviting applications for the role of Principal consultant Gen AI LLM Ops Engineer! Were looking for an LLM Ops Engineer to build operate and scale our Large Language Model platforms and applications. Youll own the end-to-end operational lifecyclefrom model deployment and orchestration to reliability observability safety cost optimization and performance tuning. Youll partner closely with Data Science ML Ops Security and Product teams to deliver robust compliant and efficient LLM-powered experiences. Responsibilities: - Architect secure reusable and modular infrastructure-as-code (Ia C) frameworks for Gen AI and LLM operations - Design deploy and maintain LLM serving infrastructure (e.g. - Azure Open AI self-hosted OSS models vector databases). - Implement model orchestration (routing ensemble strategies fallbacks retries cache layers). - Build CI/CD pipelines for prompt catalogs model configurations guardrails and evaluation suites. - Define and track LLM-specific SL Os (latency response quality safety violations hallucination rate). - Implement telemetry (traces logs metrics prompt/response analytics) and A/B experiments. - Establish alerting & incident response playbooks. - Lead the development and standardization of CI/CD pipelines for AI/ML model deployment - Ensure security privacy and regulatory compliance (data residency consent auditability). - Manage prompt governance (versioning approval workflow change logs rollback). - Define and enforce best practices for model versioning governance and lifecycle management - Troubleshoot and resolve issues related to LLM deployment scaling and performance - Stay updated with advancements in ML Ops LL Ms and Gen AI technologies Qualifications Bachelors - Business Analytics, Bachelors - Computer Science, Bachelors - Statistics, Masters - Data Science Certifications Data Science Using R - SimpliLearnSimpliLearn Required Skills Adaptive Technology, Adaptive Technology, Agile Methodology, Amazon SageMaker, Anticipatory Capability, Artificial Intelligence (AI), Asset Management, Automated Machine Learning (AutoML), CI/CD, Client Relations, Collaboration Tools, Computer Vision, Context Awareness, Continuous Delivery, Continuous Integrations, Continuous Testing, Data Provisioning, Data Validation, Design Thinking, Embedded Systems, Executive Presence, Inclusion, Internet of Things (IoT), Machine Learning Model Management, Model Validation {+ 8 more} Language English Language Proficiency - Proficient - C2 Additional Job Location - Job Type Regular Master Skill List - Advanced Analytics / AI / ML Remote Type - Hybrid Work Shift - Flex Time (India) Why join Genpact? • Lead AI-powered transformation – Drive innovation and solve real-world business challenges that matter • Make an impact – Help global enterprises solve business challenges that matter • Accelerate your career – Gain hands-on experience, mentorship, and world-class learning opportunities to stay ahead • Work with the best – Join 140,000+ bold thinkers and problem-solvers who push boundaries every day • Thrive in a values-driven culture – Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress Come join the 140,000+ coders, tech shapers, and growth makers at Genpact and take your career in the only direction that matters: Up. Let’s build tomorrow together. Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation. Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a 'starter kit,' paying to apply, or purchasing equipment or training.