SO
Full time
🤖 AI / ML
LLM Ops Lead at Sovos
Listed by DevShelfHub
Navi Mumbai, India
Hybrid
Mid-level · 2–3 yrs
About the Role
As enterprises scale Generative AI products, operationalizing LLMs with quality, safety, and observability has become essential. Sovos, a global leader in tax compliance technology, is hiring an LLM Ops Lead in Navi Mumbai to help scale, govern, and operationalize Generative AI across the business.
This role owns AI quality standards, evaluation frameworks, and release gates across Ask Sovi products while ensuring safety, observability, and continuous improvement.
What you'll do
- The LLM Ops Lead will scale, govern, and operationalize Generative AI across Sovos business operations.
- Own AI quality standards, evaluation frameworks, and release gates across Ask Sovi products
- Lead prompt and model versioning, regression detection, and AI governance initiatives
- Coordinate Safety, Guardrails, and Red Team testing programs
- Build observability practices across latency, cost, quality, and safety metrics using tools such as Langfuse
- Manage Jira epics, ticket triage, and cross-functional coordination across Product and Engineering teams
- Develop LLMOps playbooks, best practices, and operational standards
- Lead AI incident response, troubleshooting, and root-cause analysis
What we're looking for
- 2–3 years of experience in Applied AI, LLMOps, AI Quality Engineering, AI Operations, Test Automation, or related fields
- Hands-on experience with Langfuse, LangSmith, or similar AI observability and evaluation tools
- Strong understanding of AI quality, evaluation pipelines, prompt versioning, and AI governance
- Experience with AI safety, guardrails, content moderation, audit logging, and release management
Skills & Technologies
Required
2–3 years of experience in Applied AI, LLMOps, AI Quality Engineering, AI Operations, Test Automation, or related fields
Hands-on experience with Langfuse, LangSmith, or similar AI observability and evaluation tools
Strong understanding of AI quality, evaluation pipelines, prompt versioning, and AI governance
Experience with AI safety, guardrails, content moderation, audit logging, and release management
Strong stakeholder management and communication skills
Ability to support teams operating across UK business hours
Benefits & Perks
- Health Insurance
- Flexible Leave Policy
- Learning Budget
- EPF / NPS
Why This Role is Good for Experienced Professionals
- This role offers hands-on LLMOps experience governing production GenAI products in a global compliance technology company.
- Own AI quality standards, evaluation frameworks, and release gates across Ask Sovi products
- Lead prompt and model versioning, regression detection, and AI governance initiatives
- Coordinate Safety, Guardrails, and Red Team testing programs
- Build observability practices across latency, cost, quality, and safety metrics using Langfuse
- Manage Jira epics, ticket triage, and cross-functional coordination across Product and Engineering
- Develop LLMOps playbooks, best practices, and operational standards
- Lead AI incident response, troubleshooting, and root-cause analysis
- Work on cutting-edge Generative AI products and platforms
- Bi-Weekly Meeting Free Days and globally recognized training opportunities
- Comprehensive health and wellness benefits in a flexible, collaborative environment
About Sovos
Sovos is transforming tax compliance through innovative technology and AI-powered solutions used by customers worldwide. The company builds cutting-edge Generative AI products and platforms, collaborating with global AI, Product, and Engineering leaders to deliver compliant, high-quality AI experiences.
- Industry
- Technology
- Company Size
- 500+
- Website
- sovos.com
🚀 Boost your chances
Skip the queue
Contact the recruiter directly at Sovos and follow up personally — most applicants never do.
Browse Recruiter DatabaseFree trial · 40 contacts · ₹0
Job Details
- Type
- Full time
- Level
- Mid-level
- Experience
- 2–3 years
- Location
- Navi Mumbai, India
- Work Mode
- Hybrid
- Category
- AI / ML
Share this Job
Recruiter Database
Want to stand out? Talk to the recruiter directly.
Most applicants never hear back. Our Recruiter Database gives you direct email access to the people making hiring decisions — so you can follow up personally and actually get noticed.
- Recruiter name, company & direct email address
- Sourced from active job postings across top companies
- Free trial — 40 contacts, no credit card needed