AI Evaluation Lead

OB DESCRIPTION – AI Evaluation Lead / Principal Consultant

Role Summary We are seeking an AI Evaluation Lead / Principal Consultant to drive the strategy, methodology, commercial expansion, and leadership direction of our AI Evaluation practice. This senior role is responsible for scaling AI quality capabilities, developing flagship customer accounts, shaping enterprise-grade AI evaluation programs, and building thought leadership in AI assurance.

Experience Required

12+ years of total experience. Candidates should have 5+ years of experience in AI, ML, NLP, LLMs, AI quality, enterprise AI delivery, AI evaluation, or AI assurance, with 3+ years in team leadership, practice leadership, or senior client advisory roles.

Share your profile at: [HIDDEN TEXT]

Key Responsibilities

• Own and define the AI Evaluation practice strategy, operating model, methodology roadmap, and quality standards.

• Develop and scale enterprise AI evaluation solutions for voice AI, chatbots, LLM applications, agentic AI, and multimodal AI.

• Manage flagship client relationships and partner with senior executives on AI quality, AI risk, and AI assurance.

• Design and deliver high-impact AI evaluation programs for enterprise clients. • Establish commercial models, effort estimation methods, delivery frameworks, and margin governance for evaluation engagements.

• Lead solution design, proposal development, presales discussions, and strategic account growth.

• Create reusable frameworks for hallucination testing, robustness testing, red teaming, safety evaluation, compliance evaluation, and regression testing.

• Coach L3/L2 leaders and strengthen the leadership bench for the evaluation practice.

• Lead hiring strategy, senior talent development, and succession planning.

• Explore new market opportunities, domains, modalities, partnerships, and adjacent service offerings.

• Act as a visible practice representative through industry forums, customer workshops, publications, advisory engagements, and thought leadership activities.

• Drive adoption of the methodology across internal teams and external clients.

• Maintain delivery excellence, customer satisfaction, revenue growth, and long-term practice scalability.

Required Knowledge and Skills

Deep expertise in AI evaluation, LLM evaluation, AI quality, conversational AI, and enterprise AI assurance.

• Strong working knowledge of hallucination evaluation, robustness testing, safety testing, red teaming, responsible AI, and compliance-oriented evaluation.

• Strong understanding of enterprise AI delivery models, AI lifecycle risks, governance, and quality assurance.

• Proven capability in executive stakeholder management and consultative selling.

• Demonstrated experience building teams, practices, offerings, or large-scale delivery capabilities.

• Ability to define commercial strategy, pricing approach, delivery economics, and account expansion plans.

Strong methodology design and thought leadership capability.

• Ability to mentor senior practitioners and build successors. • Strong communication, executive-level presentation, negotiation, and strategic planning skills. • Ability to collaborate across delivery, product, sales, client leadership, and partner ecosystems.

Preferred Skills • Experience leading an AI testing, AI quality, AI assurance, AI governance, or AI evaluation practice. • Experience with AI evaluation and testing platforms. • Strong professional network in AI, digital transformation, quality engineering, or enterprise technology. • Experience producing thought leadership, white papers, case studies, or speaking at industry events. • Experience in regulated industries such as BFSI, healthcare, insurance, automotive, or telecom. • Exposure to Responsible AI frameworks, model risk management, AI governance, and regulatory compliance.

Educational Qualification B.E. / B.Tech / M.Tech / M.S. in Artificial Intelligence, Computer Science, Computer Engineering, Information Technology, or related Computer discipline.