GenAI Testing Consultant/Architect

Job Overview:

• Join a pivotal role where you will influence the development, validation, trust, and scalability of Generative AI systems within enterprise settings.
• In the capacity of a senior technology consultant and architect, you will collaborate with business, product, and engineering teams to conduct discovery workshops, establish success metrics, and formulate solution roadmaps for high-impact GenAI and ML applications.
• You will integrate hands-on technical expertise with architectural leadership, guiding teams from initial experimentation through to production-ready systems while formulating comprehensive testing strategies for GenAI solutions that address quality, safety, reliability, and performance.
• Your role will involve direct collaboration with data scientists, ML engineers, and cloud teams to develop repeatable evaluation frameworks, automate testing pipelines, and instruct stakeholders on best practices for responsible AI integration.
• If you thrive on converting complex requirements into streamlined AI architectures, resolving ambiguous challenges, mentoring teams, and creating solutions that are secure, reliable, and measurable, this position offers an ideal combination of innovation, ownership, and teamwork.

Core Responsibilities:

• Facilitate discovery workshops to pinpoint high-value GenAI and ML use cases, establish both standard and custom success metrics, and develop solution roadmaps.
• Design and architect comprehensive Generative AI systems, encompassing data pipelines, model selection, orchestration, evaluation, and deployment methodologies using both Infosys and industry-standard tools and platforms.
• Develop and execute ML AI solutions utilizing Python or other pertinent Data Science AI languages, applying robust software engineering principles to ensure maintainability, performance, and reliability.
• Create MCP and agentic-based solutions using suitable frameworks that facilitate tool function calling, workflow orchestration, and multi-step reasoning patterns aligned with business requirements.
• Test and validate GenAI applications using appropriate tools and frameworks, capturing, analyzing, and reporting standard and custom quality metrics such as relevance, groundedness, toxicity, latency, and cost, while driving ongoing enhancements.
• Work in tandem with cloud and platform teams to architect scalable Cloud AI solutions and cost-effective deployments across AWS, Azure, or GCP.
• Investigate and assess emerging technologies, tools, and testing methodologies to enhance development processes and solution quality, while remaining current with advancements in Generative AI and evaluation practices.

Technical Qualifications:

• Proven experience in architecting Cloud AI solutions, including scalable inference, data security frameworks, and cost-performance optimization.
• Hands-on expertise with LLM application patterns such as RAG, tool function calling, prompt engineering, and automated evaluation frameworks.
• Strong background in MLOps and LLMOps, including experiment tracking, model registry, CI/CD, observability, drift detection, and incident response for AI services.
• Familiarity with data engineering principles, feature stores, and batch/stream processing to support ML and GenAI workloads.
• Demonstrated ability to lead architecture governance, develop reference architectures, and promote adoption across teams and portfolios.

Additional Information:

• Desirable skills include GenAI, Python, Agile methodologies, CI/CD pipelines, API testing, and basic SQL Database knowledge.
• Location options include BANGALORE, PUNE, HYDERABAD, CHENNAI, TVM, INDORE, NAGPUR, MLR, MYS, NOIDA, BBSR, KOLKATA, COIMBATORE, and HUBLI.

Preferred Skills:

Technology->AI-Generative AI->Prompt Engineering,Technology->AI-Agentic AI->Agent Engineering,Technology->Open System->Open System- ALL->Python,Technology->Testing Technologies->Test Automation,Technology->AI-Generative AI->Generative AI - Basic->retrieval augmented generation (rag)