GenAI Testing Consultant/Architect

• Lead discovery workshops to identify high-value GenAI and ML use cases, define success metrics (standard and custom), and create solution roadmaps. • Architect end-to-end Generative AI systems, including data pipelines, model selection, orchestration, evaluation, and deployment patterns using Infosys and industry-standard tools and platforms. •Design and implement ML/AI solutions using Python (or other relevant Data Science/AI languages), applying strong software engineering practices for maintainability, performance, and reliability. •Build MCP and agentic-based solutions using appropriate frameworks, enabling tool/function calling, workflow orchestration, and multi-step reasoning patterns aligned to business needs. •Test and validate GenAI applications using relevant tools and frameworks; capture, analyze, and report standard and custom quality metrics (e.g., relevance, groundedness, toxicity, latency, cost) and drive continuous improvement. •Collaborate with cloud and platform teams to design scalable Cloud AI architectures and cost-efficient deployments across AWS, Azure, or GCP. •Explore and evaluate new technologies, tools, and testing methodologies to improve development processes and solution quality; stay up-to-date with advancements in Generative AI and evaluation practices.