Skip to main content
bash TV

What is your AI Agent doing wrong?

Agentic AI Institute

28 views20 Nov 2026

YouTube

Here’s how you can stay engaged and access more valuable content: 🔹 Access the session presentation: https://docs.google.com/presentation/d/1X0T-3NL2AwbRI8HN-MJcar63am3s8yig_wUKqre0FR0/edit?usp=sharing 🔹 LinkedIn Community: https://www.linkedin.com/company/mahesh-ai-pm-community/ 🔹 Substack : https://myaicommunity.substack.com/ 🔹 Sign up for Free Learning Resources: https://forms.gle/sRNjXnsurNxNAUQW7 🔹 AI PM Certification: https://maven.com/mahesh-yadav/genaipm 🔹 AI PM Interview Bootcamp: https://maven.com/mahesh-yadav/ai-pm-interview-prep-bootcamp 🔹 Speak to Our Mentors: Book a call Here: https://calendly.com/d/ct2s-3s2-n89/1-1-with-team-mahesh?month=2026-10&utm_medium=youtube&utm_campaign=description_campaign What is this lesson about? Most AI agents never reach production. The ones that do get killed by evaluations nobody set up. In this session, Mahesh Yadav (ex-Google, Meta, AWS, Microsoft, 12 AI patents) breaks down how to evaluate agents on quality, honesty, task adherence, tool use, and safety, then builds real evaluators live in Microsoft Azure AI Foundry. You'll see why helpful-honest-harmless isn't enough for agents, what to measure before you ship (context quality, groundedness, completeness, retrieval, task completion, tool calling accuracy), where the 10x cost in evaluation setup comes from, and how to price agents to outcome with the ROI-first framework: high attribution, high autonomy, sub-$1 cost per task. This is session 194 of Mahesh's free weekly Friday series, open to alumni and anyone building in AI product management. Join Cohort 10 of the Agentic AI PM Certification, the #1 rated AI PM program on Maven (4.8 stars, 597 reviews, 10,000+ alumni now at Google, Meta, AWS, Microsoft, Anthropic, Apple, PayPal). 5 weeks, live, cohort starts August 29, 2026. Last cohort of 2026. Enroll: https://maven.com/mahesh-yadav/genaipm Book a 1:1 with the team: https://calendly.com/d/ct2s-3s2-n89/1-1-with-team-mahesh

Join the discussion

Have something to add?

Sign in to reply, follow this thread, and earn XP when your answer helps someone.