Testing the Agents That Look You in the Eye

In this session, 𝐒𝐚𝐢 𝐊𝐫𝐢𝐬𝐡𝐧𝐚, Director of Engineering at TestMu AI, and 𝐒𝐫𝐢𝐧𝐢𝐯𝐚𝐬𝐚𝐧 𝐒𝐞𝐤𝐚𝐫, Director of Engineering at TestMu AI, take on a category of software almost nobody is testing: AI agents with faces. They interview candidates, onboard customers and triage patients - live, on camera. Learn why testing one traditionally means a human joining the call, playing a role and sitting through the entire conversation, which makes ten personas a lost day and pre-release testing something that simply does not happen. Sai and Srinivasan also show their approach running live and talk honestly about what is genuinely hard: hearing the agent at all, knowing when to stop talking, and answering fast enough to sound human. 𝐇𝐢𝐠𝐡𝐥𝐢𝐠𝐡𝐭𝐬: 0:00 The Next Era of Customer-Facing AI: Agents With a Face 3:11 Speaker Intro - Srinivasan and Sai, Directors of Engineering, TestMu AI 3:42 From Deterministic Web Testing to Chat, Voice and Video Agents 5:15 Why Video Agents Are Different: Avatars, Expressions, Sentiment 5:46 The Scale Problem: One Scenario x Many Personas x Many Runs 7:17 Automating the Human: Building a Test Candidate, Not a Script 8:50 Three Layers: Avatar, the Reasoning Brain, and the Browser 10:52 Memory and Red Teaming in Multi-Round AI Interviews 13:26 No SDK, No Test Hooks: Testing Any Joinable WebRTC URL 15:31 Live Demo: Scenario Generation, Personas, Avatars and Test Profiles 20:37 Watching Two AI Agents Interview Each Other 22:09 Evaluation: Goal Completion, Validation Criteria, Conversation Flow 23:41 The Hardest Problems: Lip Sync, Audio RMS and False Silence 26:13 Turn Taking: Too Eager, Too Patient, and Dead Air 28:14 15+ Metrics Including Mean Opinion Score and Avatar Presentation 33:16 What's Next: Native Apps, Noisy Backgrounds, Multi-Person Red Teaming 37:00 Q&A: Chaos Engineering, Nodding and Attentiveness, Sign Language, Latency Register for TestMuConf 2027: https://www.testmuai.com/testmuconf-2027/?utm_source=youtube&utm_medium=organic&utm_term=&utm_campaign=testing_the_agents_that_look_you_in_the_eye #TestMuConf #TestMuAI #AIAgents #VoiceAI #AgentTesting #ConversationalAI #QualityEngineering #TestAutomation