Building & Testing an E-Commerce AI Chatbot | RAG, Tools & AI Evals | FDE Full Course #18

FDE Full Course #18 In the previous video, we understood the theory behind testing AI applications — deterministic evals, LLM-as-a-Judge, correctness, relevance, faithfulness, hallucinations, and more. Now we actually build and test one. In this video, we build an E-commerce AI Support Chatbot using Spring AI that can answer company-policy questions using RAG, fetch live order information using Tools, and combine both when required. Once the chatbot is ready, we build a complete AI Evaluation pipeline around it. We test: Whether the correct RAG document was retrieved Whether the correct tool was called Whether the correct arguments were passed Whether the response exists Relevance Correctness Faithfulness Helpfulness Hallucination-Free score We also create a Golden Dataset, capture the application's execution trace, use Deterministic Evals for exact behaviour, and use LLM-as-a-Judge for semantic quality. So this video takes us through the complete journey: Build the AI Application → Observe its Behaviour → Evaluate it → PASS / FAIL #GenAI #SpringAI #AIEvals #RAG #LLM #Java #SpringBoot #LLMAsAJudge #AIChatbot ------------------------------------------------------------------------------------------------------------- Code and Notes: Github : https://github.com/adityatandon15/Forward-Deployed-Engineer-Full-Course Spring Boot Full Course : https://youtube.com/playlist?list=PLEYgx5hMdopw&si=o1Njda0XgYXwg4xs JAVA Full Course Series : https://youtube.com/playlist?list=PLQEaRBV9gAFsR15tNo2QLF9d2qc-c018p&si=4qQP_euMTZMvAwNu Join our WhatsApp Group: https://www.whatsapp.com/channel/0029VbBF1XKF1YlMyYuPM23s We have paid courses on DSA, Web Development , Blockchain, System Design & GenAI. Join Courses: https://strikes.in/ Coder Army Website: https://coderarmy.in/#home Coder Army App: https://play.google.com/store/apps/details?id=com.rohit.negi Connect with Aditya Tandon Instagram : https://www.instagram.com/itsadityatandon LinkedIn : https://www.linkedin.com/in/adityatandon2 Twitter : https://x.com/adityatandon02 Timestamps: