What's the difference between an eval and a test? By the end of this video, you'll know the difference with confidence.
📚 RESOURCES
- Mastra docs: https://mastra.ai/docs/
💬 JOIN THE MASTRA COMMUNITY
- https:...
Most people think they’ve built a successful AI agent because it ran perfectly once in their terminal. But there’s a massive gap between a flashy demo and a robust system that works reliably in production. When yo...
Watch Video
Nick Ung, ML lead for safety and customer care at Lyft, breaks down how his team built an eval system that actually keeps pace with production AI agents at Interrupt, the agent conference by LangChain.
From offline s...
Join the AI Evals October 2026 cohort: https://maven.com/parlance-labs/evals?promoCode=yt-2026
JJ Allaire on Inspect AI Evals for LLMs
JJ Allaire, founder of RStudio (Posit), presents Inspect AI, a Python-based fram...
Hamel Husain and Shreya Shankar teach the world’s most popular course on AI evals and have trained over 2,000 PMs and engineers (including many teams at OpenAI and Anthropic). In this conversation, they demystify th...
Watch Video
👉 FREE Agentic AI Webinar - https://interviewkickstart.com/agentic-ai-career-boost?utm_source=google&utm_medium=youtube_video&utm_campaign=L10X_social_media_youtube_video_YTV220226&utm_content=youtube_video
📘 F...
AI agent evals are how you actually know if your agent works. Testing AI agents isn't like testing normal software — unit tests, integration tests, and E2E tests all break down the moment your system is non-determin...
Watch Video
Copy my best AI workflows to save time and automate busywork: https://www.behindthecraft.com
🤝 Subscribe to my practical AI newsletter read by 150K+ professionals: https://creatoreconomy.so
Today, I want t...
NOTE: see our updated AI Evals video here https://youtu.be/dC8e2hHXmgM
👋 Try 1 paid lesson or unlock the full course at: tinyurl.com/LiftoffPMCourse
📝Course FAQ: tinyurl.com/LiftoffPMFAQ
Hi there! Need help a...
