Evaluating LLMs: From Concepts to Real-World Tools
What is Applied AI?
Applied AI is an invite only community for Operators. We help each other to get ready for the AI age through webinars, learning materials and community discussions.
Presenter
The speaker for this session is Gautham Muthukumar. Here's a bit about him.
"Gautham is a seasoned product / tech leader with over 14 years technology experience, ~10 years in product management - Amazon, LinkedIn, Intuit and Microsoft Azure AI - largely building ML applications and platform products for B2B customers. He is currently a Principal Product Manager at Microsoft"
Session content
What is Eval and why is it needed?
How to create Evals?
Show a sample of eval that was built with chatgpt - Show how evals is supported in cloud tools
Show observability and evals support in langfuse
Who is it relevant for?
This session will focus on basics of Evals and what are they all about. Anyone who is interested to know with or without coding experience can find it helpful.
Who runs Applied AI?
Bala is the founder of ZORP and comes with 17 years of technology and product experience. You can connect here at https://www.linkedin.com/in/balakumaranpanneerselvam/
Praveen is currently working on his start up and his last stint was as Director at Swiggy. He is a seasoned product leader and primarily has worked in multiple start ups over the last 13 years. You can connect here at https://www.linkedin.com/in/praveen213
Pls check out our previous sessions here.
https://www.youtube.com/@applied_ai_club
To join the club, visit