Agent Evaluation with RAGAS
"How do I know if what comes out of my agentic LLM application is correct?”
“What does a good output look like?”
“How can I avoid hallucinations and wrong answers?”
Just as in 2024, everyone working to develop production LLM applications is asking these questions, and rightly so!
This year, however, agents are on the rise, as are the number of companies building, shipping, and sharing LLM application prototypes.
In this event, we’ll explore the latest on agent evaluation from the leading LLM application evaluation framework: RAG ASsessment (RAGAS).
Join us live to learn about best practices for evaluating agentic workflows, including Topic Adherence, Tool call Accuracy, and Agent Goal accuracy.
Join us live to dig into the details, from concepts to code!
📚 You’ll learn:
How to think about assessing your agent applications quantitatively, with leading best-practice metrics
How agentic workflows are being assessed at the LLM edge
🤓 Who should attend the event:
Aspiring AI Engineers who want to build and evaluate production-grade agent applications
AI Engineering leaders who want to instrument their agent deployments with leading evaluators
Speakers:
Dr. Greg” Loughnane is the Co-Founder & CEO of AI Makerspace, where he is an instructor for their AI Engineering Bootcamp. Since 2021, he has built and led industry-leading Machine Learning education programs. Previously, he worked as an AI product manager, a university professor teaching AI, an AI consultant and startup advisor, and an ML researcher. He loves trail running and is based in Dayton, Ohio.
Chris “The Wiz” Alexiuk is the Co-Founder & CTO at AI Makerspace, where he is an instructor for their AI Engineering Bootcamp. During the day, he is also a Developer Advocate at NVIDIA. Previously, he was a Founding Machine Learning Engineer, Data Scientist, and ML curriculum developer and instructor. He’s a YouTube content creator YouTube who’s motto is “Build, build, build!” He loves Dungeons & Dragons and is based in Toronto, Canada.
Follow AI Makerspace on LinkedIn and YouTube to stay updated about workshops, new courses, and corporate training opportunities.