Cover Image for From gut feel to full eval: turning "good" into measurable AI quality (ft Pi Labs)
Cover Image for From gut feel to full eval: turning "good" into measurable AI quality (ft Pi Labs)
Avatar for Promptfoo
Presented by
Promptfoo

From gut feel to full eval: turning "good" into measurable AI quality (ft Pi Labs)

Google Meet
Registration
Welcome! To join the event, please register below.
About Event

Learn how to think about "goodness" and how to execute on it when it comes to data. We cover a variety of metrics (including classifiers, similarity scores, assertions, etc) and show you how to curate and score sample sets with Pi, followed by analysis in Promptfoo.

Hosted by Pi Labs and Promptfoo!

PS, check out this similar talk Pi Labs gave at the June AI Eng Worlds Fair to get a feel for what to expect (except this talk will be about Promptfoo + Pi): https://www.youtube.com/watch?v=jxrGodnopHo

Avatar for Promptfoo
Presented by
Promptfoo