Testing Your GenAI application: A Beginner’s Guide for Non-technical Users
About the Event
Generative AI models have advanced at an astonishing pace over the past two years. However, their adoption in business— especially in high-stakes applications—remains limited. One big reason? Their perceived unreliability and the potential risks they pose in real-life applications.
As a business/ product leader, risk/ compliance professional or even a startup founder, you are likely to depend on your technical colleagues to assess these risks.
Join this introductory session to understand what makes for a trustworthy, robust GenAI application, and how you can collaborate effectively with your technical partners to adopt ai at scale confidently.
Safety Benchmarks: Will your app spout violent, criminal or harmful stuff to end users? Learn how off-the-shelf benchmarks using our own Moonshot toolkit can help with this.
Speakers: Shameek & Harry from AIVF
Red Teaming: Could a malicious or even mischievous actor misuse or break your app? Learn how human experts, or another AI system, can simulate such attacks and stress test your app for security/ safety/ financial risks
Speakers: Alex & Sueyen from Vulcan
Accuracy and Hallucination testing: Is your app answering questions accurately? Are the answers in line with the internal content it’s meant to draw from? Learn how you can go beyond manual and “gut feel” testing to systematically test for this
Speakers: Shahul & Jithin from Ragas
Guardrails: Is your app in production breaking the rules you may have tested and put in before going live? Learn how relatively lightweight checks can help keep it on track
Speakers: Shreya & Safeer from Guardrails AI
Bringing it together: An overview of how many of these concepts are embedded into AWS’ Bedrock platform
Speaker: Dr Alessandro Cere, AWS
Don’t miss the chance to network and exchange insights – see you on the 19th of March!
This event aims to bring together like-minded people passionate about responsible AI, leveraging on community networks from the AI Verify Foundation, The Generative Beings, as well as Amazon Web Services Responsible AI Community of Practice.
Agenda
4:30 - 5:00 pm: Registration + Networking
5:00 - 5.10 pm: Welcome (AIVF, AWS, TGB)
5:10 - 7:10 pm: Keynote & Learning sessions
7:10 - 8:00 pm: Networking + F&B
8:00 PM: Event closes
Keynote session
Speaker: Shameek Kundu (Executive Director, AI Verify Foundation)
Learning sessions
Dr. Alessandro Cere (Principal Specialist Solutions Architect GenAI Evaluation, AWS)
Alex Leung (Co-founder, AIFT)
Sue Yen Leow (Director of Partnerships, AIFT)
Shahul ES (Cofounder, Ragas AI)
Jithin James (Cofounder, Ragas AI) [Video]
Safeer Mohiuddin (Co-founder, Guardrails AI) [Video]
Shreya Rajpal (Cofounder, Guardrails AI) [Video]
Harry Zhao (Product Manager, AI Verify Foundation)
Who Should Register
Business/ product leaders, risk/ compliance professionals, startup founders who want to learn about what makes for a trustworthy, robust GenAI application, and how to collaborate effectively with technical partners in this journey.
[Registration with missing or fake information will be rejected. AIVF/AWS/TGB reserve(s) the right to approve or reject any registration.]
AI Verify Foundation (AIVF):
A global open-source community that convenes AI owners, solution providers, users, and policymakers, to build trustworthy AI.
Amazon Web Services Responsible Generative AI Community of Practice:
In May 2024, AWS launched the AWS Responsible Generative AI Community for its customers and partners in Singapore to help harness the power of AI securely and responsibly in close alignment with AI Verify. This is a part of the broader AWS AI Spring commitment for Singapore, to accelerate the adoption of AI and generative AI across our economy in a safe and secure manner.
The Generative Beings (TGB):
Asia's fastest growing GenAI community of 2500+ Generative AI founders, leaders, builders, and experts. This is your community to learn, build, and earn using Generative AI.
Signup here | LinkedIn | Telegram | X