Secure Inference at Scale: Real-World AI Deployment with Protopia, Cyborg, AWS and WWT
Secure Inference at Scale: Real-World AI Deployment
AI is powering the next wave of products across industries, but turning bold ideas into reality means solving one of the toughest challenges in technology: keeping sensitive data secure. As systems grow more connected and regulations continue to tighten, organizations need new approaches to protect information at every stage of the AI lifecycle. The challenge is not just deploying AI, but doing it safely and responsibly.
In this session, you’ll hear how Protopia AI, Cyborg, AWS, and WWT are working together to help organizations meet that challenge with secure, scalable AI solutions built for real-world deployment.
Protopia’s Stained Glass technology enables LLMs to process sensitive data with zero exposure, unlocking high-value datasets for completely private, high-performance inference, even in managed environments.
Cyborg’s encrypted vector database keeps data protected at rest, in transit, and during processing, enabling fast and secure retrieval for AI workloads.
AWS provides the scalable, enterprise-grade GenAI infrastructure to run these workloads securely and efficiently, with services like Amazon Bedrock making it easier to build and deploy generative AI applications.
WWT brings it all together, helping the most security-conscious enterprises deploy production-ready AI for complex, heavily regulated environments.
In this session, panelists will walk through the core components of secure inference systems, share a live demo of a joint solution, and offer actionable insights for AI product builders. Attendees will leave with strategies for creating the next generation of AI systems on platforms trusted by leading enterprises and governments.
Our Speakers
Eiman Ebrahimi, Ph.D. is the Co-Founder and CEO of Protopia AI, a company helping enterprises run AI on sensitive data without compromising privacy. Previously, he spent 9 years as a Senior Research Scientist at NVIDIA, where he focused on large-scale data access and scalable AI infrastructure. Eiman holds a Ph.D. in Electrical and Computer Engineering from the University of Texas at Austin and has authored award-winning research in computer architecture and AI systems.
Nicolas Dupont is the CEO & Founder of Cyborg, a startup enabling AI adoption in regulated industries through Confidential AI. He leads the team's work on CyborgDB, the first end-to-end encrypted vector database which underpins secure AI inference workflows.
Istvan Berko is the Global Head of AI Cyber and Innovation at World Wide Technology. With 25+ years in security, risk, and governance, he has held senior roles at NTT/Dimension Data and AWS, authored AWS Cloud Adoption Framework whitepapers, and remains active in the cybersecurity community through leadership and industry events.
John Liu is Principal Product Manager for Amazon Bedrock at AWS, where he helps organizations build and deploy generative AI applications at scale. With 14 years as a product executive and 10 years as a portfolio manager, he combines commercial insight with technical product leadership. Previously, he led product strategy for AWS’s Web3 and blockchain services and drove innovation in DeFi and fintech platforms.