Twelve Labs: Multimodal AI Media & Entertainment Hack
Innovating at the Intersection of Multimodal AI and M&E
Twelve Labs and FBRC.AI are excited to bring together the best multimodal AI talent and the strongest AI community in Los Angeles for a groundbreaking 24hr hackathon focused on AI applications in media and entertainment.
Multimodal AI is revolutionizing the media and entertainment industry, enabling new possibilities from script writing and location scouting in pre-production to object removal and scene stabilization in post-production. One of the most innovative and powerful ways that multimodal AI is transforming M&E is through video understanding - allowing computers to interpret video with the same nuanced context as humans by analyzing visual, audio, textual and other data types together.
The Los Angeles AI community is uniquely positioned at the intersection of Silicon Valley tech innovation and Hollywood creativity. With a vibrant ecosystem of AI researchers, engineers, artists and entrepreneurs collaborating closely, LA is poised to drive the future of AI-powered media and entertainment.
Event Details
Date: June 8-9, 2024
Location: AI Beach House
Attendees: 100+ AI engineers, data scientists, and entertainment professionals
Event Agenda
Saturday, June 8
9am - Arrivals & Breakfast
10:30am - Introduction from Twelve Labs and FBRC.ai
11:00am - Team Formation
12pm - Hacking Begins
1pm - Lunch
2pm - Sponsored Workshops (Twelve Labs, AWS, and more)
6pm - Dinner
Sunday, June 9
9am - Breakfast
11:30am - Project Submissions
12:00pm - Lunch
1pm - Presentations and Demos from Teams
2pm - Judging
2:30pm - Announcing Winning Team & Wrap-up
3-5pm - Networking
Why Attend?
Showcase your AI skills and creativity in front of industry leaders and investors. This is your chance to get discovered!
Learn about the cutting-edge applications of multimodal AI in media and entertainment directly from the researchers and companies pushing the boundaries.
Network with top AI talent and industry leaders from both the technology and creative sides of the M&E industry. Build relationships that can accelerate your career.
Win exciting prizes and recognition to boost your resume and personal brand as an AI innovator. Past hackathon winners have gone on to raise venture capital and build successful startups!
Hackathon Use Cases
Participants will develop AI-powered solutions for challenges including:
Video Editing with Johnny Harris: Develop an AI-powered video editing tool that can analyze Johnny Harris' Switzerland bunker footage and script to automate the process of finding relevant clips and creating montages based on the script.
Highlight Reel Generation with Drew Binsky: Develop an AI-powered tool that can analyze Drew Binsky's travel footage and automatically generate engaging highlight reels that capture the best moments from his adventures around the world.
Sports Press Conference Summarization and Highlight Generation: Develop an AI-powered tool that can automatically generate concise summaries and engaging highlight reels from sports press conference videos. The goal is to help fans and media quickly grasp the key takeaways and most memorable moments without watching the entire press conference.
AWS-Powered Video Q&A Chatbot with RAG: Develop an AI-powered chatbot that can answer questions about a library of movie and TV show trailers using the RAG (Retrieval-Augmented Generation) approach. The chatbot should provide an engaging and informative Q&A experience for users interested in learning more about upcoming releases.
Twelve Labs' multimodal AI is already used by major sports leagues, film studios, and creators for intelligent video applications like asset management, post-production workflows, user engagement, and contextual advertising. This hackathon will expand the possibilities even further.
Prizes from Twelve Labs
1st Place: $2,500 + 100 Video Hours in Twelve Labs API credits
2nd Place: $1,500 + 75 Video Hours in Twelve Labs API credits
3rd Place: $1,000 + 50 Video Hours in Twelve Labs API credits
Judges
Greg Young (Head of Production and Post Technology at Prime Video & Amazon Studios)
Vivek Gangasani (AI/ML Solutions Architect working with Generative AI startups on AWS)
Pranav Murthy (Senior Gen AI/ML Specialist Solutions Architect at AWS, WW Tech Lead SageMaker Studio)
Nikao Yang (Principal at the AWS Venture Capital and Startups team)
Brad Boim (Senior Director, Asset Management and Post Production at NFL Media)
Eric Peters (Director, Post Production and Media Administration at NFL Media)
Simran Butalia (Principal M&E GenAI Consultant at Butalia Media Consulting)
Rachel Joy Victor (Co-Founder at FBRC.ai)
Manish Maheshwari (Product Manager - Developer Experience at Twelve Labs)
Soyoung Lee (Co-Founder and Head of Business Development at Twelve Labs)
Sponsors
We're proud to partner with these innovative companies and organizations:
1 - AWS
AWS can provide credits as prizes for the winning teams:
1st Place: $10,000 in AWS credits
2nd Place: $5,000 in AWS credits
3rd Place: $5,000 in AWS credits
Participants will have access to Amazon Bedrock, a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon through a single API, along with a broad set of capabilities you need to build generative AI applications with security, privacy, and responsible AI.
Using Amazon Bedrock, you can easily experiment with and evaluate top FMs for your use case, privately customize them with your data using techniques such as fine-tuning and Retrieval Augmented Generation (RAG), and build agents that execute tasks using your enterprise systems and data sources. Since Amazon Bedrock is serverless, you don't have to manage any infrastructure, and you can securely integrate and deploy generative AI capabilities into your applications using the AWS services you are already familiar with.
Learn more about Amazon Bedrock developer experience
2 - Fireworks
Fireworks.ai provides a fast, reliable platform for developers to run and tune generative artificial intelligence (AI) models at scale, like Llama 3 and Stable Diffusion 3. The company's mission is to democratize AI for developers and businesses. Use Fireworks to provide your users with delightful, responsive experiences by delivering up to 4x lower latency than alternative solutions with zero compromise on model quality.
More Resources:
Website: Fireworks.ai
API quickstart
All models
Image generation (Stable Diffusion)
Image understanding (Fire-llava)
Embedding models guide
Credits: $20 credits provided to all hackathon participants through this form. $1,000 in credits will be assigned to the hackathon submission with the best Fireworks usage!
3 - VAST AI
Vast.ai is a market based cloud computing platform focused on reducing the costs and friction of compute-intensive workloads, enabling anyone to easily leverage large-scale GPU liquidity. We have thousands of GPUs available now at cloud.vast.ai.
More Resources:
Website: cloud.vast.ai
Promotion: Receive $20 in credits for all new users signing up through this form. Plus, an exclusive $1,000 in credits for the most innovative use of Vast.ai in a hackathon entry!
Contact lab@fbrc.ai if you are interested in sponsoring or to help volunteer.