Cover Image for Arxiv Dives with Oxen.AI - Evolutionary Optimization of Model Merging Recipes
Cover Image for Arxiv Dives with Oxen.AI - Evolutionary Optimization of Model Merging Recipes
Avatar for Oxen.ai
Presented by
Oxen.ai
Build World-Class AI Datasets, Together. Track, iterate, collaborate on, & discover data in any format.

Arxiv Dives with Oxen.AI - Evolutionary Optimization of Model Merging Recipes

Zoom
Registration
Past Event
Welcome! To join the event, please register below.
About Event

​Hey Nerd, join the Herd!... for a little book/paper review.

WHAT TO EXPECT

​Each week we pick a topic to cover in depth and have open Q/A and discussion. Reading optional 🙃.

​We'll alternate in some Practical ML time - that includes 1) live, working code, 2) running models on real data, and 3) learning to apply the principles to your own work.

THIS WEEK

We present a novel application of evolutionary algorithms to automate the creation of powerful foundation models. While model merging has emerged as a promising approach for LLM development due to its cost-effectiveness, it currently relies on human intuition and domain knowledge, limiting its potential. Here, we propose an evolutionary approach that overcomes this limitation by automatically discovering effective combinations of diverse open-source models, harnessing their collective intelligence without requiring extensive additional training data or compute.

​JOIN THE CONVO

​Make sure to also join our Discord here (https://discord.gg/s3tBEn7Ptg) to share recommendations for future sessions and more community discussion.

​SEE PAST SESSIONS

​To see past topics head over to our blog which has show notes and links to Youtube videos.
🤓🐂🤓🐂🤓🐂🤓🐂🤓🐂🤓🐂🤓🐂🤓🐂🤓🐂🤓🐂

​WHO'S AN ARXIV DIVER

​We've been joined by folks from around the world including leaders from:

​and many more...


​Sign up

​We'll be sharing datasets relevant to these sessions via our wicked fast and we think, pretty beautiful, Oxen.ai. To get the most out of participating in Arxiv Dives, we recommend:

About Oxen.ai: Build World-Class AI Datasets, Together. Track, iterate, collaborate on, & discover data in any format.


​About Arxiv Dives

​Each week we are diving deep into a topic in machine learning or artificial intelligence. We break down the content into a digestible format and have an open discussion with the Oxen.ai team and friends. We like to nerd out, so expect to dive deep! Read more on why we host these in our Arxiv Dive Manifesto.

Avatar for Oxen.ai
Presented by
Oxen.ai
Build World-Class AI Datasets, Together. Track, iterate, collaborate on, & discover data in any format.