Arxiv Dives with Oxen.AI - Rise of the SLM, a survey of Smol Language Models
Hey Nerd, join the Herd!... for a little book/paper review.
WHAT TO EXPECT
Each week we pick a paper to cover in depth and have open Q/A. Often joined by paper authors themselves! Reading is optional 🙃.
THIS WEEK
Come for the food & drinks... stay for the paper review.
DOORS OPEN: 6:00pm
TALK STARTS: 6:30pm
The theme of this dive with be all about Smol Language Models that you can run locally. The DeepSeek and R1 papers show that it's becoming possible to generate synthetic data and train models that you own. So, it’s going to be a 🔥 topic... “Rise of the SLM - a survey of Smol Language Models”. We’ll do a survey of related papers and cap it all off with some internal GRPO experiments highlighting the newest Oxen.ai features 🤫.
You can start here and we'll share more papers over the coming week in our Discord...
TRY OUR NEW MODEL EVALS FEATURE
Oxen.ai makes it easier than ever to prompt various models on real world datasets. Just like the paper, we run through prompts live and testing them on a variety of benchmarks.
ARXIV DIVE SPECIAL. 🆓 🤖 Get Free Compute on Oxen 🤖 🆓 Email us and we'll 2x your free compute credits! All you gotta do is ask :) [one per user] Just email us at hello at oxen dot ai.
Docs here (https://docs.oxen.ai/getting-started/models)
💬 JOIN THE CONVO
Discord here to share paper recs and more community discussion.
SEE PAST SESSIONS
To see past topics head over to our blog which has show notes and links to Youtube videos.
🤓🐂🤓🐂🤓🐂🤓🐂🤓🐂🤓🐂🤓🐂🤓🐂🤓🐂🤓🐂
WHO'S AN ARXIV DIVER
1.4k+ in Discord and 5.3k+ on Youtube - we've been joined by folks from around the world including leaders from:
and many more...
Sign up
We share datasets relevant to these sessions via Oxen.ai. To get free data:
About Oxen.ai: Build World-Class AI Datasets, Together. Track, iterate, collaborate on, & discover data in any format.
About Arxiv Dives
Each week we dive deep into a topic in machine learning or artificial intelligence. We break down the content into a digestible format and have an open discussion with the Oxen.ai community. Read more in our Arxiv Dive Manifesto.