LLM Paper Club (Gemini Diffusion & Diffusion Models Survey)
@tytybyebye will present his survey of diffusion models
video:
text:
audio:
Readings covered:
Background on Diffusion
Deep Unsupervised Learning using Nonequilibrium Thermodynamics, Sohl-Dickstein Et al. 2015-03-12 https://arxiv.org/abs/1503.03585,
Improved Techniques for Training Score-Based Generative Models, Song & Ermon 2020-06-16 https://arxiv.org/abs/2006.09011,
Denoising Diffusion Probabilistic Models, Ho Et al. 2020-06-19 https://arxiv.org/abs/2006.11239,
Score-Based Generative Modeling Through Stochastic Differential Equations, Song Et al. 2020-11-26 https://arxiv.org/abs/2011.13456,
Language Diffusion Models
Structured Denoising Diffusion Models in Discrete State-Spaces, Austin et al. 2021-07-13 https://arxiv.org/abs/2107.03006,
DiffuSeq: Sequence to Sequence Text Generation with Diffusion Models, Gong et al. 2022-10-17 https://arxiv.org/abs/2210.08933,
Scaling up Masked Diffusion Models on Text, Nie et al. 2024-10-24 https://arxiv.org/abs/2410.18514,
Large Language Diffusion Models, Nie et al. 2025-02-14 https://arxiv.org/abs/2502.09992,
Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models, Arriola et al. 2025-03-12 https://arxiv.org/abs/2503.09573,
d1: Scaling Reasoning in Diffusion Large Language Models via Reinforcement Learning, Zhao et al. 2025-04-16 https://arxiv.org/abs/2504.12216
---
we need YOU to volunteer to do rapid-fire recaps and explanations of our remaining papers on the board: https://app.sli.do/event/bNV6mo3BFGhe8Bqzb1tonb/live/questions
please sign up in #llm-paper-club in https://www.latent.space/p/community discord
recordings at https://www.youtube.com/@LatentSpaceTV