Paper Club - The Annotated Transformer

​Join this week’s paper club as we dive into some of the fundamentals of deep learning.

This week, we will be reviewing a blog post called “The Annotated Transformer”.  IT’s a detailed walkthrough of how a transformer works, which is an important part of modern LLM infrastructure.  The essay was also recommended by Ilya Sutskever, on his 30 papers you should read list.

​https://nlp.seas.harvard.edu/annotated-transformer/

https://meet.google.com/uob-jqgx-jxi

​What is paper club? The paper club is a discussion group that covers a wide range of topics, some that are really technical ( e.g. GPipe , DSPy ) and some that are of more broad interest ( like doing graphic designs with LLMs ). We pick a paper every week, and read it over together, usually with one person facilitating the discussion. The group is a mixture of engineers, PhDs, and people from other fields like film and education. We want you here!