LLM Paper Club (Speculative Decoding: Classic, Eagle, Medusa)
Registration
Past Event
About Event
Eugene and Vibhu are doing 3 spec decoding papers in 1!
Classic Speculative Decoding https://arxiv.org/abs/2211.17192
Speculative decoding heads, EAGLE HYDRA - https://github.com/SafeAILab/EAGLE - https://arxiv.org/abs/2402.05109
Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads (https://arxiv.org/abs/2401.10774)
we need YOU to volunteer to do rapid-fire recaps and explanations of our remaining papers on the board: https://app.sli.do/event/bNV6mo3BFGhe8Bqzb1tonb/live/questions
please sign up in #llm-paper-club!