9:39Faster LLMs: Accelerate Inference with Speculative DecodingIBM Technology26.2K viewsView & Download
4:53What is Speculative Decoding? making LLMs fasterData Science in your pocket5 viewsView & Download
15:15How to make LLMs fast: KV Caching, Speculative Decoding, and Multi-Query Attention | Cursor TeamLex Clips13.8K viewsView & Download
40:19Speculation is all you need: Intro to Speculative Decoding for High Performance InferenceModal862 viewsView & Download
7:40Speculative Decoding: 3× Faster LLM Inference with Zero Quality LossTales Of Tensors1.6K viewsView & Download
1:51MTP Speculative Decoding Explained: How AI Models Generate FasterTyrel Barstow4 viewsView & Download
7:48Why using a dumb language model can speed up a smarter one: Speculative Decoding [Lecture]Jordan Boyd-Graber233 viewsView & Download
12:25Speculative Decoding: Faster Inference for Transformers and LLMsThe Clue Matrix15 viewsView & Download