CS480/680 Lecture 19: Attention and Transformer Networks
Pascal Poupart · 3 位 HN 用户推荐 · 2023–2023
I would also recommend Pascal Poupart's talk [1] on Attention and Transformers. Doesn't seem to be cited often, but its quite well done and seeing him work out some of the details using chalk and board is very reassuring. [1] [link]
— abhgh, 2023I'm missing a lot of details but that's basically the intuition behind this. These are very excellent resources: - [link] - [link]
— elankart, 2023What made attention mechanism click to me was the video [link] by Sebastian Raschka. Another good video on attention that tries to give a bit more intuition on the query/key/value stuff is [link]
— metanonsense, 2023