❝HN 片单

CS480/680 Lecture 19: Attention and Transformer Networks

Pascal Poupart · 3 位 HN 用户推荐 · 2023–2023

  1. I would also recommend Pascal Poupart's talk [1] on Attention and Transformers. Doesn't seem to be cited often, but its quite well done and seeing him work out some of the details using chalk and board is very reassuring. [1] [link]
    — abhgh, 2023
  2. I'm missing a lot of details but that's basically the intuition behind this. These are very excellent resources: - [link] - [link]
    — elankart, 2023
  3. What made attention mechanism click to me was the video [link] by Sebastian Raschka. Another good video on attention that tries to give a bit more intuition on the query/key/value stuff is [link]
    — metanonsense, 2023

← HN 片单