Do we need Attention? - Linear RNNs and State Space Models (SSMs) for NLP
Sasha Rush · 2 位 HN 用户推荐 · 2024–2024
Would recommend Sasha Rush's lecture [link] , it provides the intuition for state space models via linear RNNs
— anomaly72, 2024To those curious about the tradeoffs between transformer and state space model layers, I highly recommend Sasha Rush's video on it: [link]
— a_wild_dandan, 2024