❝HN 片单

AI Language Models & Transformers - Computerphile

Computerphile · 3 位 HN 用户推荐 · 2022–2025

  1. This video by Computerphile is a great overview of transformers and how we got to this point [0]. Basically the networks we used before, recurrent neural networks, "forgot" prior information so they're not good at long tasks. The transformer architecture however does not forget (or at least as easily). [0] [link]
    — cercatrova, 2022
  2. And for a deeper dive, Andrej Kharpaty has this hands-on video[1] where he builds a transformer from scratch. You can check-out his other videos on NLP as well they are all excellent. [0] [link] , [link]
    — FranklinMaillot, 2023
  3. This gives you a similar interface to what you see in the Google AI Studio but you run it locally. And with downloaded models. (The model you download is the actual LLM which is basically very large amount of parameters you combine with the input tokens to get the next token the system outputs.) For a more fundamental introduction to what all these systems do there are a number of Computerphile v
    — mhast, 2025

← HN 片单