❝HN 片单

Deep Dive into LLMs like ChatGPT

Andrej Karpathy · 11 位 HN 用户推荐 · 2025–2026

Karpathy 3.5 小时通俗讲解 ChatGPT 类 LLM 的原理,无需数学编程基础

  1. Karpathy's recent video[1] is quite good. 1. Deep Dive into LLMs like ChatGPT ( [link] )
    — sieve, 2025
  2. The key differences between base and agentic models are 1) the latter behave like agents, and 2) the latter hallucinate less. But that isn't about planning (you still need planning to hallucinate something). It's more to do with post-base training specifically being about providing positive rewards for things which aren't hallucinations. Changing the way the reward function is computed during RL d
    — wzdd, 2025
  3. There is a very good intro on how LLM work by Kharpaty. It's [link] and it's 3.30 hours, so way below the 100 hours mark :)
    — highhedgehog, 2025
  4. Depending on how much time you have, the first thing I would recommend is to watch Karpathy's 'deep dive into LLMs' video ( [link] ). It is 3.5 hours but it will give you so much instinctive understanding of how these things work and will likely save you a lot of time.
    — GodelNumbering, 2025
  5. [0] [link] [1] [link]
    — matthewolfe, 2025
  6. Karpathy walks through this visualization in [link] , well worth a watch!
    — m4r71n, 2025
  7. Then there is a good video that dives into LLMs and how they work that is quite approachable: [link]
    — runjake, 2025
  8. Also keep in mind that LLMs are stochastic by design. If you haven't seen it, Karpathy's excellent "deep dive into LLMs like chatgpt" video[0] explains and demonstrates this aspect pretty well: [0] [link]
    — pengaru, 2025
  9. This is a good resource, however for about 99.99% of people, you are most likely to just use a foundation model like ChatGPT, Claude, Gemini etc. so this knowledge/training will get you neither here or there. I would suggest you look into another Karpathy's video -- Deep Dive into LLMs like ChatGPT. [link]
    — npalli, 2026
  10. I highly recommend Andrej Karpathy's Deep Dive into LLMs like ChatGPT: [link] . It's a 3.5 hour general intro to the topic that I think does a great job of making sense of the tech and how it works under the hood, without needing to build up a foundation of math and programming.
    — romanhn, 2026
  11. Even if you have some basic understanding of how LLMs work, I highly recommend Karpathy’s intro to LLMs videos on YouTube. - [link] - [link]
    — etothet, 2026

← HN 片单