Why Would AI Want to do Bad Things? Instrumental Convergence
Robert Miles AI Safety · 4 位 HN 用户推荐 · 2019–2023
...and many would say that’s because us humans are bad at imagining optimizing agents without anthropomorphizing them. This is a reasonable, even typical suspicion that many people share! The best explanation I know of why it’s unfortunately wrong is by Robert Miles in a video, but if you prefer a more thorough treatment, you could also read about “instrumental convergence” directly. If you find a
— ludwigschubert, 2019There's a wondeful [link] channel from a researcher who focusses exactly on this topic, I think you should check it out: [link]
— sabellito, 2022[2] [link] Good explainer video by Robert Miles: [link]
— jbay808, 2023The trolley problem is similarly a thought experiment in moral philosophy that many moral philosophers have used to guide discussion, but nobody actually takes the thought experiment seriously as a "real-world" thing. If you actually want to engage with the argument in good faith for why an AI might indeed be smart enough to wipe us out but "dumb enough" to just pursue some other goal ("make pape
— DirkH, 2023