13 metaphors to give the flavor of why sufficiently advanced A.I. could be extremely dangerous

April 2, 2023

1. Suppose a new species evolves on earth with the same intellectual, planning, and coordination abilities relative to us that we have relative to chimps. Chimps are faster and stronger than most humans - why don't they run the show? 2. Suppose aliens show up on earth that are far smarter than the smartest among us at all cognitive tasks. They have specific goals that aren't fully aligned with ours, are completely unconstrained by human morality, and don't value our survival. What happens ne...

A thought experiment about what you’d be truly capable of doing (if you had no choice)

April 26, 2018

Think of something you value that:A. multiple other people you know are capable of achieving, but thatB. you assume you would not be capable of achieving, even thoughC. you have never actually tried to do this thing well before. Now suppose, for a moment, that you have no choice but to do the thing. That is, everything you care about in the world will be destroyed if you do not achieve it in X months. Here, X could be 1 if it's a very small thing, or X could be 100 if it's a much larger thin...