13 metaphors to give the flavor of why sufficiently advanced A.I. could be extremely dangerous

April 2, 2023

1. Suppose a new species evolves on earth with the same intellectual, planning, and coordination abilities relative to us that we have relative to chimps. Chimps are faster and stronger than most humans - why don't they run the show? 2. Suppose aliens show up on earth that are far smarter than the smartest among us at all cognitive tasks. They have specific goals that aren't fully aligned with ours, are completely unconstrained by human morality, and don't value our survival. What happens ne...

Four tiny parables about starting a company

December 22, 2018

TLDR: become a looper of questions to know how to program the machine that will polish the stone while you outlast the jungle. 1. Looping the Question “What don’t I know that I must know?” This Meta Question is your obsession. The answer to that Meta Question is itself a question, and it leads you to create your first data loop (say, conducting a series of interviews with experts). After sucking down much of what it has to teach you, you’re hearing the same answers again and again. Da...