Eliezer Yudkowsky Quotes

When you are older, you will learn that the first and foremost thing which any ordinary person does is nothing.

But ignorance exists in the map, not in the territory. If I am ignorant about a phenomenon, that is a fact about my own state of mind, not a fact about the phenomenon itself. A phenomenon can seem mysterious to some particular person. There are no phenomena which are mysterious of themselves. To worship a phenomenon because it seems so wonderfully mysterious, is to worship your own ignorance.

There was a conference one time on: "What are we going to do about the looming risk of AI disaster?" … And what came out of that conference was OpenAI, which was basically the worst possible way of doing anything. Like, "This is not a problem of, 'Oh no, what if secret elites get AI', it's that nobody knows how to build the thing." … So, like, "Let's open up everything! Let's accelerate everything!" It was like ChatGPT's blind version of throwing the ideals at a place where they were exactly the wrong ideals to solve the problem. … And that was it. That was me in 2015 going, "Oh. So this is what humanity will elect to do. We will not rise above. We will not have more grace, not even here, at the very end." So that is when I did my crying late at night, and then picked myself up and fought and fought and fought until I had run out all the avenues that I seem to have the capability to do.

If you declare Crocker's Rules, other people don't need to worry about being tactful to you. (You still need to worry about being tactful to them — Crocker's Rules only work one way.)

The AI does not hate you, nor does it love you, but you are made out of atoms which it can use for something else.

The nature of "reality" is something about which I'm still confused, which leaves open the possibility that there isn't any such thing. But Egan's Law still applies: "It all adds up to normality." Apples didn't stop falling when Einstein disproved Newton's theory of gravity. Sure, when the dust settles, it could turn out that apples don't exist, Earth doesn't exist, reality doesn't exist. But the nonexistent apples will still fall toward the nonexistent ground at a meaningless rate of 9.8 m/s2.

Between hindsight bias, fake causality, positive bias, anchoring/priming, et cetera et cetera, and above all the dreaded confirmation bias, once an idea gets into your head, it's probably going to stay there.

Physiologically adult humans are not meant to spend an additional 10 years in a school system; their brains map that onto "I have been assigned low tribal status". And so, of course, they plot rebellion—accuse the existing tribal overlords of corruption—plot perhaps to split off their own little tribe in the savanna, not realizing that this is impossible in the Modern World.

There are no surprising facts, only models that are surprised by facts; and if a model is surprised by the facts, it is no credit to that model.

If I'm teaching deep things, then I view it as important to make people feel like they're learning deep things, because otherwise, they will still have a hole in their mind for "deep truths" that needs filling, and they will go off and fill their heads with complete nonsense that has been written in a more satisfying style.

If dragons were common, and you could look at one in the zoo — but zebras were a rare legendary creature that had finally been decided to be mythical — then there's a certain sort of person who would ignore dragons, who would never bother to look at dragons, and chase after rumors of zebras. The grass is always greener on the other side of reality. Which is rather setting ourselves up for eternal disappointment, eh? If we cannot take joy in the merely real, our lives shall be empty indeed.

Lonely dissent doesn't feel like going to school dressed in black. It feels like going to school wearing a clown suit.

Have I ever remarked on how completely ridiculous it is to ask high school students to decide what they want to do with the rest of their lives and give them nearly no support in doing so? Support like, say, spending a day apiece watching twenty different jobs and then another week at their top three choices, with salary charts and projections and probabilities of graduating that subject given their test scores? The more so considering this is a central allocation question for the entire economy?

Part of the rationalist ethos is binding yourself emotionally to an absolutely lawful reductionistic universe — a universe containing no ontologically basic mental things such as souls or magic — and pouring all your hope and all your care into that merely real universe and its possibilities, without disappointment.

By and large, the answer to the question "How do large institutions survive?" is "They don't!" The vast majority of large modern-day institutions — some of them extremely vital to the functioning of our complex civilization — simply fail to exist in the first place.