Oz

“For an instant Harry imagined his own Mum and Dad in Azkaban with the Dementors sucking out their life, draining away the happy memories of their love for him. Just for an instant, before his imagination blew a fuse and called an emergency shutdown and told him never to imagine that again.”
― Eliezer Yudkowsky, Harry Potter and the Methods of Rationality

“You couldn't leave your home planet while it still contained a place like Azkaban.

You had to stay and fight.”
― Eliezer Yudkowsky, Harry Potter and the Methods of Rationality

“But then human beings only understood each other in the first place by pretending. You didn't make predictions about people by modeling the hundred trillion synapses in their brain as separate objects. Ask the best social manipulator on Earth to build you an Artificial Intelligence from scratch, and they'd just give you a dumb look. You predicted people by telling your brain to act like theirs. You put yourself in their place. If you wanted to know what an angry person would do, you activated your own brain's anger circuitry, and whatever that circuitry output, that was your prediction. What did the neural circuitry for anger actually look like inside? Who knew? The best social manipulator on Earth might not know what neurons were, and neither might the best Legilimens.”
― Eliezer Yudkowsky, Harry Potter and the Methods of Rationality

“I have a feeling," Harry said finally, "that we're coming at this from the wrong angle. There's a tale I once heard about some students who came into a physics class, and the teacher showed them a large metal plate near a fire. She ordered them to feel the metal plate, and they felt that the metal nearer the fire was cooler, and the metal further away was warmer. And she said, write down your guess for why this happens. So some students wrote down 'because of how the metal conducts heat', and some students wrote down 'because of how the air moves', and no one said 'this just seems impossible', and the real answer was that before the students came into the room, the teacher turned the plate around."

"Interesting," said Professor Quirrell. "That does sound similar. Is there a moral?"

"That your strength as a rationalist is your ability to be more confused by fiction than by reality," said Harry. "If you're equally good at explaining any outcome, you have zero knowledge. The students thought they could use words like 'because of heat conduction' to explain anything, even a metal plate being cooler on the side nearer the fire. So they didn't notice how confused they were, and that meant they couldn't be more confused by falsehood than by truth. If you tell me that the centaurs were under the Imperius Curse, I still have the feeling of something being not quite right. I notice that I'm still confused even after hearing your explanation.”
― Eliezer Yudkowsky, Harry Potter and the Methods of Rationality