The Long Middle · Post 1

Why Smart People Believe False Things — And What You Can Do About It

SIGNAL · 2 min read

Intelligence is not a reliable protection against misinformation. This is one of the most uncomfortable findings in the psychology of belief — and one of the most important to understand clearly. The people most susceptible to sophisticated misinformation are not the least intelligent or the least educated. They are often highly intelligent and well-educated, with one additional characteristic: strong prior beliefs that motivated reasoning can protect. The intelligence, in these cases, is applied to the defence of an existing position rather than to its examination. The smarter you are, the better you are at constructing convincing arguments for conclusions you already hold. Understanding this changes what good thinking looks like.

The three mechanisms you need to know

Three cognitive features, documented in the research on belief formation, are systematically exploited by the current information environment. Understanding each one changes what you need to do to think clearly. The first is the illusory truth effect: repeated exposure to a claim increases its perceived accuracy, even when the claim is known to be false. The mechanism is familiarity — the brain uses ease of processing as a heuristic for truth, and familiar information processes more easily. Repetition creates familiarity. Familiarity creates a feeling of truth. The feeling is used as evidence, unconsciously, when the explicit evaluation of the claim is bypassed by the speed and volume of the information environment. The second is motivated reasoning: the tendency to evaluate evidence more critically when it threatens existing beliefs than when it supports them. This is not conscious hypocrisy. It is an automatic cognitive process that applies higher standards to unwelcome information and lower standards to welcome information. The result is that exposure to evidence can sometimes strengthen rather than weaken prior beliefs — each challenging piece of evidence getting refuted more thoroughly than the supporting evidence gets scrutinised. The third is novelty bias: the preference for new, surprising, and emotionally activating information over accurate but unexciting information. This bias is directly exploited by information systems optimised for engagement, where the most emotionally activating content gets amplified regardless of its accuracy.

What calibration actually looks like

The intervention that the research most consistently supports is not fact-checking specific claims, important as that is. It is the cultivation of a general habit of epistemic calibration — knowing, for any given belief, how confident you actually are in it and what evidence would genuinely cause you to revise it. The calibration prompt is simple: for any significant factual claim, complete this sentence before stating or sharing it: "I am about ___% confident this is accurate, because ___. I would revise this if I saw ___." Three blanks, less than a minute. Most people discover, when they try this honestly, that their performed confidence significantly exceeds their evidential confidence. This gap is not dishonesty. It is the normal consequence of a social environment that rewards confident assertion and punishes visible uncertainty. Closing the gap, even partially, produces dramatically better thinking. SIGNAL: How to Find What's True When the World Is Loud explores the three mechanisms of belief distortion and the practical tools of the Signal-Finder's Protocol for thinking more clearly in an environment designed to prevent it.

SIGNAL

The full book explores this topic in much greater depth, with production history, box-office analysis, and the complete story of reclamation.

Get the Book →