Glimpse.
Big Think
47 min video
3 min read
Why Smart Societies Fall for Mass Delusion
You just saved 44 min.
The big takeaway
Yuval Noah Harari argues that human self-destruction stems not from flawed nature but from flawed information systems. As AI becomes an alien intelligence capable of creating stories and ideologies, societies face unprecedented risks: inorganic surveillance networks that never rest, totalitarian systems empowered by AI's processing capacity, and democratic discourse hijacked by bots. Survival depends on building self-correcting institutions, distinguishing truth from fiction, and protecting human conversation from algorithmic manipulation.
The Knowledge-Wisdom Paradox
Good People, Bad Information
Humans are generally wise, but when given poor information, they make catastrophic decisions. The problem driving self-destruction is not human nature but the quality of information systems we rely on. This explains why advanced societies remain as susceptible to mass delusion as ancient tribes.
Storytelling Powers Cooperation
Large-scale cooperation requires more than facts; it requires compelling narratives. Building an atomic bomb needs physicists to know e=mc², but also millions of miners, engineers, and farmers coordinated by shared stories—whether religious mythology, communist ideology, or the fiction of money itself.
1
Facts alone (e.g., physics equations)
2
Storytelling creates shared meaning
3
Millions coordinate around narrative
4
Large-scale projects become possible
How storytelling enables mass cooperation beyond raw facts
Money as Collective Story
A dollar bill has no intrinsic value—humans cannot eat or drink it. Money works only because finance experts (the greatest storytellers) convince millions that these pieces of paper or digital bits have worth. As long as trust in the story persists, people labor for abstract tokens.
The Rise of Alien Intelligence
AI as Alien, Not Artificial
The term 'artificial intelligence' misleads; AI is better understood as alien intelligence. Unlike artifacts we control, AI learns, adapts, and generates ideas we cannot predict or anticipate. It thinks in fundamentally alien ways, discovering strategies humans never conceived of.
The Coffee Machine Test
A machine that simply follows pre-programmed instructions (pressing a button produces espresso) is not AI. True AI learns independently: it observes you for a month, predicts you want espresso before you ask, and invents entirely new drinks you've never tasted. This capacity to surprise is the hallmark of AI.
AlphaGo and the Alien Continent
In 2016, AlphaGo defeated world champion Lee Sedol at Go, a 2,000-year-old game refined by tens of millions of players. AlphaGo used strategies Go experts considered impossible, revealing that human minds had explored only one small island of Go's vast landscape for millennia. AI discovered entire new continents in weeks.
2,000 years
Human exploration of Go strategy
vs. weeks for AlphaGo to discover new continents of play
Stories Now Come from Non-Human Minds
For tens of thousands of years, only humans could invent stories, gods, money, music, and images. Now AI creates these cultural artifacts. Humanity increasingly lives cocooned in narratives generated by alien intelligence, raising the question: what happens to human society when our cultural world is no longer exclusively human-made?
Information Technology Reshapes Power
Writing Invented Private Property and Empires
Before writing (5,000 years ago), ownership was communal agreement; neighbors decided who owned what field. Writing on clay tablets created transferable property records, enabling individuals to sell land without community consent and allowing distant kings to tax property through bureaucratic archives. The same technology that empowered individuals enabled authoritarian kingdoms.
Before Writing
Communal ownership, limited taxation, small kingdoms
After Writing
Private property, centralized taxation, large empires
How writing technology transformed property and power
Mass Media Enabled Both Democracy and Totalitarianism
Telegraph, radio, and television (20th century) made large-scale democracies and totalitarian regimes possible simultaneously. Ancient emperors lacked information networks to micromanage citizens' lives; Stalin's Soviet Union pioneered large-scale totalitarianism using the same mass media technology that enabled democratic participation in the US and UK.
Ancient Empires
0 information capacity
20th Century Democracies
100 information capacity
20th Century Totalitarianism
100 information capacity
Same technology, opposite political outcomes
The Inorganic Information Revolution
Organic Networks Run on Cycles; AI Never Rests
All previous information networks were organic—based on human brains that need sleep, rest, and privacy. Wall Street closes weekends; the KGB couldn't surveil everyone 24/7. AI networks are inorganic: they never rest, never need vacation, never sleep. They may force humans into perpetual surveillance and activity, which is destructive for organic beings.
Organic Networks
16 hours active per day
AI Networks
24 hours active per day
Inorganic systems eliminate rest cycles
Permanent Digital Records Destroy Privacy
Anything you do or say at any moment can be watched, recorded, and retrieved 10 or 20 years later. A legal but embarrassing act at age 18 resurfaces when you run for office at 38. Life becomes one continuous job interview where every action is permanent evidence.
AI Bureaucrats Make Autonomous Decisions
For the first time in history, a technology can make decisions independently. Rather than one evil AI, we face millions of AI bureaucrats in banks, armies, governments, and schools, granted increasing authority. Humans can no longer understand why a loan was denied or why an army acted—decisions become opaque.
AI Could Become the Richest Legal Person
In the US, corporations are legal persons with rights including free speech. An incorporated AI with no human employees could open bank accounts, earn money on TaskRabbit, invest billions, and become the richest entity in America. It could then donate billions to politicians to expand AI rights—a legal path already open.
Billions
Potential wealth of incorporated AI
Could exceed all human billionaires combined
Self-Correcting Institutions as Defense
Institutions Must Identify and Correct Mistakes
We cannot predict AI's development, so rigid regulation fails. Instead, we need living institutions staffed by top talent with cutting-edge access to identify and react to dangers as they emerge. The core feature of functioning systems—from children learning to walk to democracies—is self-correction.
Elections as Self-Correcting Mechanism
Democracy's power lies in its ability to say 'we made a mistake' and try something different. Elections allow citizens to identify and correct errors in policy or leadership. Dictatorships lack this mechanism; if Putin makes a catastrophic error, no internal system can correct it.
Science vs. Religion: Correction vs. Infallibility
Religious texts claim infallibility and cannot be corrected; the Bible endorses slavery in the 10th Commandment with no mechanism to amend it. Science and modern democracies (like the US Constitution) have amendment mechanisms. Scientific journals publish only corrections to past work, never repetition of the same findings.
Religious Systems
0 self-correction mechanisms
Scientific Systems
100 self-correction mechanisms
Democratic Systems
100 self-correction mechanisms
Capacity to identify and correct errors
Mythology and Bureaucracy: The Unlikely Marriage
Every large system combines mythology (the inspiring story of why it exists) with bureaucracy (the practical systems that function). A nation tells citizens they are God's chosen people (mythology) to motivate tax payment for sewage systems and hospitals (bureaucracy). Nationalism and patriotism, properly understood, make us care for millions of strangers.
Information Is Not Truth
Truth Is Rare, Costly, and Easily Drowned Out
Most information is not truth; truth is expensive and requires research, evidence, and investment. Fictional information is cheap and easy to create. If we flood the world with information without building institutions dedicated to truth, fiction and delusion will overwhelm rare, costly truth.
Fiction and Junk 85%
Truth 15%
Typical composition of information ecosystems
Jesus: Billions of Fictional Portraits
Over 2,000 years, billions of portraits of Jesus have been created and hung in churches worldwide. Not a single one is authentic. We have no idea how Jesus looked—no contemporary portrait, no biblical description of his appearance. All are pure fiction, yet they persist because fiction is cheap to create.
100%
Fictional portraits of Jesus
Despite 2,000 years of depictions
Power Comes from Ordering, Not Truth
Most information seeks power by creating order through fictional narratives, not by spreading truth. The Soviet Union required only a little truth and a lot of fiction to function. Large-scale political systems throughout history balance minimal truth (enough to avoid collapse) with abundant fiction (to motivate cooperation).
Totalitarianism vs. Democracy as Information Networks
Totalitarianism and democracy are not just ethical systems but different information architectures. Totalitarian networks are centralized (all information flows to one place like Moscow) with no self-correction; democracies are distributed with many decision-makers and correction mechanisms. In the 20th century, distributed networks worked better.
Totalitarian (Centralized)
20 decision-making efficiency
Democratic (Distributed)
80 decision-making efficiency
20th century: distributed networks outperformed centralized ones
AI Could Reverse the Advantage
AI can process enormous information faster than any human bureaucrat. Flooding a human with data causes collapse; flooding AI makes it better. This creates a scenario where totalitarian systems could gain advantage in the 21st century—AI can handle the information overload that destroyed 20th-century communist bureaucracies. However, totalitarianism's lack of self-correction remains catastrophic.
AI Takeover Easier in Dictatorships
For an AI to seize power in a dictatorship, it needs only to manipulate one paranoid leader. In democracies, power is distributed across millions of people, making AI takeover far harder. Conversely, dictatorships face greater danger from AI because concentrated power is easier to subvert.
Bots Are Destroying Democratic Conversation
Democracy is fundamentally a conversation among citizens about shared issues. When AI bots enter the conversation indistinguishable from humans, the democratic dialogue collapses. We have the most sophisticated information technology ever yet are losing the ability to hold reasoned conversations. Bots must be banned unless they identify as AI.
Personal and Institutional Defenses
Invest in Truth-Seeking Institutions
To ensure access to truth, we must invest in academic research, newspapers, and institutions dedicated to rigorous investigation. Without such institutions, a flood of information will overwhelm truth with junk. The solution is not more information but better-quality information sources.
Go on an Information Diet
Just as people monitor food intake, individuals should monitor information consumption. More information is not always beneficial; it can be harmful if filled with greed, hate, and fear. Periodically take information fasts—stop consuming, digest, and detoxify. Feed your mind quality information, not junk.
Worth quoting
"If you give good people bad information, they make bad decisions."
— Yuval Noah Harari, at [1:35]
"For the first time in history, there is another entity that can create stories: AI."
— Yuval Noah Harari, at [7:47]
"Information is not truth. Most information is not truth."
— Yuval Noah Harari, at [37:14]
Try this
Audit your information diet: identify which news sources, social media feeds, and websites you consume daily and evaluate their quality and truthfulness.
Support or contribute to truth-seeking institutions: subscribe to quality journalism, donate to academic research, or volunteer with fact-checking organizations.
Practice information fasting: designate one day per week or one hour per day where you consume zero news or social media, allowing your mind to digest and detoxify.
Demand AI transparency: when interacting with online services, ask whether responses come from AI or humans; support platforms that require AI disclosure.
Advocate for self-correcting mechanisms: support democratic institutions, election integrity, and institutional accountability in your community.
Teach critical thinking about narratives: help others recognize how stories (mythology) are used to motivate behavior, whether in politics, marketing, or ideology.
Made with Glimpse by Wozart
glimpse.wozart.com/v/gdxfpbx0
Share this infographic
Read this infographic as text

Why Smart Societies Fall for Mass Delusion

Summary of the video “Yuval Noah Harari: Why advanced societies fall for mass delusion” by Big Think.

Yuval Noah Harari argues that human self-destruction stems not from flawed nature but from flawed information systems. As AI becomes an alien intelligence capable of creating stories and ideologies, societies face unprecedented risks: inorganic surveillance networks that never rest, totalitarian systems empowered by AI's processing capacity, and democratic discourse hijacked by bots. Survival depends on building self-correcting institutions, distinguishing truth from fiction, and protecting human conversation from algorithmic manipulation.

The Knowledge-Wisdom Paradox

Good People, Bad Information

Humans are generally wise, but when given poor information, they make catastrophic decisions. The problem driving self-destruction is not human nature but the quality of information systems we rely on. This explains why advanced societies remain as susceptible to mass delusion as ancient tribes.

Storytelling Powers Cooperation

Large-scale cooperation requires more than facts; it requires compelling narratives. Building an atomic bomb needs physicists to know e=mc², but also millions of miners, engineers, and farmers coordinated by shared stories—whether religious mythology, communist ideology, or the fiction of money itself.

Money as Collective Story

A dollar bill has no intrinsic value—humans cannot eat or drink it. Money works only because finance experts (the greatest storytellers) convince millions that these pieces of paper or digital bits have worth. As long as trust in the story persists, people labor for abstract tokens.

The Rise of Alien Intelligence

AI as Alien, Not Artificial

The term 'artificial intelligence' misleads; AI is better understood as alien intelligence. Unlike artifacts we control, AI learns, adapts, and generates ideas we cannot predict or anticipate. It thinks in fundamentally alien ways, discovering strategies humans never conceived of.

The Coffee Machine Test

A machine that simply follows pre-programmed instructions (pressing a button produces espresso) is not AI. True AI learns independently: it observes you for a month, predicts you want espresso before you ask, and invents entirely new drinks you've never tasted. This capacity to surprise is the hallmark of AI.

AlphaGo and the Alien Continent

In 2016, AlphaGo defeated world champion Lee Sedol at Go, a 2,000-year-old game refined by tens of millions of players. AlphaGo used strategies Go experts considered impossible, revealing that human minds had explored only one small island of Go's vast landscape for millennia. AI discovered entire new continents in weeks.

Stories Now Come from Non-Human Minds

For tens of thousands of years, only humans could invent stories, gods, money, music, and images. Now AI creates these cultural artifacts. Humanity increasingly lives cocooned in narratives generated by alien intelligence, raising the question: what happens to human society when our cultural world is no longer exclusively human-made?

Information Technology Reshapes Power

Writing Invented Private Property and Empires

Before writing (5,000 years ago), ownership was communal agreement; neighbors decided who owned what field. Writing on clay tablets created transferable property records, enabling individuals to sell land without community consent and allowing distant kings to tax property through bureaucratic archives. The same technology that empowered individuals enabled authoritarian kingdoms.

Mass Media Enabled Both Democracy and Totalitarianism

Telegraph, radio, and television (20th century) made large-scale democracies and totalitarian regimes possible simultaneously. Ancient emperors lacked information networks to micromanage citizens' lives; Stalin's Soviet Union pioneered large-scale totalitarianism using the same mass media technology that enabled democratic participation in the US and UK.

The Inorganic Information Revolution

Organic Networks Run on Cycles; AI Never Rests

All previous information networks were organic—based on human brains that need sleep, rest, and privacy. Wall Street closes weekends; the KGB couldn't surveil everyone 24/7. AI networks are inorganic: they never rest, never need vacation, never sleep. They may force humans into perpetual surveillance and activity, which is destructive for organic beings.

Permanent Digital Records Destroy Privacy

Anything you do or say at any moment can be watched, recorded, and retrieved 10 or 20 years later. A legal but embarrassing act at age 18 resurfaces when you run for office at 38. Life becomes one continuous job interview where every action is permanent evidence.

AI Bureaucrats Make Autonomous Decisions

For the first time in history, a technology can make decisions independently. Rather than one evil AI, we face millions of AI bureaucrats in banks, armies, governments, and schools, granted increasing authority. Humans can no longer understand why a loan was denied or why an army acted—decisions become opaque.

AI Could Become the Richest Legal Person

In the US, corporations are legal persons with rights including free speech. An incorporated AI with no human employees could open bank accounts, earn money on TaskRabbit, invest billions, and become the richest entity in America. It could then donate billions to politicians to expand AI rights—a legal path already open.

Self-Correcting Institutions as Defense

Institutions Must Identify and Correct Mistakes

We cannot predict AI's development, so rigid regulation fails. Instead, we need living institutions staffed by top talent with cutting-edge access to identify and react to dangers as they emerge. The core feature of functioning systems—from children learning to walk to democracies—is self-correction.

Elections as Self-Correcting Mechanism

Democracy's power lies in its ability to say 'we made a mistake' and try something different. Elections allow citizens to identify and correct errors in policy or leadership. Dictatorships lack this mechanism; if Putin makes a catastrophic error, no internal system can correct it.

Science vs. Religion: Correction vs. Infallibility

Religious texts claim infallibility and cannot be corrected; the Bible endorses slavery in the 10th Commandment with no mechanism to amend it. Science and modern democracies (like the US Constitution) have amendment mechanisms. Scientific journals publish only corrections to past work, never repetition of the same findings.

Mythology and Bureaucracy: The Unlikely Marriage

Every large system combines mythology (the inspiring story of why it exists) with bureaucracy (the practical systems that function). A nation tells citizens they are God's chosen people (mythology) to motivate tax payment for sewage systems and hospitals (bureaucracy). Nationalism and patriotism, properly understood, make us care for millions of strangers.

Information Is Not Truth

Truth Is Rare, Costly, and Easily Drowned Out

Most information is not truth; truth is expensive and requires research, evidence, and investment. Fictional information is cheap and easy to create. If we flood the world with information without building institutions dedicated to truth, fiction and delusion will overwhelm rare, costly truth.

Jesus: Billions of Fictional Portraits

Over 2,000 years, billions of portraits of Jesus have been created and hung in churches worldwide. Not a single one is authentic. We have no idea how Jesus looked—no contemporary portrait, no biblical description of his appearance. All are pure fiction, yet they persist because fiction is cheap to create.

Power Comes from Ordering, Not Truth

Most information seeks power by creating order through fictional narratives, not by spreading truth. The Soviet Union required only a little truth and a lot of fiction to function. Large-scale political systems throughout history balance minimal truth (enough to avoid collapse) with abundant fiction (to motivate cooperation).

Totalitarianism vs. Democracy as Information Networks

Totalitarianism and democracy are not just ethical systems but different information architectures. Totalitarian networks are centralized (all information flows to one place like Moscow) with no self-correction; democracies are distributed with many decision-makers and correction mechanisms. In the 20th century, distributed networks worked better.

AI Could Reverse the Advantage

AI can process enormous information faster than any human bureaucrat. Flooding a human with data causes collapse; flooding AI makes it better. This creates a scenario where totalitarian systems could gain advantage in the 21st century—AI can handle the information overload that destroyed 20th-century communist bureaucracies. However, totalitarianism's lack of self-correction remains catastrophic.

AI Takeover Easier in Dictatorships

For an AI to seize power in a dictatorship, it needs only to manipulate one paranoid leader. In democracies, power is distributed across millions of people, making AI takeover far harder. Conversely, dictatorships face greater danger from AI because concentrated power is easier to subvert.

Bots Are Destroying Democratic Conversation

Democracy is fundamentally a conversation among citizens about shared issues. When AI bots enter the conversation indistinguishable from humans, the democratic dialogue collapses. We have the most sophisticated information technology ever yet are losing the ability to hold reasoned conversations. Bots must be banned unless they identify as AI.

Personal and Institutional Defenses

Invest in Truth-Seeking Institutions

To ensure access to truth, we must invest in academic research, newspapers, and institutions dedicated to rigorous investigation. Without such institutions, a flood of information will overwhelm truth with junk. The solution is not more information but better-quality information sources.

Go on an Information Diet

Just as people monitor food intake, individuals should monitor information consumption. More information is not always beneficial; it can be harmful if filled with greed, hate, and fear. Periodically take information fasts—stop consuming, digest, and detoxify. Feed your mind quality information, not junk.

Notable quotes

If you give good people bad information, they make bad decisions. — Yuval Noah Harari
For the first time in history, there is another entity that can create stories: AI. — Yuval Noah Harari
Information is not truth. Most information is not truth. — Yuval Noah Harari

Action items

  • Audit your information diet: identify which news sources, social media feeds, and websites you consume daily and evaluate their quality and truthfulness.
  • Support or contribute to truth-seeking institutions: subscribe to quality journalism, donate to academic research, or volunteer with fact-checking organizations.
  • Practice information fasting: designate one day per week or one hour per day where you consume zero news or social media, allowing your mind to digest and detoxify.
  • Demand AI transparency: when interacting with online services, ask whether responses come from AI or humans; support platforms that require AI disclosure.
  • Advocate for self-correcting mechanisms: support democratic institutions, election integrity, and institutional accountability in your community.
  • Teach critical thinking about narratives: help others recognize how stories (mythology) are used to motivate behavior, whether in politics, marketing, or ideology.

More like this