Humanity faces a small but non-trivial chance of events that could permanently damage or end our long-term potential. Understanding these existential risks and acting to reduce them may be one of the most important projects of our time.
What Are Existential Risks and Why They Matter
Researchers define an existential risk as a threat that could either cause the extinction of humanity or permanently and drastically curtail its long-term potential. These are a subset of global catastrophic risks: not only would the impact be worldwide, it would also be effectively irreversible.
Key features of existential risks include:
- Pan-generational scale – they affect not only people alive today but all future generations.
- Terminal outcomes – they involve extinction or permanent loss of civilisation’s capacity to flourish.
- Massive expected impact – even if the probability is low, the potential loss (measured in future lives or well-being) is astronomically large.
Because the stakes involve the entire future of intelligent life originating on Earth, ethicists like Nick Bostrom and Toby Ord argue that reducing these risks can dominate other causes in terms of expected moral importance.
Major Sources of Existential Risk
Different organisations classify existential risks slightly differently, but many converge on a core set of threat areas.
| Risk Category | Illustrative Examples | Why It Could Be Existential |
|---|---|---|
| Nuclear conflict | Full-scale nuclear war between major powers | Immediate mass casualties plus possible nuclear winter and long-term societal collapse. |
| Pandemics & bio-risks | Engineered pathogens, accidental lab releases | Highly lethal, transmissible pandemics could overwhelm global health systems and cause lasting breakdown. |
| Advanced AI | Misaligned artificial general intelligence | Superhuman systems not aligned with human values could gain decisive power and permanently constrain humanity’s future. |
| Climate & ecological tipping points | Runaway warming, ecosystem collapse | Most climate scenarios are non-existential, but extreme or cascading failures could severely undermine civilisation’s stability. |
| Natural cosmic events | Large asteroid impact, supervolcanic eruption | Low-frequency events capable of global devastation and long-term disruption. |
Principles for Prioritising Existential Risk Reduction
Given limited resources, we cannot tackle every risk at once. Several widely-used principles help guide prioritisation:
- Scale – existential risks score maximally on scale by definition, because they affect all future generations.
- Neglectedness – some critical risks, particularly from emerging technologies, receive far less attention and funding than their importance suggests.
- Tractability – we should focus where additional effort can meaningfully reduce risk, for example by influencing policy, safety standards, or research agendas.
In practice, this often means concentrating on a small number of high-stakes, relatively neglected risks, especially those driven by human technology where interventions are plausible.
Strategies for Reducing Existential Risk
Existential risk reduction is a multi-level project involving individuals, institutions, and international governance. The following strategies provide a practical high-level roadmap.
1. Improve Early Detection and Monitoring
Many global threats escalate from small signals. Building systems that detect and interpret these signals early can greatly expand our options.
- Scientific surveillance
Enhancing monitoring for asteroids, emerging infectious diseases, unusual biosurveillance signals, and systemic cyber vulnerabilities helps identify crises before they become unmanageable. - Risk modelling and scenario analysis
Interdisciplinary teams can map plausible pathways to catastrophe and identify key early warning indicators. - Information-sharing platforms
Trusted channels among governments, labs, and international organisations allow rapid dissemination of critical risk information, as seen in global health reporting frameworks.
2. Strengthen Global Governance and Cooperation
Existential risks are inherently global. No country can fully protect itself in isolation.
- International treaties and norms
Arms control arrangements, non-proliferation treaties, and agreements governing dual-use technologies can limit the most dangerous capabilities and encourage transparency. - Crisis communication channels
Maintaining reliable, redundant communication links between major powers reduces the chance that accidents or misinterpretations escalate into full-scale nuclear or cyber conflicts. - Specialised global bodies
Institutions analogous to the World Health Organization for biosecurity, or dedicated AI governance forums, can coordinate standards and responses at the global level.
3. Make Dangerous Technologies Safer by Design
Many of the gravest risks emerge from powerful technologies developed for beneficial purposes. Safety must be built into their design, deployment, and governance from the outset.
- Safety research and technical standards
For advanced AI, this includes work on alignment, robustness, interpretability, and controllability, with an emphasis on ensuring that increasingly capable systems remain under meaningful human direction. - Secure biological research
Laboratory biosafety standards, dual-use review processes, and genomic surveillance can reduce the chance that biological research contributes to catastrophic pandemics. - Engineering for fail-safes
Critical infrastructure and cyber-physical systems (for example, power grids and nuclear facilities) should be designed to fail gracefully rather than catastrophically in the face of shocks.
4. Reduce the Risk of Great-Power Conflict
Several existential threats, especially nuclear war and destabilising cyber operations, are tightly linked to geopolitical tensions.
- Arms control and de-escalation
Negotiated reductions in nuclear arsenals, limits on destabilising weapons systems, and verification measures lower the chance of accidental or intentional global war. - Diplomatic confidence-building
Joint military exercises, hotlines, and transparent doctrine discussions can reduce misunderstanding and miscalculation. - Norms against first use and targeting population centres
Strengthening taboos on certain uses of nuclear and biological weapons can help maintain longstanding restraints.
5. Build Civilisational Resilience and Recovery Capacity
Not all extreme shocks can be prevented. Improving our ability to withstand and recover from catastrophe can turn some existential trajectories into merely severe but survivable crises.
- Robust food systems
Diversifying food production, stockpiling key inputs, and researching alternative foods (for example, low-light crops, single-cell proteins) could sustain populations through scenarios like nuclear winter or supervolcanic eruptions. - Redundant infrastructure
Backup power, communication, and data storage systems can preserve knowledge and coordination capacity during prolonged disruptions. - Institutional continuity planning
Governments and critical organisations can create plans to maintain essential functions even under extreme stress.
6. Invest in Research, Forecasting, and Field-Building
Many uncertainties remain about the likelihood and dynamics of various existential risks. Targeted research can reduce uncertainty and uncover high-leverage interventions.
- Academic and policy research
Dedicated centres now study existential and global catastrophic risks, combining insights from philosophy, economics, political science, computer science, and more. - Data collection and forecasting
Systematic expert surveys, probabilistic forecasting platforms, and scenario workshops can help prioritise which risks to address and how. - Community and capacity-building
Supporting training programmes, scholarships, and early-career fellowships grows the pool of people with relevant expertise.
How Individuals Can Contribute
Existential risk reduction is not just a matter for governments and large institutions. Individuals can make substantial contributions over a lifetime.
1. Career Choice and Skill Development
For many people, the most significant lever is their career. Working directly on high-priority risk areas or supporting them indirectly can have outsized impact.
- Directly impactful roles
These may include technical research (for example, AI safety, biosecurity), policy work in relevant agencies, or roles at organisations focused on catastrophic risk mitigation. - Enabling roles
Fundraising, operations, communications, law, and management can all be essential to making specialist teams effective. - Skill-building pathways
Early-career stages are often best spent acquiring general analytical, technical, or policy skills that can later be applied to priority areas.
2. Philanthropy and Resource Allocation
Well-directed funding can accelerate promising work, especially in neglected domains.
- Supporting specialised organisations
Many institutes, think tanks, and non-profits focus specifically on AI safety, biosecurity, nuclear risk reduction, and global governance. - Backing research and talent development
Grants for researchers, scholarships, and training programmes can have long time horizons and leverage future work. - Flexible, patient capital
Long-term funding commitments allow organisations to tackle structurally difficult problems without short-term pressure.
3. Advocacy, Norm-Shaping, and Public Discourse
Public understanding and elite norms shape policy choices, regulatory frameworks, and industry behaviour.
- Responsible communication
Writers, educators, and public intellectuals can present existential risk issues in ways that are accurate, proportionate, and avoid sensationalism. - Stakeholder engagement
Professionals in technology, health, defence, and finance can raise risk concerns within their own sectors and push for higher safety standards. - Democratic input
In many countries, citizens can provide feedback on policy proposals, support candidates prioritising long-term safety, and encourage parliamentary scrutiny of emerging risks.
Balancing Near-Term Needs and Long-Term Safety
Some critics worry that focusing on existential risk may distract from pressing current issues like poverty, inequality, or ordinary public health concerns. In practice, there are several ways to align near-term and long-term goals.
- Co-benefits
Strengthening pandemic preparedness protects both present and future populations. Improvements to health systems, surveillance, and vaccination capacity have well-documented short-term benefits. - Institutional quality
Improving governance, transparency, and rule of law tends to reduce many kinds of risk simultaneously, including corruption, conflict, and technological misuse. - Ethical inclusiveness
Policies that explicitly consider the interests of future generations can coexist with efforts to improve current well-being, for example through climate mitigation measures that also reduce pollution and energy costs.
Common Misconceptions About Existential Risk
Several misunderstandings can impede constructive work on existential risks.
- “The probabilities are too speculative to act on.”
Although precise probabilities are uncertain, multiple experts have argued that reasonable estimates for total existential risk this century are high enough that even small risk reductions are extremely valuable in expectation. - “Natural risks dominate, so we can’t do much.”
Evidence suggests that near-term existential risk is dominated by anthropogenic (human-made) sources, particularly advanced technologies. These are precisely the areas where deliberate action can matter most. - “Thinking about the far future is a luxury.”
Because an existential catastrophe would eliminate the possibility of solving future problems, safeguarding the long-term future can be seen as a way of protecting the space in which other moral projects occur.
Frequently Asked Questions (FAQs)
Q: How likely is an existential catastrophe in the next century?
A: There is no consensus, and estimates rely on expert judgment rather than precise data. Some scholars argue that the cumulative probability over this century may be on the order of 10–20%, though these figures remain highly uncertain and are intended mainly to emphasise that the risk is not negligible.
Q: Which existential risks are considered most pressing right now?
A: Many experts highlight advanced AI, engineered pandemics, and nuclear war as particularly urgent, given their combination of destructive potential, increasing capabilities, and current gaps in governance and safety research.
Q: Isn’t climate change already an existential risk?
A: Mainstream scientific assessments describe climate change as a severe global challenge with catastrophic regional and global impacts, but most scenarios do not reach true existential levels. However, extreme warming pathways, feedback loops, or interactions with other stresses could contribute to existential trajectories, so strong mitigation and adaptation efforts are still crucial.
Q: What background should I have to work on existential risk?
A: People contribute from many fields: computer science, bioengineering, public health, international relations, law, economics, philosophy, and more. Strong analytical skills, quantitative reasoning, and familiarity with risk analysis are widely useful. Many roles also value policy experience or domain-specific technical expertise.
Q: How can I stay informed without becoming overwhelmed?
A: Focusing on high-quality sources, reading summaries from reputable research centres, and following a small number of expert commentators can provide a solid foundation. It can help to treat existential risk work as a long-term project, pacing your engagement and connecting with communities that take psychological resilience seriously.
References
- Global catastrophic risk — Wikipedia summary drawing on academic literature (used for definitional background; primary sources cited separately). Accessed 2024-10-01. https://en.wikipedia.org/wiki/Global_catastrophic_risk
- Risks — Existential Risk Observatory. 2023-05-10. https://www.existentialriskobservatory.org/risks/
- Existential Risk Prevention as Global Priority — Nick Bostrom, Journal of Evolution and Technology. 2013-09-01. https://existential-risk.com/concept
- Existential risk — LessWrong Wiki (summarises work by Nick Bostrom and others). Accessed 2024-10-01. https://www.lesswrong.com/w/existential-risk
- Existential Risks: Human Extinction Scenarios and Related Hazards — Nick Bostrom, Journal of Evolution and Technology. 2002-03-01. https://nickbostrom.com/existential/risks.pdf
- Existential Risks — Globaïa. 2022-07-15. https://globaia.org/risks
- Existential Risk — Future of Life Institute. 2023-11-20. https://futureoflife.org/existential-risk/existential-risk/
