The Future of Humanity Institute (FHI) at the University of Oxford was one of the first academic centres to treat the long-term future of humanity as a serious subject of rigorous research. It helped popularise ideas such as existential risk, longtermism, and AI alignment, and influenced governments, philanthropists, and research agendas worldwide. Although the institute closed in 2024, its ideas and alumni continue to shape debates about how to protect and improve humanity’s future.
From Experimental Project to Global Influence
FHI was founded in 2005 within Oxford’s Faculty of Philosophy and supported by the Oxford Martin School. Its founding director, philosopher Nick Bostrom, assembled researchers from philosophy, computer science, mathematics, and economics to work on questions that were both highly important and unusually neglected.
- Institutional home: University of Oxford, connected to the Faculty of Philosophy and the Oxford Martin School.
- Operating years: 2005–2024, spanning 19 years of research.
- Multidisciplinary approach: Combined formal modelling, philosophy, social science, and technical expertise.
- Focus: Long-term global risks and opportunities, especially from transformative technologies such as advanced AI.
Over time, FHI developed into a widely recognised centre for research on long-term global priorities, influencing emerging academic fields and public policy discussions.
Core Mission: Studying Humanity’s Long-Term Trajectory
FHI’s mission was to clarify the choices that could shape the far future of humanity, especially where the stakes appeared extremely large and the existing research was sparse.
Its work tended to emphasise topics that were:
- Crucially important for humanity’s long-run prospects (e.g., existential risks, AI safety).
- Neglected in mainstream academia and policy.
- Tractable enough that careful analysis might produce useful insights or guidance.
FHI researchers used tools from probability theory, decision theory, ethics, and computer science to analyse how current decisions might affect humanity’s survival and flourishing over very long timescales.
Key Concepts Shaped by the Institute
Many ideas that are now common in discussions of global priorities were either developed, formalised, or popularised by FHI researchers.
| Concept | What it concerns | Why it matters |
|---|---|---|
| Existential risk | Risks that could permanently curtail humanity’s potential or cause extinction. | Even small probabilities can matter enormously if the long-term stakes are vast. |
| Longtermism | The view that positively influencing the long-run future is a key moral priority. | Encourages focusing on interventions with long-lasting, large-scale impact. |
| AI alignment & governance | Ensuring powerful AI systems are safe, aligned with human values, and well regulated. | Addresses the risk that advanced AI could cause catastrophic or irreversible harm. |
| Global catastrophic risks | Events that could kill a large fraction of the world’s population or severely disrupt civilisation. | Motivates policy and preparedness for pandemics, engineered pathogens, and more. |
These ideas now appear not only in academic work but also in policy debates, think-tank reports, and major philanthropic strategies.
Major Research Themes
1. Existential and Global Catastrophic Risks
FHI examined a broad portfolio of dangers that could have permanent or civilization-scale impacts, including runaway AI, engineered pandemics, nuclear war, and unaligned transformative technologies. This work contributed to broader scholarly and policy attention to existential risk as a category distinct from ordinary global problems.
- Clarifying the definition and taxonomy of catastrophic and existential risks.
- Assessing how technological change can both create and mitigate such risks.
- Exploring how to prioritise among different threats under deep uncertainty.
2. Artificial Intelligence Safety and Governance
Some of FHI’s most influential work concerned the long-term societal impact of advanced AI systems. This included both technical questions about alignment and higher-level questions about governance, incentives, and institutional design.
- Analysing scenarios in which AI capabilities advance very rapidly.
- Studying how misaligned AI could pose global security risks, including existential ones.
- Exploring governance mechanisms, standards, and international coordination to reduce AI-related risks.
These lines of inquiry helped shape the modern field of AI safety and contributed to growing interest in AI governance in governments and major AI labs.
3. Ethics, Value Theory, and Moral Uncertainty
FHI researchers investigated how to make decisions when we are unsure which moral theory is correct, or how to weigh the interests of present versus future people. This work underpinned much of the institute’s focus on long-term outcomes, and helped support the ethical foundations of effective altruism and longtermism.
- Analysing population ethics and how to compare different possible futures.
- Developing frameworks for decision-making under moral uncertainty.
- Reflecting on how current policy choices might echo over centuries or millennia.
4. Global Priorities and Effective Altruism
FHI worked closely with organisations linked to the effective altruism (EA) movement, sharing office space and collaborating on projects that aimed to translate research into impact. The institute’s work helped shape the view that directing resources toward reducing existential risk and improving the long-term future could be one of the most effective ways to do good.
- Identifying cause areas where impact per unit of resources may be especially high.
- Supporting the idea that some of the world’s most important problems are also the least studied.
- Helping to train and mentor researchers who then spread these ideas to other institutions.
Institutional Impact and Ecosystem Building
Beyond its direct research output, FHI played a role as a “greenhouse” for new fields and organisations. Researchers often explored unfashionable topics until they gained enough intellectual traction to flourish more widely.
FHI contributed to or influenced the growth of:
- Dedicated centres on existential risk and global priorities at other universities.
- Non-profit organisations focused on AI safety, biosecurity, and global priorities research.
- Longtermist and effective altruist communities of practice worldwide.
By the time of its closure, many of the topics once seen as fringe at FHI were being pursued in government agencies, leading AI labs, and major philanthropic foundations.
Closure and Controversies
Despite its influence, FHI faced increasing institutional challenges inside the University of Oxford. The Faculty of Philosophy reportedly froze fundraising and hiring from 2020 onward, and the contracts of remaining staff were not renewed, leading to the institute’s closure in April 2024.
Public commentary has highlighted several sources of tension:
- Academic politics: Disagreements over priorities, governance, and the place of unconventional research agendas within traditional faculties.
- Philosophical criticism: Critics of longtermism and effective altruism have argued that focusing heavily on speculative future risks can divert attention from urgent present-day issues such as poverty or climate change.
- Concerns about elitism and democracy: Some commentators worry that longtermist thinking could justify technocratic or authoritarian approaches to policy if mishandled.
Supporters, by contrast, emphasise that FHI brought rigorous attention to risks that, if neglected, could have catastrophic or irreversible consequences, and that balancing present and future priorities is itself a serious ethical challenge.
Why FHI Matters for Future Generations
The closure of FHI does not mark the end of research on existential risk or longtermism. Many of its alumni now work at other universities, AI labs, think tanks, and non-profits, continuing similar lines of inquiry. However, its history highlights several broader lessons for those who care about humanity’s long-term future.
Lesson 1: Interdisciplinary Work Is Essential but Fragile
Studying the long-term future requires integrating insights from computer science, ethics, economics, political science, and more. FHI showed that such integration is possible and valuable, but also that it can sit uneasily within traditional disciplinary structures.
Lesson 2: Long-Term Thinking Must Engage with Present Concerns
Research on very long-run futures can appear abstract or disconnected from everyday problems. Building legitimacy may require clearer links between long-term risk reduction and near-term benefits, such as improved biosecurity surveillance, safer AI deployment standards, or more resilient institutions.
Lesson 3: Institutional Design Matters for Radical Research
FHI’s trajectory raises questions about what kinds of institutions are best suited to host boundary-pushing research on existential risk. Some argue that future efforts might need:
- Stronger governance structures that maintain academic independence while engaging constructively with critics.
- Diversified funding to reduce vulnerability to any single source of support.
- Deliberate efforts to include perspectives from the Global South, social movements, and future generations in agenda-setting.
How Individuals Can Contribute to This Work
Even though FHI itself has closed, there are many ways for researchers, policymakers, and concerned citizens to engage with its core questions.
- Research careers: Pursue work in AI safety, biosecurity, global catastrophic risk analysis, or global priorities research at universities and think tanks.
- Policy and governance: Support evidence-based approaches to AI regulation, pandemic preparedness, and nuclear risk reduction in government or international organisations.
- Philanthropy and funding: Direct resources toward high-quality organisations working on existential risk reduction and longtermist priorities.
- Public discourse: Foster nuanced debate about how to balance present-day needs with obligations to future people.
Frequently Asked Questions (FAQs)
Q1: What was the Future of Humanity Institute?
The Future of Humanity Institute was a multidisciplinary research centre at the University of Oxford that studied big-picture questions about humanity’s long-term future, especially existential risks and transformative technologies such as advanced AI.
Q2: Why did the institute close?
According to public reports, the Faculty of Philosophy imposed restrictions on fundraising and hiring from 2020 and later chose not to renew the contracts of remaining staff, leading to the institute’s closure in April 2024. Commentators also point to tensions over its research agenda and links to effective altruism and longtermism.
Q3: Did FHI only focus on artificial intelligence?
No. While advanced AI became a major focus, FHI also worked on biosecurity, global catastrophic risks more broadly, ethics and population theory, forecasting and prediction methods, and the philosophical foundations of longtermism and effective altruism.
Q4: How did FHI relate to the effective altruism movement?
FHI collaborated closely with organisations in the effective altruism community and helped shape the idea that reducing existential risk and improving the long-run future can be among the most impactful ways to use resources.
Q5: What is the institute’s legacy today?
FHI’s legacy includes pioneering research on existential risk, helping to found and shape fields such as AI safety and global priorities research, and training a network of researchers who continue similar work across academia, industry, and the non-profit sector.
References
- Future of Humanity Institute (2005–2024) — Future of Humanity Institute, University of Oxford. 2024-04-16. https://www.futureofhumanityinstitute.org
- Future of Humanity Institute — Oxford Martin School, University of Oxford. 2022-07-01. https://www.oxfordmartin.ox.ac.uk/future-humanity
- The Future of Humanity Institute, University of Oxford — Idealist.org (organisational profile). 2021-06-01. https://www.idealist.org/en/nonprofit/2f31af403f374367a45ef603e06d18ce-the-future-of-humanity-institute-university-of-oxford-oxford
- Future of Humanity Institute — Effective Altruism Forum (topic overview). 2024-05-01. https://forum.effectivealtruism.org/topics/future-of-humanity-institute
- The University of Oxford has closed the Future of Humanity Institute — Bioethics Observatory – Institute of Life Sciences, Catholic University of Valencia. 2024-05-31. https://bioethicsobservatory.org/2024/05/the-university-of-oxford-has-closed-the-future-of-humanity-institute/46366/
- Looking Back at the Future of Humanity Institute — Asterisk Magazine. 2024-06-01. https://asteriskmag.com/issues/08/looking-back-at-the-future-of-humanity-institute
- Does the world need another Future of Humanity Institute? — Future of Being Human Initiative, Arizona State University. 2024-06-10. https://www.futureofbeinghuman.com/p/beyond-the-future-of-humanity-institute
Medha Deb is an editor with a master's degree in Applied Linguistics from the University of Hyderabad. She believes that her qualification has helped her develop a deep understanding of language and its application in various contexts. Medha specializes in the areas of beauty, health, sports, and wellness and is committed to ensuring that the content on the website is…