Assessing Global Catastrophic Risk

by | 1 November 2017

Download Preprint PDF

This article, published in Sleepwalking to Armageddon: The 21st Century Threat of Nuclear Annihilation, discusses the importance of analyzing global catastrophic risks in order to understand and reduce them.

The article begins as follows:

Imagine living here on Earth five billion years from now – toward the end of when it is physically possible to live on Earth. The Sun gradually gets warmer, and over billions of years, eventually it becomes too hot for life as we know it to survive here on Earth. But five billion years from now, humans might exist not only on Earth; we might have spread across the stars, forming an immense galactic civilization that dwarfs anything we could have on Earth.

What besides the sun could jeopardize the future of the human race? Because humans are currently confined to earth, major global catastrophes are events so severe that they could make the difference for that entire great, beautiful future of the species. A global catastrophe could ruin it all, depriving countless members of countless future generations the chance ever to live. So, will we succeed at avoiding catastrophe, so that this great, beautiful future can occur? Or will we fail, ruining it all?

When we talk about the catastrophic risk of nuclear war, the biggest thing that could be at stake is no less than the entire fate of human civilization.

The remainder of the article is available in PDF archive.


This blog post was published on 01 November 2017 as part of a website overhaul and backdated to reflect the time of the publication of the work referenced here.

Author

Recent Publications

Climate Change, Uncertainty, and Global Catastrophic Risk

Climate Change, Uncertainty, and Global Catastrophic Risk

Is climate change a global catastrophic risk? This paper, published in the journal Futures, addresses the question by examining the definition of global catastrophic risk and by comparing climate change to another severe global risk, nuclear winter. The paper concludes that yes, climate change is a global catastrophic risk, and potentially a significant one.

Assessing the Risk of Takeover Catastrophe from Large Language Models

Assessing the Risk of Takeover Catastrophe from Large Language Models

For over 50 years, experts have worried about the risk of AI taking over the world and killing everyone. The concern had always been about hypothetical future AI systems—until recent LLMs emerged. This paper, published in the journal Risk Analysis, assesses how close LLMs are to having the capabilities needed to cause takeover catastrophe.

On the Intrinsic Value of Diversity

On the Intrinsic Value of Diversity

Diversity is a major ethics concept, but it is remarkably understudied. This paper, published in the journal Inquiry, presents a foundational study of the ethics of diversity. It adapts ideas about biodiversity and sociodiversity to the overall category of diversity. It also presents three new thought experiments, with implications for AI ethics.

Climate Change, Uncertainty, and Global Catastrophic Risk

Climate Change, Uncertainty, and Global Catastrophic Risk

Is climate change a global catastrophic risk? This paper, published in the journal Futures, addresses the question by examining the definition of global catastrophic risk and by comparing climate change to another severe global risk, nuclear winter. The paper concludes that yes, climate change is a global catastrophic risk, and potentially a significant one.

Assessing the Risk of Takeover Catastrophe from Large Language Models

Assessing the Risk of Takeover Catastrophe from Large Language Models

For over 50 years, experts have worried about the risk of AI taking over the world and killing everyone. The concern had always been about hypothetical future AI systems—until recent LLMs emerged. This paper, published in the journal Risk Analysis, assesses how close LLMs are to having the capabilities needed to cause takeover catastrophe.

On the Intrinsic Value of Diversity

On the Intrinsic Value of Diversity

Diversity is a major ethics concept, but it is remarkably understudied. This paper, published in the journal Inquiry, presents a foundational study of the ethics of diversity. It adapts ideas about biodiversity and sociodiversity to the overall category of diversity. It also presents three new thought experiments, with implications for AI ethics.