Getting Smart About Global Catastrophes

by | 16 March 2015

View in Medium

This article stresses the importance of global catastrophic risks, and how understanding these risks will be the key to their reduction.

The article begins as follows:

Global catastrophes are events so large — global warming, nuclear war, pandemics, and emerging technologies such as artificial intelligence and synthetic biology — that they threaten the entire future of human civilization If we fail to we avoid a global catastrophe, nothing else matters. Therefore, preventing a global catastrophe must be a top priority for society today. We should all try as hard as we can on this, but it’s not enough to try. To succeed, we must be smart.

We need to be smart because some actions are a lot more effective than others at confronting global catastrophes. We should not waste our time on inefficient, ineffective little efforts when we could be going big. But how to go big can be a subtle endeavor. That means we need to invest in — and listen to — practical research that helps us confront global catastrophes more effectively.

 Smart action on global catastrophes does two things well. First, it makes large reductions in the risk of global catastrophe. Second, it is easy. The larger the risk reduction, and the easier the action is to do, the smarter it is.

The remainder of the article is available in Medium.

Image credit: US Air Force


This blog post was published on 28 July 2020 as part of a website overhaul and backdated to reflect the time of the publication of the work referenced here.

Author

Recent Publications

Climate Change, Uncertainty, and Global Catastrophic Risk

Climate Change, Uncertainty, and Global Catastrophic Risk

Is climate change a global catastrophic risk? This paper, published in the journal Futures, addresses the question by examining the definition of global catastrophic risk and by comparing climate change to another severe global risk, nuclear winter. The paper concludes that yes, climate change is a global catastrophic risk, and potentially a significant one.

Assessing the Risk of Takeover Catastrophe from Large Language Models

Assessing the Risk of Takeover Catastrophe from Large Language Models

For over 50 years, experts have worried about the risk of AI taking over the world and killing everyone. The concern had always been about hypothetical future AI systems—until recent LLMs emerged. This paper, published in the journal Risk Analysis, assesses how close LLMs are to having the capabilities needed to cause takeover catastrophe.

On the Intrinsic Value of Diversity

On the Intrinsic Value of Diversity

Diversity is a major ethics concept, but it is remarkably understudied. This paper, published in the journal Inquiry, presents a foundational study of the ethics of diversity. It adapts ideas about biodiversity and sociodiversity to the overall category of diversity. It also presents three new thought experiments, with implications for AI ethics.

Climate Change, Uncertainty, and Global Catastrophic Risk

Climate Change, Uncertainty, and Global Catastrophic Risk

Is climate change a global catastrophic risk? This paper, published in the journal Futures, addresses the question by examining the definition of global catastrophic risk and by comparing climate change to another severe global risk, nuclear winter. The paper concludes that yes, climate change is a global catastrophic risk, and potentially a significant one.

Assessing the Risk of Takeover Catastrophe from Large Language Models

Assessing the Risk of Takeover Catastrophe from Large Language Models

For over 50 years, experts have worried about the risk of AI taking over the world and killing everyone. The concern had always been about hypothetical future AI systems—until recent LLMs emerged. This paper, published in the journal Risk Analysis, assesses how close LLMs are to having the capabilities needed to cause takeover catastrophe.

On the Intrinsic Value of Diversity

On the Intrinsic Value of Diversity

Diversity is a major ethics concept, but it is remarkably understudied. This paper, published in the journal Inquiry, presents a foundational study of the ethics of diversity. It adapts ideas about biodiversity and sociodiversity to the overall category of diversity. It also presents three new thought experiments, with implications for AI ethics.