The Challenge of Analyzing Global Catastrophic Risks

by | 29 July 2019

Download Preprint PDF

The quantification of global catastrophic risks in terms of their probabilities and severities is difficult, but it is important for many decisions. Likewise, the fields of risk and decision analysis have much to offer the study of global catastrophic risk. This short paper summarizes the challenge of quantitatively analyzing global catastrophic risks. I was invited by the Decision Analysis Society to write this for their publication Decision Analysis Today.

As the paper explains, the quantification of global catastrophic risks is not always necessary. Sometimes, clear decisions can be made without it. The decision to turn the lights off when we leave the room is one example. Quantification can be more important when there are tradeoffs to be evaluated or scarce resources to be allocated. The paper describes three examples: nuclear disarmament, nuclear power, and the launch of advanced AI.

Another challenge is institutional. Many risk and decision analyses are commissioned by decision-makers who value this input. In contrast, analysis of global catastrophic risk is often motivated by an intrinsic concern for the risk. As a consequence, it can lack a built-in audience. The paper describes two approaches to handling this situation: promoting intrinsic concern for global catastrophic risk and seeking synergies between global catastrophic risk and whatever issues decision-makers care about.

The paper relates to GCRI’s ongoing work on risk and decision analysis and solutions and strategy.

The Decision Analysis Society is one of the leading academic and professional societies for risk and decision analysis, and it is an honor to have the opportunity to discuss global catastrophic risk with its membership. (Another leading society is the Society for Risk Analysis, which GCRI is also active in.)

Academic citation:
Baum, Seth D., 2019. The challenge of analyzing global catastrophic risks. Decision Analysis Today, vol. 38, no. 1 (July), pages 20-24.

Download Preprint PDFDownload Decision Analysis Today full issue PDF

Image credit: Adrian Scottow

Author

Recent Publications

Climate Change, Uncertainty, and Global Catastrophic Risk

Climate Change, Uncertainty, and Global Catastrophic Risk

Is climate change a global catastrophic risk? This paper, published in the journal Futures, addresses the question by examining the definition of global catastrophic risk and by comparing climate change to another severe global risk, nuclear winter. The paper concludes that yes, climate change is a global catastrophic risk, and potentially a significant one.

Assessing the Risk of Takeover Catastrophe from Large Language Models

Assessing the Risk of Takeover Catastrophe from Large Language Models

For over 50 years, experts have worried about the risk of AI taking over the world and killing everyone. The concern had always been about hypothetical future AI systems—until recent LLMs emerged. This paper, published in the journal Risk Analysis, assesses how close LLMs are to having the capabilities needed to cause takeover catastrophe.

On the Intrinsic Value of Diversity

On the Intrinsic Value of Diversity

Diversity is a major ethics concept, but it is remarkably understudied. This paper, published in the journal Inquiry, presents a foundational study of the ethics of diversity. It adapts ideas about biodiversity and sociodiversity to the overall category of diversity. It also presents three new thought experiments, with implications for AI ethics.

Climate Change, Uncertainty, and Global Catastrophic Risk

Climate Change, Uncertainty, and Global Catastrophic Risk

Is climate change a global catastrophic risk? This paper, published in the journal Futures, addresses the question by examining the definition of global catastrophic risk and by comparing climate change to another severe global risk, nuclear winter. The paper concludes that yes, climate change is a global catastrophic risk, and potentially a significant one.

Assessing the Risk of Takeover Catastrophe from Large Language Models

Assessing the Risk of Takeover Catastrophe from Large Language Models

For over 50 years, experts have worried about the risk of AI taking over the world and killing everyone. The concern had always been about hypothetical future AI systems—until recent LLMs emerged. This paper, published in the journal Risk Analysis, assesses how close LLMs are to having the capabilities needed to cause takeover catastrophe.

On the Intrinsic Value of Diversity

On the Intrinsic Value of Diversity

Diversity is a major ethics concept, but it is remarkably understudied. This paper, published in the journal Inquiry, presents a foundational study of the ethics of diversity. It adapts ideas about biodiversity and sociodiversity to the overall category of diversity. It also presents three new thought experiments, with implications for AI ethics.