April Newsletter

by | 3 April 2017

Centre for the Study of Existential Risk

GCRI executive director Seth Baum has joined the Cambridge Centre for the Study of Existential Risk (CSER) as a research affiliate. The affiliation is in recognition of the contribution Baum has made to CSER.

Colloquium on Catastrophic and Existential Threats

GCRI executive director Seth Baum gave a talk titled “Integrated Assessment of Global Catastrophic Risk” and GCRI director of research Tony Barrett gave a talk titled “Towards Integrated, Comprehensive Assessment of Global Catastrophic Risks to Inform Risk Reduction” at the Garrick Institute for the Risk Science’s first Colloquium On Catastrophic And Existential Threats, March 27-29 in Los Angeles.

Artificial Intelligence

GCRI Associate Roman Yampolskiy gave a talk on the “Future of Intelligent Machines” at the Retreat on Artificial Intelligence, Rochester Institute of Technology, February 17. Yampolskiy gave a separate talk on AI safety at Beer with a Scientist in Louisville, KY. Yampolskiy was interviewed for a piece produced by the Beneficial AI 2017 conference about the conference and the Asilomar AI Principles that came out of the conference.

GCRI Associate Roman Yampolskiy is also looking for submissions of chapters for a forthcoming book, Artificial Intelligence Safety and Security. Submissions are due before July 25, 2017.

Popular Media

GCRI Director of Communications Robert de Neufville was interviewed about global catastrophes that threaten human civilization on the podcast Here’s How I Think This Works.

Author

Recent Publications

Climate Change, Uncertainty, and Global Catastrophic Risk

Climate Change, Uncertainty, and Global Catastrophic Risk

Is climate change a global catastrophic risk? This paper, published in the journal Futures, addresses the question by examining the definition of global catastrophic risk and by comparing climate change to another severe global risk, nuclear winter. The paper concludes that yes, climate change is a global catastrophic risk, and potentially a significant one.

Assessing the Risk of Takeover Catastrophe from Large Language Models

Assessing the Risk of Takeover Catastrophe from Large Language Models

For over 50 years, experts have worried about the risk of AI taking over the world and killing everyone. The concern had always been about hypothetical future AI systems—until recent LLMs emerged. This paper, published in the journal Risk Analysis, assesses how close LLMs are to having the capabilities needed to cause takeover catastrophe.

On the Intrinsic Value of Diversity

On the Intrinsic Value of Diversity

Diversity is a major ethics concept, but it is remarkably understudied. This paper, published in the journal Inquiry, presents a foundational study of the ethics of diversity. It adapts ideas about biodiversity and sociodiversity to the overall category of diversity. It also presents three new thought experiments, with implications for AI ethics.

Climate Change, Uncertainty, and Global Catastrophic Risk

Climate Change, Uncertainty, and Global Catastrophic Risk

Is climate change a global catastrophic risk? This paper, published in the journal Futures, addresses the question by examining the definition of global catastrophic risk and by comparing climate change to another severe global risk, nuclear winter. The paper concludes that yes, climate change is a global catastrophic risk, and potentially a significant one.

Assessing the Risk of Takeover Catastrophe from Large Language Models

Assessing the Risk of Takeover Catastrophe from Large Language Models

For over 50 years, experts have worried about the risk of AI taking over the world and killing everyone. The concern had always been about hypothetical future AI systems—until recent LLMs emerged. This paper, published in the journal Risk Analysis, assesses how close LLMs are to having the capabilities needed to cause takeover catastrophe.

On the Intrinsic Value of Diversity

On the Intrinsic Value of Diversity

Diversity is a major ethics concept, but it is remarkably understudied. This paper, published in the journal Inquiry, presents a foundational study of the ethics of diversity. It adapts ideas about biodiversity and sociodiversity to the overall category of diversity. It also presents three new thought experiments, with implications for AI ethics.