January Newsletter

by | 6 January 2017

Conferences

GCRI Director of Research Tony Barrett led a symposium on global catastrophic risk at the 2016 meeting of the Society for Risk Analysis, December 11-15 in San Diego. The 2016 GCRI symposium featured five talks focused on risks from AI and nuclear weapons. These included Barrett’s presentation, “Technology Forecasting for Analyzing Future Global Catastrophic Risks” and GCRI Associate Roman Yampolskiy’s presentation, “Artificial General Intelligence Risk Analysis”. SRA is the premier academic and professional society for risk analysis. GCRI has led symposia at SRA since 2010.

GCRI Associate Matthijs Maas gave a talk on “Politics in the Age of Weapons Containment: Insights From Nuclear Weapons Policy for the Governance of AI Development” at the 2016 Cambridge Conference on Catastrophic Risk (CCCR).

Popular Media

GCRI Executive Director Seth Baum was featured in articles in Quartz and Elite Daily discussing his recent Bulletin of the Atomic Scientists article on the US election and and global catastrophic risk. He was also interviewed about his article on The Next Chapter radio show and on the NonProphets podcast.

Seth Baum also published an essay on “Space Colonization and the Meaning of Life” in the science magazine Nautilus. The article gives Baum’s personal perspective on his work on global catastrophic risk.

GCRI Associate Kaitlin Butler was interviewed about global catastrophic risks for FiveThirtyEight’s “Science Question From a Toddler” column.

GCRI Associate Roman Yampolskiy was interviewed for three pieces on artificial intelligence: a RedZone podcast on AI safety, cyber security and other topics; a TechRepublic piece on the White House’s recent report on AI and unemployment; and a separate TechRepublic piece on three AI trends to watch in 2017.

Author

Recent Publications

Climate Change, Uncertainty, and Global Catastrophic Risk

Climate Change, Uncertainty, and Global Catastrophic Risk

Is climate change a global catastrophic risk? This paper, published in the journal Futures, addresses the question by examining the definition of global catastrophic risk and by comparing climate change to another severe global risk, nuclear winter. The paper concludes that yes, climate change is a global catastrophic risk, and potentially a significant one.

Assessing the Risk of Takeover Catastrophe from Large Language Models

Assessing the Risk of Takeover Catastrophe from Large Language Models

For over 50 years, experts have worried about the risk of AI taking over the world and killing everyone. The concern had always been about hypothetical future AI systems—until recent LLMs emerged. This paper, published in the journal Risk Analysis, assesses how close LLMs are to having the capabilities needed to cause takeover catastrophe.

On the Intrinsic Value of Diversity

On the Intrinsic Value of Diversity

Diversity is a major ethics concept, but it is remarkably understudied. This paper, published in the journal Inquiry, presents a foundational study of the ethics of diversity. It adapts ideas about biodiversity and sociodiversity to the overall category of diversity. It also presents three new thought experiments, with implications for AI ethics.

Climate Change, Uncertainty, and Global Catastrophic Risk

Climate Change, Uncertainty, and Global Catastrophic Risk

Is climate change a global catastrophic risk? This paper, published in the journal Futures, addresses the question by examining the definition of global catastrophic risk and by comparing climate change to another severe global risk, nuclear winter. The paper concludes that yes, climate change is a global catastrophic risk, and potentially a significant one.

Assessing the Risk of Takeover Catastrophe from Large Language Models

Assessing the Risk of Takeover Catastrophe from Large Language Models

For over 50 years, experts have worried about the risk of AI taking over the world and killing everyone. The concern had always been about hypothetical future AI systems—until recent LLMs emerged. This paper, published in the journal Risk Analysis, assesses how close LLMs are to having the capabilities needed to cause takeover catastrophe.

On the Intrinsic Value of Diversity

On the Intrinsic Value of Diversity

Diversity is a major ethics concept, but it is remarkably understudied. This paper, published in the journal Inquiry, presents a foundational study of the ethics of diversity. It adapts ideas about biodiversity and sociodiversity to the overall category of diversity. It also presents three new thought experiments, with implications for AI ethics.