Published: 19 December, 2023; Last Updated: 19 December, 2023.
Epistemic Status: Varies. Some of the examples here come from thorough case studies for our other projects. We are less confident of the examples which were not part of a dedicated case study: some of the sources cited were not read thoroughly, and we did not check to make sure that they are representative of the relevant literature.
This page lists some examples of warning signs from the history of technologies other than AI.
Sometimes, to understand the development of an emerging technology and the policy surrounding it, it is important to understand a few key events, called 'warning signs.' Activists use these events to argue that the specific technology, or the industry more generally, has important risks that need to be addressed. This galvanizes public support and puts pressure on policy makers. The policies enacted in the wake of these events are important for that industry for at least decades to come.
There are multiple terms that are used to refer to these key events in the history of technology policy. The terms do not mean exactly the same thing, and are used inconsistently.
“A warning shot is a global catastrophe that indirectly reduces existential risk by increasing concern about future catastrophes.”1) To be a warning shot under this definition, large scale harm has to occur.
A fire alarm is something which creates “common knowledge that action is now due and socially acceptable.”2) The focus here is the creation of common knowledge, rather than the harm caused.
A warning sign is “any event that increases concern about a particular category of existential risk, regardless of whether the event itself constitutes a global catastrophe. … Note, however, that both 'warning shot' and 'fire alarm' are sometimes used as synonyms for 'warning sign.'”3)
A trigger event is “a 'highly publicized, shocking incident' that 'dramatically reveals a critical social problem to the public in a vivid way.'”4) This term is not specific to technology policy, and comes from the general theory of protest. A related term is a moment of the whirlwind. The focus of this term is on the decision maker at a critical moment, rather than the event leading to that critical moment.
A Sputnik moment is “a trigger mechanism, an event that makes people collectively say that they need to do something, and this sets a course in another direction,” especially when a country recognizes that its competitors have some technological ability that they do not currently have.5)
A galvanizing event is an event that stimulates people's willingness to take action.
Below are some examples of warning signs for various industries: nuclear power, fossil fuels, chlorofluorocarbons, genetically modified organisms, medical research involving viruses, and medical research involving humans. For some of them, the main concern is not existential risk. Some of them also satisfy the definitions of several of the terms described above.
The examples of warning signs are grouped by the industry they were used to promote policies for. Each example also includes the date the warning sign was made known to the public, the location where the warning sign took place, and a brief description of what occurred. The relevance of the warning sign to the problem activists were trying to address is categorized as High, Moderate, or Low. The amount of harm caused is categorized as harm occurring locally, regionally, or globally, and as catastrophic if it kills a majority of the people it impacts or renders a large area uninhabitable, significant if it kills some people or has severe environmental consequences, and low if no one is killed by the warning shot. The resulting policies that this warning sign contributed to are then briefly described.
Primary author: Jeffrey Heninger.