arguments_for_ai_risk:views_of_ai_developers_on_risk_from_ai
Differences
This shows you the differences between two versions of the page.
| Next revision | Previous revision | ||
|
arguments_for_ai_risk:views_of_ai_developers_on_risk_from_ai [2023/05/21 02:50] rickkorzekwa created |
arguments_for_ai_risk:views_of_ai_developers_on_risk_from_ai [2024/03/09 18:18] (current) katjagrace [Geoffrey Hinton, 2018 Turing Award recipient] |
||
|---|---|---|---|
| Line 1: | Line 1: | ||
| ====== Views of prominent AI developers on risk from AI ====== | ====== Views of prominent AI developers on risk from AI ====== | ||
| + | |||
| + | //This page is in an early draft. It is incomplete and may contain errors.// | ||
| People who have worked on creating artificial intelligence have a variety of views on risk from AI, both for the potential benefits and potential downsides. | People who have worked on creating artificial intelligence have a variety of views on risk from AI, both for the potential benefits and potential downsides. | ||
| Line 13: | Line 15: | ||
| ===== Academic researchers ===== | ===== Academic researchers ===== | ||
| + | |||
| + | ==== Yoshua Bengio, Université de Montréal, 2018 Turing Award recipient ==== | ||
| + | |||
| + | > I'm not concerned about [the warnings from people like Elon Musk and Stephen Hawking about an existential threat from super intelligent AI and getting into a recursive improvement loop], I think it's fine that some people study the question. My understanding of the current science as it is now, and as I can foresee it, is that those kinds of scenarios are not realistic. Those kinds of scenarios are not compatible with how we build AI right now. | ||
| + | |||
| + | // | ||
| + | |||
| + | > [Prof. Bengio] noted that disagreement among AI experts was an important signal to the public that science did not have the answers as of yet. “If we disagree it means we don’t know . . . if it could be dangerous. And if we don’t know, it means we must act to protect ourselves, | ||
| + | > | ||
| + | > “If you want humanity and society to survive these challenges, we can’t have the competition between people, companies, countries — and a very weak international co-ordination, | ||
| + | |||
| + | //Financial Times [[https:// | ||
| + | |||
| + | Prof. Bengio signed [[https:// | ||
| ==== Stuart Russel, UC Berkeley, Professor ==== | ==== Stuart Russel, UC Berkeley, Professor ==== | ||
| + | |||
| + | > The problem with that is that if we succeed in creating artificial intelligence and machines with those abilities, then unless their objectives happen to be perfectly aligned with those of humans, then we’ve created something that’s extremely intelligent, | ||
| + | > | ||
| + | > The negative consequences for humans are without limit. The mistake is in the way we have transferred the notion of intelligence, | ||
| + | |||
| + | // | ||
| + | |||
| + | > In the last 10 years or so I've been asking myself what happens if I or if we as a field succeed in what we've been trying to do which is to create AI systems that are at least as general in their intelligence as human beings. And I came to the conclusion that if we did succeed it might not be the best thing in the history of the human race. In fact, it might be the worst. | ||
| + | |||
| + | // | ||
| > If we pursue [our current approach], then we will eventually lose control over the machines. But, we can take a different route that actually leads to AI systems that are beneficial to humans. | > If we pursue [our current approach], then we will eventually lose control over the machines. But, we can take a different route that actually leads to AI systems that are beneficial to humans. | ||
| - | [[https:// | + | //[[https:// |
| + | |||
| + | Prof. Russel signed [[https:// | ||
| + | |||
| + | ==== Gary Marcus, New York University, Professor ==== | ||
| + | |||
| + | > I’m not that worried about AI systems independently wanting to eat us for breakfast or turn us into paper clips. It’s not completely impossible, but there’s no real evidence that we’re moving in that direction. There is evidence, though, that we’re giving more and more power to those machines, and that we have no idea how to solve the cybersecurity threats in the near term. | ||
| + | |||
| + | > I don’t completely discount [the AI control problem and recursive improvement], | ||
| + | |||
| + | // | ||
| + | |||
| + | Prof. Marcus signed [[https:// | ||
| ===== AI Labs leaders & researchers ===== | ===== AI Labs leaders & researchers ===== | ||
| Line 33: | Line 71: | ||
| // | // | ||
| + | |||
| + | Mr. Altman signed [[https:// | ||
| ==== Dario Amodei, CEO, Anthropic ==== | ==== Dario Amodei, CEO, Anthropic ==== | ||
| Line 45: | Line 85: | ||
| // | // | ||
| + | |||
| + | Dr. Amodei signed [[https:// | ||
| ==== Greg Brockman, Co-Founder and President, OpenAI ==== | ==== Greg Brockman, Co-Founder and President, OpenAI ==== | ||
| Line 53: | Line 95: | ||
| ==== Demis Hassabis, CEO, DeepMind ==== | ==== Demis Hassabis, CEO, DeepMind ==== | ||
| + | |||
| + | > My view on [existential risk from AI] is that I’m in the middle. The reason I work on AI is because I think it’s going to be the most beneficial thing to humanity ever. I think it’s going to unlock our potential within science and medicine in all sorts of ways. As with any powerful technology, and AI could be especially powerful because it’s so general, the technology itself is neutral. It depends on how we as humans decide to design and deploy it, what we decide to use it for, and how we decide to distribute the gains. | ||
| + | |||
| + | > A lot of what Nick Bostrom worries about are the technical questions we have to get right, such as the control problem and the value alignment problem. My view is that on those issues we do need a lot more research because we’ve only just got to the point now where there are systems that can even do anything interesting at all. | ||
| + | |||
| + | // | ||
| From Billy Perrigo at Time: | From Billy Perrigo at Time: | ||
| Line 70: | Line 118: | ||
| // | // | ||
| - | ==== Yann LeCun, Chief AI Scientist, | + | ==== Geoffrey Hinton, 2018 Turing Award recipient ==== |
| + | |||
| + | >If I were advising governments, | ||
| + | |||
| + | //Financial Times [[https:// | ||
| + | |||
| + | > There' | ||
| + | |||
| + | //NPR [[https:// | ||
| + | |||
| + | >My big worry is, sooner or later someone will wire into them the ability to create their own subgoals... I think it’ll very quickly realize that getting more control is a very good subgoal because it helps you achieve other goals... And if these things get carried away with getting more control, we’re in trouble. | ||
| + | |||
| + | >And if [AI models] are much smarter than us, they’ll be very good at manipulating us. You won’t realize what’s going on... So even if they can’t directly pull levers, they can certainly get us to pull levers. It turns out if you can manipulate people, you can invade a building in Washington without ever going there yourself. | ||
| + | |||
| + | // | ||
| + | |||
| + | ==== Yann LeCun, Meta, Chief AI Scientist, | ||
| + | |||
| + | > Let me start with one thing we should not worry about, the Terminator scenario. This idea that somehow we’ll come up with the secret to artificial general intelligence, | ||
| + | |||
| + | // | ||
| > There will be mistakes, no doubt, as with any new technology (early jetliners lost wings, early cars didn't have seat belts, roads didn't have speed limits...). | > There will be mistakes, no doubt, as with any new technology (early jetliners lost wings, early cars didn't have seat belts, roads didn't have speed limits...). | ||
| > But I disagree that there is a high risk of accidentally building existential threats to humanity. | > But I disagree that there is a high risk of accidentally building existential threats to humanity. | ||
| - | //Facebook discussion with Stuart Russel and Yoshua Bengio [[https:// | + | //Facebook discussion with Stuart Russel and Yoshua Bengio, September 2019 [[https:// |
| > I think that the magnitude of the AI alignment problem has been ridiculously overblown & our ability to solve it widely underestimated. | > I think that the magnitude of the AI alignment problem has been ridiculously overblown & our ability to solve it widely underestimated. | ||
arguments_for_ai_risk/views_of_ai_developers_on_risk_from_ai.1684637431.txt.gz · Last modified: 2023/05/21 02:50 by rickkorzekwa
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: CC0 1.0 Universal
