AI Impacts Wiki

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
====== AI Timeline Surveys ======
/*
EDITOR COMMENTS:

-Harlan: I think that it's a bit inaccurate to say that  Gruetzemacher's survey had a response rate of 40%, because they only sent emails to those who said in person that they would be interested in taking the survey. I'm removing that number from the table

-Harlan: This page generally could use some work, much of the discussion after the table was written long ago.

-Harlan: Zach pointed out that we should add something about this survey as well https://www.generationlab.org/expertsai. ALthough it might not fit well into the table
*/
// Published 10 January 2015; last updated 9 January 2024 //


// This page is incomplete, under active work and may be updated soon. //


We know of 20 surveys on the predicted timing of human-level AI. If we collapse a few slightly different meanings of ‘human-level AI’, then:

  * Median estimates made before 2016 for when there will be a 10% chance of human-level AI are all in the 2020s, median estimates made after 2016 for when there will be a 10% chance of human-level AI are in the 2030s, except for  one with a median of 2046.
  * Median estimates for when there will be a 50% chance of human-level AI ranged between 2035 and 2074 (from twelve surveys).
  * Of three surveys in recent decades asking for predictions but not probabilities, two produced median estimates of when human-level AI will arrive in the 2050s, and one in 2085.

Participants appear to mostly be experts in AI or related areas, but with a large contingent of others. Several groups of survey participants seem likely to over-represent people who are especially optimistic about human-level AI being achieved soon.



===== Details =====


==== List of surveys ====


<HTML>
<p>These are the surveys that we know of on timelines to human-level AI:</p>
</HTML>


<HTML>
<ul>
<li><div class="li">
<a href="http://aiimpacts.wpengine.com/michie-survey/" title="Michie Survey">Michie</a> (1972)
                </div></li>
<li><div class="li">
<a href="http://aiimpacts.wpengine.com/bainbridge-survey/" title="Bainbridge survey">Bainbridge</a> (2005)
                </div></li>
<li><div class="li">
<a href="http://aiimpacts.wpengine.com/ai50-survey/" title="AI@50 Survey">AI@50</a> (2006)
                </div></li>
<li><div class="li">
<a href="http://aiimpacts.wpengine.com/klein-agi-survey/" title="Klein AGI Survey">Klein</a> (2007)
                </div></li>
<li><div class="li">
<a href="http://aiimpacts.wpengine.com/agi-09-survey/" title="AGI-09 Survey">AGI-09</a> (2009)
                </div></li>
<li><div class="li">
<a href="http://aiimpacts.wpengine.com/fhi-ai-timelines-survey/" title="FHI Winter Intelligence Survey">FHI Winter Intelligence</a> (2011)
                </div></li>
<li><div class="li">
<a href="http://aiimpacts.wpengine.com/kruel-ai-survey/" title="Kruel AI Interviews">Kruel</a> (2011-12)
                </div></li>
<li><div class="li">
<a href="http://aiimpacts.wpengine.com/hanson-ai-expert-survey/" title="Hanson AI Expert Survey">Hanson</a> (2012 onwards)
                </div></li>
<li><div class="li">
<a href="http://aiimpacts.wpengine.com/muller-and-bostrom-ai-progress-poll/" title="Müller and Bostrom AI Progress Poll">Müller and Bostrom</a>: AGI-12, TOP100, EETN, PTAI (2012-2013)
                </div></li>
<li><div class="li">
<a href="https://wiki.aiimpacts.org/doku.php?id=ai_timelines:predictions_of_human-level_ai_timelines:ai_timeline_surveys:2016_expert_survey_on_progress_in_ai" title="2016 Expert Survey on Progress in AI">ESPAI 2016</a> (survey 2015)
                </div></li>
<li><div class="li">
<a href="https://wiki.aiimpacts.org/doku.php?id=ai_timelines:predictions_of_human-level_ai_timelines:ai_timeline_surveys:etzioni_2016_survey" title="Etzioni 2016 survey">Etzioni</a> (2016)
                </div></li>
<li><div class="li">
<a href="https://wiki.aiimpacts.org/doku.php?id=ai_timelines:predictions_of_human-level_ai_timelines:ai_timeline_surveys:walsh_2017_survey" title="Walsh 2017 survey">Walsh</a> (2017)
                </div></li>
<li><div class="li">
<a href="https://arxiv.org/pdf/1901.08579.pdf" title="Forecasting Transformative AI: An Expert Survey">Gruetzemacher</a> (2018, published 2019)
                </div></li>
<li><div class="li">
<a href="https://arxiv.org/abs/2206.04132" title="Forecasting AI Progress: Evidence from a Survey of Machine Learning Researchers">GovAI</a> (2019, published 2022)
                </div></li>
<li><div class="li">
<a href="https://wiki.aiimpacts.org/doku.php?id=ai_timelines:predictions_of_human-level_ai_timelines:ai_timeline_surveys:2022_expert_survey_on_progress_in_ai" title="2022 Expert Survey on Progress in AI">ESPAI 2022</a> (2022)
                </div></li>
<li><div class="li">
<a href="https://wiki.aiimpacts.org/ai_timelines/predictions_of_human-level_ai_timelines/ai_timeline_surveys/2023_expert_survey_on_progress_in_ai" title="2023 Expert Survey on Progress in AI">ESPAI 2023</a> (2023)
                </div></li>           
</ul>
</HTML>




==== Results ====


=== Results summary ===


<HTML>
<table border="0" cellpadding="0" cellspacing="0" style="border-collapse: collapse; width: 650pt;" width="650">
<colgroup>
<col span="10" style="width: 65pt;" width="65"/>
</colgroup>
<tbody>
<tr style="height: 21.0pt;">
<td height="21" style="height: 21.0pt; width: 65pt;" width="65">Year</td>
<td style="width: 65pt;" width="65">Survey</td>
<td style="width: 65pt;" width="65">#</td>
<td class="xl64" style="width: 65pt;" width="65"> 10% chance</td>
<td class="xl64" style="width: 65pt; font-size: inherit;" width="65"> 50% chance</td>
<td class="xl64" style="width: 65pt; font-size: inherit;" width="65"> 90% chance</td>
<td class="xl64" style="width: 65pt; font-size: inherit;" width="65"> Other key ‘Predictions’</td>
<td class="xl64" style="width: 65pt;" width="65">Participants</td>
<td class="xl64" style="width: 65pt;" width="65">Response rate</td>
<td class="xl64" style="width: 65pt;" width="65">Link to original document</td>
</tr>
<tr style="height: 21.0pt;">
<td height="21" style="height: 21.0pt;">1972</td>
<td class="xl65" style="font-size: inherit;">
<a href="http://aiimpacts.wpengine.com/michie-survey/" title="Michie Survey"> Michie</a>
</td>
<td>67</td>
<td class="xl64" style="font-size: inherit;"> </td>
<td class="xl64" style="font-size: inherit;"> </td>
<td class="xl64" style="font-size: inherit;"> </td>
<td class="xl64" style="font-size: inherit;">Median 50y (2022) (vs 20 or &gt;50)</td>
<td>AI, CS</td>
<td>–</td>
<td>
<a href="https://saltworks.stanford.edu/assets/cf501kz5355.pdf">link</a>
</td>
</tr>
<tr style="height: 21.0pt;">
<td height="21" style="height: 21.0pt;">2005</td>
<td class="xl65" style="font-size: inherit;">
<a href="http://aiimpacts.wpengine.com/bainbridge-survey/" title="Bainbridge survey"> Bainbridge</a>
</td>
<td>26</td>
<td class="xl64" style="font-size: inherit;"> </td>
<td class="xl64" style="font-size: inherit;"> </td>
<td class="xl64" style="font-size: inherit;"> </td>
<td class="xl64" style="font-size: inherit;"> Median 2085</td>
<td>Tech</td>
<td>–</td>
<td>
                       <a href="http://www.wtec.org/ConvergingTechnologies/3/NBIC3_report.pdf">link</a>
</td>
</tr>
<tr style="height: 21.0pt;">
<td height="21" style="height: 21.0pt;">2006</td>
<td class="xl65" style="font-size: inherit;">
<a href="http://aiimpacts.wpengine.com/ai50-survey/" title="AI@50 Survey"> AI@50</a>
</td>
<td> </td>
<td class="xl64" style="font-size: inherit;"> </td>
<td class="xl64" style="font-size: inherit;"> </td>
<td class="xl64" style="font-size: inherit;"> </td>
<td class="xl64" style="font-size: inherit;">median &gt;50y (2056)</td>
<td>AI conf</td>
<td>–</td>
<td>
<a href="http://web.archive.org/web/20110710193831/http://www.engagingexperience.com/ai50/">link</a>
</td>
</tr>
<tr style="height: 21.0pt;">
<td height="21" style="height: 21.0pt;">2007</td>
<td class="xl65" style="font-size: inherit;">
<a href="http://aiimpacts.wpengine.com/klein-agi-survey/" title="Klein AGI Survey"> Klein</a>
</td>
<td>888</td>
<td class="xl64" style="font-size: inherit;"> </td>
<td class="xl64" style="font-size: inherit;"> </td>
<td class="xl64" style="font-size: inherit;"> </td>
<td class="xl64" style="font-size: inherit;">median 2030-2050</td>
<td class="xl64">Futurism?</td>
<td>–</td>
<td>
<a href="http://web.archive.org/web/20110226225452/http://www.novamente.net/bruce/?p=54">link</a> and <a href="http://sethbaum.com/ac/2011_AI-Experts.pdf">link</a>
</td>
</tr>

<tr style="height: 21.0pt;">
<td height="21" style="height: 21.0pt;">2009</td>
<td class="xl65" style="font-size: inherit;">
<a href="http://aiimpacts.wpengine.com/agi-09-survey/" title="AGI-09 Survey"> AGI-09</a>
</td>
<td> 21</td>
<td class="xl64" style="font-size: inherit;"> 2020</td>
<td class="xl64" style="font-size: inherit;"> 2040</td>
<td class="xl64" style="font-size: inherit;"> 2075</td>
<td class="xl64" style="font-size: inherit;"> </td>
<td class="xl64">AGI conf; AI</td>
<td class="xl64">–</td>
<td>
<a href="http://sethbaum.com/ac/2011_AI-Experts.pdf">link</a>
</td>
</tr>

<tr style="height: 21.0pt;">
<td height="21" style="height: 21.0pt;">2011</td>
<td class="xl65" style="font-size: inherit;">
<a href="https://wiki.aiimpacts.org/doku.php?id=ai_timelines:predictions_of_human-level_ai_timelines:ai_timeline_surveys:agi-11_survey" title="AGI-11 survey"> AGI-11 </a>
</td>
<td>60</td>
<td class="xl64" style="font-size: inherit;"></td>
<td class="xl64" style="font-size: inherit;"> </td>
<td class="xl64" style="font-size: inherit;"> </td>
<td class="xl64" style="font-size: inherit;"> </td>
<td>AGI-11</td>
<td class="xl66"></td>
<td>
<a href="https://web.archive.org/web/20221129004757/https://hplusmagazine.com/2011/09/16/how-long-till-agi-views-of-agi-11-conference-participants/">link</a>
</td>
</tr>


<tr style="height: 21.0pt;">
<td height="21" style="height: 21.0pt;">2011</td>
<td class="xl65" style="font-size: inherit;">
<a href="http://aiimpacts.wpengine.com/fhi-ai-timelines-survey/" title="FHI Winter Intelligence Survey"> FHI Winter Intelligence</a>
</td>
<td>35</td>
<td class="xl64" style="font-size: inherit;"> 2028</td>
<td class="xl64" style="font-size: inherit;">2050</td>
<td class="xl64" style="font-size: inherit;"> 2150</td>
<td class="xl64" style="font-size: inherit;"> </td>
<td class="xl64">AGI impacts conf; 44% related technical</td>
<td class="xl66">41%</td>
<td>
<a href="https://www.fhi.ox.ac.uk/wp-content/uploads/2011-1.pdf">link</a>
</td>
</tr>
<tr style="height: 21.0pt;">
<td height="21" style="height: 21.0pt;">2011-2012</td>
<td class="xl65" style="font-size: inherit;">
<a href="http://aiimpacts.wpengine.com/kruel-ai-survey/" title="Kruel AI Interviews"> Kruel interviews</a>
</td>
<td >37</td>
<td class="xl64" style="font-size: inherit;"> 2025</td>
<td class="xl64" style="font-size: inherit;"> 2035</td>
<td class="xl64" style="font-size: inherit;"> 2070</td>
<td class="xl64" style="font-size: inherit;"> </td>
<td class="xl64">AGI, AI</td>
<td class="xl64">–</td>
<td>
<a href="http://wiki.lesswrong.com/wiki/Interview_series_on_risks_from_AI">link</a>
</td>
</tr>
<tr style="height: 21.0pt;">
<td height="21" style="height: 21.0pt;">2012</td>
<td class="xl65" style="font-size: inherit;">
<a href="http://aiimpacts.wpengine.com/muller-and-bostrom-ai-progress-poll/" title="Müller and Bostrom AI Progress Poll"> FHI: AGI-12</a>
</td>
<td >72</td>
<td class="xl64" style="font-size: inherit;"> 2022</td>
<td class="xl64" style="font-size: inherit;"> 2040</td>
<td class="xl64" style="font-size: inherit;"> 2065</td>
<td class="xl64" style="font-size: inherit;"> </td>
<td class="xl64">AGI &amp; AGI impacts conf; AGI, technical work</td>
<td class="xl66">65%</td>
<td>
<a href="http://www.nickbostrom.com/papers/survey.pdf">link</a>
</td>
</tr>
<tr style="height: 21.0pt;">
<td height="21" style="height: 21.0pt;">2012</td>
<td class="xl65" style="font-size: inherit;">
<a href="http://aiimpacts.wpengine.com/muller-and-bostrom-ai-progress-poll/" title="Müller and Bostrom AI Progress Poll"> FHI:PT-AI</a>
</td>
<td>43</td>
<td class="xl64" style="font-size: inherit;"> 2023</td>
<td class="xl64" style="font-size: inherit;"> 2048</td>
<td class="xl64" style="font-size: inherit;"> 2080</td>
<td class="xl64" style="font-size: inherit;"> </td>
<td class="xl64">Philosophy &amp; theory of AI conf; not technical AI</td>
<td class="xl66">49%</td>
<td>
<a href="http://www.nickbostrom.com/papers/survey.pdf">link</a>
</td>
</tr>
<tr style="height: 21.0pt;">
<td height="21" style="height: 21.0pt;">2012-?</td>
<td class="xl65" style="font-size: inherit;">
<a href="http://aiimpacts.wpengine.com/hanson-ai-expert-survey/" title="Hanson AI Expert Survey"> Hanson</a>
</td>
<td>~10</td>
<td class="xl64" style="font-size: inherit;"> </td>
<td class="xl64" style="font-size: inherit;"> </td>
<td class="xl64" style="font-size: inherit;"> </td>
<td class="xl64" style="font-size: inherit;"> ≤ 10% progress to human level in past 20y</td>
<td>AI</td>
<td>–</td>
<td>
<a href="http://www.overcomingbias.com/2012/08/ai-progress-estimate.html">link</a>
</td>
</tr>
<tr style="height: 21.0pt;">
<td height="21" style="height: 21.0pt;">2013</td>
<td class="xl65" style="font-size: inherit;">
<a href="http://aiimpacts.wpengine.com/muller-and-bostrom-ai-progress-poll/" title="Müller and Bostrom AI Progress Poll"> FHI: TOP100</a>
</td>
<td >29</td>
<td class="xl64" style="font-size: inherit;">2022</td>
<td class="xl64" style="font-size: inherit;"> 2040</td>
<td class="xl64" style="font-size: inherit;"> 2075</td>
<td class="xl64" style="font-size: inherit;"> </td>
<td>Top AI</td>
<td class="xl66">29%</td>
<td>
<a href="http://www.nickbostrom.com/papers/survey.pdf">link</a>
</td>
</tr>
<tr style="height: 21.0pt;">
<td height="21" style="height: 21.0pt;">2013</td>
<td class="xl65" style="font-size: inherit;">
<a href="http://aiimpacts.wpengine.com/muller-and-bostrom-ai-progress-poll/" title="Müller and Bostrom AI Progress Poll"> FHI:EETN</a>
</td>
<td >26</td>
<td class="xl64" style="font-size: inherit;"> 2020</td>
<td class="xl64" style="font-size: inherit;"> 2050</td>
<td class="xl64" style="font-size: inherit;"> 2093</td>
<td class="xl64" style="font-size: inherit;"> </td>
<td class="xl64">Greek assoc. for AI; AI</td>
<td class="xl66">10%</td>
<td>
<p><a href="http://www.nickbostrom.com/papers/survey.pdf">link</a></p>
</td>
</tr>
<tr style="height: 21.0pt;">
<td height="21" style="height: 21.0pt;">2015</td>
<td class="xl65" style="font-size: inherit;">
<a href="https://wiki.aiimpacts.org/doku.php?id=ai_timelines:predictions_of_human-level_ai_timelines:ai_timeline_surveys:2016_expert_survey_on_progress_in_ai" title="2016 Expert Survey on Progress in AI"> ESPAI 2016</a>
</td>
<td >352</td>
<td  class="xl64" style="font-size: inherit;">2025</td>
<td class="xl64" style="font-size: inherit;"> 2061</td>
<td class="xl64" style="font-size: inherit;"> </td>
<td class="xl64" style="font-size: inherit;"> </td>
<td>NIPS and ICML 2015</td>
<td class="xl66">21%</td>
<td>
<a href="https://wiki.aiimpacts.org/doku.php?id=ai_timelines:predictions_of_human-level_ai_timelines:ai_timeline_surveys:2016_expert_survey_on_progress_in_ai">link</a>
</td>
</tr>
<tr style="height: 21.0pt;">
<td height="21" style="height: 21.0pt;">2016</td>
<td class="xl65" style="font-size: inherit;">
<a href="https://wiki.aiimpacts.org/doku.php?id=ai_timelines:predictions_of_human-level_ai_timelines:ai_timeline_surveys:etzioni_2016_survey" title="Etzioni 2016 survey"> Etzioni</a>
</td>
<td>80</td>
<td class="xl64" style="font-size: inherit;"></td>
<td class="xl64" style="font-size: inherit;"> </td>
<td class="xl64" style="font-size: inherit;"> </td>
<td class="xl64" style="font-size: inherit;"> </td>
<td></td>
<td class="xl66">41%</td>
<td>
<a href="https://wiki.aiimpacts.org/doku.php?id=ai_timelines:predictions_of_human-level_ai_timelines:ai_timeline_surveys:etzioni_2016_survey">link</a>
</td>
</tr>
<tr style="height: 21.0pt;">
<td height="21" style="height: 21.0pt;">2017</td>
<td class="xl65" style="font-size: inherit;">
<a href="https://wiki.aiimpacts.org/doku.php?id=ai_timelines:predictions_of_human-level_ai_timelines:ai_timeline_surveys:walsh_2017_survey" title="Walsh 2017 survey"> Walsh</a>
</td>
<td >849</td>
<td class="xl64" style="font-size: inherit;">AI experts: 2035<BR>Robotics experts: 2033<BR>Non-experts: 2026</td>
<td class="xl64" style="font-size: inherit;">AI experts: 2061<BR>Robotics experts: 2065<BR>Non-experts: 2039</td>
<td class="xl64" style="font-size: inherit;">AI experts: 2109<BR>Robotics experts: 2118<BR>Non-experts: 2060</td>
<td class="xl64" style="font-size: inherit;"> </td>
<td>200 AI Experts<BR>101 Robotics experts<BR>548 Non-experts</td>
<td class="xl66"></td>
<td>
<a href="https://wiki.aiimpacts.org/doku.php?id=ai_timelines:predictions_of_human-level_ai_timelines:ai_timeline_surveys:walsh_2017_survey">link</a>
</td>
</tr>
<tr style="height: 21.0pt;">
<td height="21" style="height: 21.0pt;">2018</td>
<td class="xl65" style="font-size: inherit;">
<a href="https://arxiv.org/pdf/1901.08579.pdf" title="Forecasting Transformative AI: An Expert Survey"> Gruetzemacher</a>
</td>
<td>164</td>
<td class="xl64" style="font-size: inherit;">2046</td>
<td class="xl64" style="font-size: inherit;">2074</td>
<td class="xl64" style="font-size: inherit;">2117</td>
<td class="xl64" style="font-size: inherit;"> </td>
<td>ICML, IJCAI, and HLAI 2018</td>
<td class="xl66"></td>
<td>
<a href="https://wiki.aiimpacts.org/doku.php?id=ai_timelines:predictions_of_human-level_ai_timelines:ai_timeline_surveys:2016_expert_survey_on_progress_in_ai">link</a>
</td>
</tr>
<tr style="height: 21.0pt;">
<td height="21" style="height: 21.0pt;">2019</td>
<td class="xl65" style="font-size: inherit;">
<a href="https://arxiv.org/abs/2206.04132" title="Forecasting AI Progress: Evidence from a Survey of Machine Learning Researchers"> GovAI</a>
</td>
<td>296</td>
<class="xl64" style="font-size: inherit;"></td>
<td class="xl64" style="font-size: inherit;">2039</td>
<td class="xl64" style="font-size: inherit;">2059</td>
<td class="xl64" style="font-size: inherit;">2119</td>
<td></td>
<td class="xl66">NIPS and ICML 2018</td>
<td>20%</td>
<td>
<a href="https://arxiv.org/abs/2206.04132">link</a>
</td>
</tr>
<tr style="height: 21.0pt;">
<td height="21" style="height: 21.0pt;">2022</td>
<td class="xl65" style="font-size: inherit;">
<a href="https://wiki.aiimpacts.org/doku.php?id=ai_timelines:predictions_of_human-level_ai_timelines:ai_timeline_surveys:2022_expert_survey_on_progress_in_ai" title="2022 Expert Survey on Progress in AI"> ESPAI 2022</a>
</td>
<td>461</td>
<td class="xl64" style="font-size: inherit;">2029</td>
<td class="xl64" style="font-size: inherit;">2060</td>
<td class="xl64" style="font-size: inherit;">2288</td>
<td class="xl64" style="font-size: inherit;"> </td>
<td>NIPS and ICML 2021</td>
<td class="xl66">17%</td>
<td>
<a href="https://wiki.aiimpacts.org/doku.php?id=ai_timelines:predictions_of_human-level_ai_timelines:ai_timeline_surveys:2022_expert_survey_on_progress_in_ai">link</a>
</td>
</tr>

<tr style="height: 21.0pt;">
<td height="21" style="height: 21.0pt;">2023</td>
<td class="xl65" style="font-size: inherit;">
<a href="https://wiki.aiimpacts.org/ai_timelines/predictions_of_human-level_ai_timelines/ai_timeline_surveys/2023_expert_survey_on_progress_in_ai" title="2023 Expert Survey on Progress in AI"> ESPAI 2023</a>
</td>
<td>1714</td>
<td class="xl64" style="font-size: inherit;">2027</td>
<td class="xl64" style="font-size: inherit;">2047</td>
<td class="xl64" style="font-size: inherit;">2186</td>
<td class="xl64" style="font-size: inherit;"> </td>
<td>NeurIPS, ICML, ICLR, AAAI, JMLR, and IJCAI 2022</td>
<td class="xl66">15%</td>
<td>
<a href="https://wiki.aiimpacts.org/ai_timelines/predictions_of_human-level_ai_timelines/ai_timeline_surveys/2023_expert_survey_on_progress_in_ai">link</a>
</td>
</tr>

</tbody>
</table>
</HTML>


=== Time to a 10% chance and a 50% chance of human-level AI ===


<HTML>
<p>The FHI Winter Intelligence, Müller and Bostrom, AGI-09, Kruel, and 2016 ESPAI surveys asked for years when participants expected 10%, 50% and 90% probabilities of human-level AI (or a similar concept). All of these surveys were taken between 2009 and 2012, except the 2016 ESPAI.</p>
</HTML>


<HTML>
<p>Survey participants’ median estimates for when there will be a 10% chance of human-level AI are all in the 2020s or 2030s. Until the 2016 ESPAI survey, median estimates for when there will be a 50% chance of human-level AI ranged between 2035 and 2050. <span style="font-weight: 400;">The 2016 ESPAI asked about human-level AI using both very similar questions to previous surveys, and a different style of question based on automation of specific human occupations. The former questions found median dates of at least 2056, and the latter question prompted median dates of at least 2106.</span></p>
</HTML>


=== Non-probabilistic predictions ===


<HTML>
<p>Three surveys (Bainbridge, Klein, and AI@50) asked about predictions, rather than confidence levels. These produced median predictions of  &gt;2056 (<a href="http://aiimpacts.wpengine.com/ai50-survey/" title="AI@50 Survey">AI@50</a>), 2030-50 (<a href="http://aiimpacts.wpengine.com/klein-agi-survey/" title="Klein AGI Survey">Klein</a>), and 2085 (<a href="http://aiimpacts.wpengine.com/bainbridge-survey/" title="Bainbridge survey">Bainbridge</a>). It is unclear how participants interpret the request to estimate when a thing will happen; these responses may mean the same as the 50% confidence estimate discussed above. These surveys together appear to contain a high density of people who don’t work in AI, compared to the other surveys.</p>
</HTML>


=== Michie survey ===


<HTML>
<p><a href="http://aiimpacts.wpengine.com/michie-survey/" title="Michie Survey">Michie’s survey</a> is unusual in being much earlier than the others (1972). In it, less than a third of participants expected human-level AI by 1992, another almost third estimated 2022, and the rest expected it later. Note that the participants’ median expectation (50 years away) was further from their present time than those of contemporary survey participants. This point conflicts with a common perception that early AI predictions were shockingly optimistic, and quickly undermined.</p>
</HTML>


=== Hanson survey ===


<HTML>
<p><a href="http://aiimpacts.wpengine.com/hanson-ai-expert-survey/" title="Hanson AI Expert Survey">Hanson’s survey</a> is unusual in its methodology. Hanson informally asked some AI experts what fraction of the way to human-level capabilities we had come in 20 years, in their subfield. He also asked about apparent acceleration. Around half of answers were in the 5-10% range, and all except one which hadn’t passed human-level already were less than 10%. Of six who reported on acceleration, only one saw positive acceleration.</p>
</HTML>


<HTML>
<p>These estimates suggest human-level capabilities in most fields will take more than 200 years, if progress proceeds as it has (i.e. if we progress at 10% per twenty years, it will take 200 years to get to 100%). This estimate is quite different from those obtained from most of the other surveys.</p>
</HTML>


<HTML>
<p><span style="font-weight: 400;">The 2016 ESPAI attempted to</span> <a href="/doku.php?id=ai_timelines:predictions_of_human-level_ai_timelines:ai_timeline_surveys:2016_expert_survey_on_progress_in_ai#Outside_view_implied_HLMI_forecasts"><span style="font-weight: 400;">replicate this methodology</span></a><span style="font-weight: 400;">, and did not appear to find similarly long implied timelines, however little attention has been paid to analyzing that data.</span></p>
</HTML>


<HTML>
<p><span style="font-weight: 400;">This methodology is discussed more in the methods section below.</span></p>
</HTML>


==== Methods ====


=== Survey participants ===


<HTML>
<p>In assessing the quality of predictions, we are interested in the expertise of the participants, the potential for biases in selecting them, and the degree to which a group of well-selected experts generally tend to make good predictions. We will leave the third issue to be addressed elsewhere, and here describe the participants’ expertise and the surveys’ biases. We will see that the participants have much expertise relevant to AI, but – relatedly – their views are probably biased toward optimism because of selection effects as well as normal human optimism about projects.</p>
</HTML>


== Summary of participant backgrounds ==


<HTML>
<p>The FHI (2011), AGI-09, and one of the four FHI collection surveys are from AGI (artificial general intelligence) conferences, so will tend to include a lot of people who work directly on trying to create human-level intelligence, and others who are enthusiastic or concerned about that project. At least two of the aforementioned surveys draw some participants from the ‘impacts’ section of the AGI conference, which is likely to select for people who think the effects of human-level intelligence are worth thinking about now.</p>
</HTML>


<HTML>
<p>Kruel’s participants are not from the AGI conferences, but around half work in AGI. Klein’s participants are not known, except they are acquaintances of a <a href="http://web.archive.org/web/20091208081401/http://www.novamente.net/bruce/?page_id=2">person</a> who is enthusiastic about AGI (his site is called ‘AGI-world’). Thus many participants either do AGI research, or think about the topic a lot.</p>
</HTML>


<HTML>
<p>Many more participants are AI researchers from outside AGI. Hanson’s participants are experts in narrow AI fields. Michie’s participants are computer scientists working close to AI. Müller and Bostrom’s surveys of the top 100 artificial intelligence researchers, and Members of the Greek Association for Artificial Intelligence, would be almost entirely AI researchers, and there is little reason to expect them to be in AGI. AI@50 seems to include a variety of academics interested in AI rather than those in the narrow field of AGI, though also <a href="http://www.aaai.org/ojs/index.php/aimagazine/article/view/1911/1809">includes</a> others, such as several dozen graduate and post-doctoral students. <a href="/doku.php?id=ai_timelines:predictions_of_human-level_ai_timelines:ai_timeline_surveys:2016_expert_survey_on_progress_in_ai">2016 ESPAI</a> is everyone publishing in two top machine learning conferences, so largely machine learning researchers.</p>
</HTML>


<HTML>
<p>The remaining participants appear to be mostly highly educated people from academia and other intellectual areas. The attendees at the 2011 Conference on Philosophy and Theory of AI appear to be a mixture of philosophers, AI researchers, and academics from related fields such as brain sciences. Bainbridge’s participants are contributors to ‘converging technology’ reports, on topics of nanotechnology, biotechnology, information technology, and cognitive science. From looking at <a href="http://www.wtec.org/ConvergingTechnologies/Report/NBIC_report.pdf">what appears to be one of these reports</a>, these seem to be mostly experts from government and national laboratories, academia, and the private sector. Few work in AI in particular. An arbitrary sample includes the Director of the Division of Behavioral and Cognitive Sciences at NSF, a person from the Defense Threat Reduction Agency, and a person from HP laboratories.</p>
</HTML>


== AGI researchers ==


<HTML>
<p>As noted above, many survey participants work in AGI – the project to create general intelligent agents, as opposed to narrow AI applications. In general, we might expect people working on a given project to be unusually optimistic about its success, for two reasons. First, those who are most optimistic initially will more likely find the project worth investing in. Secondly, people are <a href="http://en.wikipedia.org/wiki/Planning_fallacy">generally observed</a> to be especially optimistic about the time needed for their own projects to succeed. So we might expect AGI researchers to be biased toward optimism, for these reasons.</p>
</HTML>


<HTML>
<p>On the other hand, AGI researchers are working on projects most closely related to human-level AI, so probably have the most relevant expertise.</p>
</HTML>


== Other AI researchers ==


<HTML>
<p>Just as AGI researchers work on topics closer to human-level AI than other AI researchers – and so may be more biased but also more knowledgeable – AI researchers work on more relevant topics than everyone else. Similarly, we might expect them to both be more accurate due to their additional expertise, but more biased due to selection effects and optimism about personal projects.</p>
</HTML>


<HTML>
<p>Hanson’s participants are experts in narrow AI fields, but are also reporting on progress in their own fields of narrow AI (rather than on general intelligence), so we might expect them to be more like the AGI researchers – especially expert and especially biased. On the other hand, Hanson asks about past progress rather than future expectations, which should diminish both the selection effect and the effect from the planning fallacy, so we might expect the bias to be weaker.</p>
</HTML>


<HTML>
<p><b>Definitions of human-level AI</b></p>
</HTML>


<HTML>
<p>A few different definitions of human-level AI are combined in this analysis.</p>
</HTML>


<HTML>
<p>The AGI-09 survey asked about four benchmarks; the one reported here is the Turing-test capable AI. <a href="http://aiimpacts.wpengine.com/agi-09-survey/" title="AGI-09 Survey">Note</a> that ‘Turing test capable’ seems to sometimes be interpreted as merely capable of holding a normal human discussion. It isn’t clear that the participants had the same definition in mind.</p>
</HTML>


<HTML>
<p>Kruel only asked that the AI be as good as humans at science, mathematics, engineering and programming, and asks conditional on favorable conditions continuing (e.g. no global catastrophes). This might be expected prior to fully human-level AI.</p>
</HTML>


<HTML>
<p>Even where people talk about ‘human-level’ AI, they can mean a variety of different things. For instance, it is not clear whether a machine must operate at human cost to be ‘human-level’, or to what extent it must resemble a human.</p>
</HTML>


<HTML>
<p>At least three surveys use the acronym ‘HLMI’, but it can stand for either ‘human-level machine intelligence’ or ‘high level machine intelligence’ and is defined differently in different surveys.</p>
</HTML>


<HTML>
<p>Here is a full list of exact descriptions of something like ‘human-level’ used in the surveys:</p>
</HTML>


<HTML>
<ul>
<li><div class="li"><strong>Michie:</strong> ‘computing system exhibiting intelligence at adult human level’</div></li>
<li><div class="li"><strong>Bainbridge:</strong> ‘The computing power and scientific knowledge will exist to build<br/>
                machines that are functionally equivalent to the human brain’</div></li>
<li><div class="li"><strong>Klein:</strong> ‘When will AI surpass human-level intelligence?’</div></li>
<li><div class="li"><strong>AI@50:</strong> ‘When will computers be able to simulate every aspect of human intelligence?’</div></li>
<li><div class="li"><strong>FHI 2011:</strong> ‘Assuming no global catastrophe halts progress, by what year would you assign a 10%/50%/90% chance of the development of human-level machine intelligence? Feel free to answer ‘never’ if you believe such a milestone will never be reached.’</div></li>
<li><div class="li"><strong>Müller and Bostrom: ‘</strong>[machine intelligence] that can carry out most human professions at least as well as a typical human’</div></li>
<li><div class="li"><strong>Hanson:</strong> ‘human level abilities’ in a subfield (wording is probably not consistent, given the long term and informal nature of the poll)</div></li>
<li><div class="li"><strong>AGI-09:</strong> ‘Passing the Turing test’</div></li>
<li><div class="li"><strong>Kruel:</strong> Variants on, ‘Assuming beneficial political and economic development and that no global catastrophe halts progress, by what year would you assign a 10%/50%/90% chance of the development of artificial intelligence that is roughly as good as humans (or better, perhaps unevenly) at science, mathematics, engineering and programming?’</div></li>
<li><div class="li">
<strong>2016 ESPAI </strong>(our emboldening)<strong>: </strong>
<ul>
<li><div class="li">Say we have ‘<strong>high level machine intelligence</strong>’ when unaided machines can accomplish every task better and more cheaply than human workers. Ignore aspects of tasks for which being a human is intrinsically advantageous, e.g. being accepted as a jury member. <em>Think feasibility, not adoption.</em></div></li>
<li><div class="li">Say an occupation becomes <strong>fully automatable</strong> when unaided machines can accomplish it better and more cheaply than human workers. Ignore aspects of occupations for which being a human is intrinsically advantageous, e.g. being accepted as a jury member. <em>Think feasibility, not adoption.</em></div></li>
<li><div class="li">Say we have reached ‘<strong>full automation of labor</strong>’ “when all occupations are fully automatable. That is, when for any occupation, machines could be built to carry out the task better and more cheaply than human workers.”</div></li>
</ul>
</div></li>
</ul>
</HTML>


=== Inside vs. outside view methods ===


<HTML>
<p><span style="font-weight: 400;">Hanson’s survey was unusual in that it asked participants for their impressions of past rates of progress, from which extrapolation could be made (an ‘</span><a href="http://en.wikipedia.org/wiki/Reference_class_forecasting"><span style="font-weight: 400;">outside view</span></a><span style="font-weight: 400;">’ estimate), rather than asking directly about expected future rates of progress (an ‘inside view’ estimate). It also produced much later median dates for human-level AI, suggesting that this outside view methodology in general produces much later estimates (rather than for instance, Hanson’s low sample size and casual format just producing a noisy or biased estimate that happened to be late).</span></p>
</HTML>


<HTML>
<p><span style="font-weight: 400;">If so, this would be important because outside view estimates in general are often informative.</span></p>
</HTML>


<HTML>
<p><span style="font-weight: 400;">However t</span><span style="font-weight: 400;">he 2016 ESPAI included a set of questions similar to Hanson’s, and did not at a glance find similarly long implied timelines, though the data has not been carefully analyzed. This is some evidence against the outside view style methodology systematically producing longer timelines, though arguably not enough to overturn the hypothesis.</span></p>
</HTML>


<HTML>
<p><span style="font-weight: 400;">We might expect Hanson’s outside view method to be especially useful in AI forecasting because a key merit is that asking people about the past means asking questions more closely related to their expertise, and the future of AI is arguably especially far from anyone’s expertise (relative to say asking a dam designer how long it will take for their dam to be constructed) . On the other hand, AI researchers’ expertise may include a lot of information about AI other than how far we have come, and translating what they have seen into what fraction of the way we have come may be difficult and thus introduce additional error.</span></p>
</HTML>
AI Impacts Wiki

User Tools

Site Tools

Page Tools
