AI Impacts Wiki

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
====== Accuracy of AI Predictions ======

// Published 04 June, 2015; last updated 24 November, 2020 //



<HTML>
<p>It is unclear how informative we should expect expert predictions about AI timelines to be. Individual predictions are undoubtedly often off by many decades, since they disagree with each other. However their aggregate may still be quite informative. The main potential reason we know of to doubt the accuracy of expert predictions is that experts are generally poor predictors in many areas, and AI looks likely to be one of them. However we have not investigated how accurate ‘poor’ is, or whether AI really is such a case.</p>
</HTML>


<HTML>
<p>Predictions of AI timelines are likely to be biased toward optimism by roughly decades, especially if they are <a href="/doku.php?id=ai_timelines:predictions_of_human-level_ai_timelines:interpretation_of_ai_predictions:accuracy_of_ai_predictions:selection_bias_from_optimistic_experts">voluntary statements</a> rather than surveys, and especially if they are <a href="/doku.php?id=ai_timelines:group_differences_in_ai_predictions">from populations selected for optimism</a>. We expect these factors account for less than a decade and around two decades’ difference in median predictions respectively.</p>
</HTML>



===== Support =====


==== Considerations regarding accuracy ====


<HTML>
<p>A number of reasons have been suggested for distrusting predictions about AI timelines:</p>
</HTML>


<HTML>
<ul>
<li><div class="li">
<b>Models of areas where people predict well<br/></b> Research has produced a characterization of situations where experts predict well and where they do not. See table 1 <a href="http://intelligence.org/files/PredictingAI.pdf">here</a>. AI appears to fall into several classes that go with worse predictions. However we have not investigated this evidence in depth, or the extent to which these factors purportedly influence prediction quality.
                </div></li>
<li><div class="li"><b>Expert predictions are generally poor<br/></b> Experts are notoriously poor predictors. However our impression is that this is because of their disappointing inability to predict some things well, rather than across the board failure. For instance, experts can predict the Higgs boson’s existence, outcomes of chemical reactions, and astronomical phenomena. So the question falls back to where AI falls in the spectrum of expert predictability, discussed in the last point.</div></li>
<li><div class="li"><b>Disparate predictions<br/></b> One sign that AI predictions are not very accurate is that they differ over a range of a century or so. This strongly suggests that many individual predictions are inaccurate, though not that the aggregate distribution is uninformative.</div></li>
<li><div class="li"><b><a href="/doku.php?id=ai_timelines:predictions_of_human-level_ai_timelines:interpretation_of_ai_predictions:accuracy_of_ai_predictions:similarity_between_historical_and_contemporary_ai_predictions">Similarity of old and new predictions</a><sup><br/></sup></b> Older predictions seem to form a fairly similar distribution to more recent predictions, except for very old predictions. This is weak evidence that new predictions are not strongly affected by evidence, and are therefore more likely to be inaccurate.</div></li>
<li><div class="li">
<b>Similarity of expert and lay opinions<br/></b> <a href="https://intelligence.org/files/PredictingAI.pdf">Armstrong and Sotala</a> found that expert and non-expert predictions look very similar.<span class="easy-footnote-margin-adjust" id="easy-footnote-1-166"></span><span class="easy-footnote"><a href="#easy-footnote-bottom-1-166" title='&amp;#8216;Using a database of 95 AI timeline predictions, it will show that these expectations are borne out in practice: expert predictions contradict each other considerably, and are indistinguishable from non-expert predictions and past failed predictions.&amp;#8217; &amp;#8211; &lt;a href="https://intelligence.org/files/PredictingAI.pdf"&gt;Armstrong and Sotala&lt;/a&gt; 2012, p1'><sup>1</sup></a></span> This finding is in doubt at the time of writing, due to errors in the analysis. If it were true, this would be weak evidence against experts having relevant expertise, since if they did, this might cause a difference with the opinions of lay-people. Note that it may also not, if the laypeople go to experts for information.
                </div></li>
<li><div class="li"><b>Predictions are about different things and often misinterpreted<br/></b> Comments made around predictions of human-level AI suggest that predictors are sometimes thinking about different events as ‘AI arriving’.<span class="easy-footnote-margin-adjust" id="easy-footnote-2-166"></span><span class="easy-footnote"><a href="#easy-footnote-bottom-2-166" title='For instance, in an &lt;a href="http://lesswrong.com/r/discussion/lw/9cm/qa_with_experts_on_risks_from_ai_3/"&gt;interview with Alexander Kruel&lt;/a&gt;, Pei Wang says &amp;#8216;Here by &amp;#8220;roughly as good as humans&amp;#8221; I mean the AI will follow roughly the same principles as human in information processing, though it does not mean that the system will have the same behavior or capability as human, due to the difference in body, experience, motivation, etc.&amp;#8217;Nils Nilson &lt;a href="http://lesswrong.com/r/discussion/lw/9a1/qa_with_experts_on_risks_from_ai_2/"&gt;interprets the question differently&lt;/a&gt;: &amp;#8216;Because human intelligence is so multi-faceted, your question really should be divided into each of the many components of intelligence&amp;#8230;A while back I wrote an essay about a replacement for the Turing test. It was called the &amp;#8220;Employment Test.&amp;#8221;  (See: &lt;a href="http://ai.stanford.edu/~nilsson/OnlinePubs-Nils/General_Essays/AIMag26-04-HLAI.pdf"&gt;http://ai.stanford.edu/~nilsson/OnlinePubs-Nils/General_Essays/AIMag26-04-HLAI.pdf&lt;/a&gt;)  How many of the many, many jobs that humans do can be done by machines?  I&amp;#8217;ll rephrase your question to be: When will AI be able to perform around 80% of these jobs as well or better than humans perform?These researchers were asked for their predictions in a context conducive to elaboration. Had they been surveyed more briefly (as in most surveys), or chosen not to elaborate, at least one would have been misunderstood. It is an open question whether 80% of jobs being automated will roughly coincide with artificial minds using similar information processing principles to humans.'><sup>2</sup></a></span> Even when they are predictions about the same event, ‘prediction’ can mean different things. One person might ‘predict’ the year when they think human-level AI is more likely than not, while another ‘predicts’ the year that AI seems almost certain.</div></li>
</ul>
</HTML>


<HTML>
<p>This list is not necessarily complete.</p>
</HTML>


==== Purported biases ====


<HTML>
<p>A number of biases have been posited to affect predictions of human-level AI:</p>
</HTML>


<HTML>
<ul>
<li><div class="li"><b><a href="/doku.php?id=ai_timelines:predictions_of_human-level_ai_timelines:interpretation_of_ai_predictions:accuracy_of_ai_predictions:selection_bias_from_optimistic_experts">Selection biases from optimistic experts</a></b><br/>
                Becoming an expert is probably correlated with independent optimism about the field, and experts make most of the credible predictions. We expect this to push median estimates earlier by less than a few decades.</div></li>
<li><div class="li"><b><a href="/doku.php?id=ai_timelines:predictions_of_human-level_ai_timelines:interpretation_of_ai_predictions:accuracy_of_ai_predictions:publication_biases_toward_shorter_predictions">Biases from short-term predictions being recorded</a><br/></b> There are a few reasons to expect recorded public predictions to be biased toward shorter timescales. Overall these probably make public statements less than a decade more optimistic.</div></li>
<li><div class="li"><b><a href="/doku.php?id=ai_timelines:predictions_of_human-level_ai_timelines:interpretation_of_ai_predictions:accuracy_of_ai_predictions:the_maes-garreau_law">Maes-Garreau law</a><br/></b> The Maes-Garreau law is a posited tendency for people to predict important technologies not long before their own likely death. It probably doesn’t afflict predictions of human-level AI substantially.</div></li>
<li><div class="li"><b>Fixed period bias</b><br/>
                There is a stereotype that people tend to predict AI in 20-30 years. There is weak evidence of such a tendency around 20 years, though little evidence that this is due to a bias (that we know of).</div></li>
</ul>
</HTML>


==== Conclusions ====


<HTML>
<p>AI appears to exhibit several qualities characteristic of areas that people are not good at predicting. Individual AI predictions appear to be inaccurate by many decades in virtue of their disagreement. Other grounds for particularly distrusting AI predictions seem to offer weak evidence against them, if any. Our current guess is that AI predictions are less reliable than many kinds of prediction, though still potentially fairly informative.</p>
</HTML>


<HTML>
<p>Biases toward early estimates appear to exist, as a result of optimistic people becoming experts, and optimistic predictions being more likely to be published for various reasons. These are the only plausible substantial biases we know of.</p>
</HTML>


<HTML>
<ol class="easy-footnotes-wrapper">
<li><div class="li">
<span class="easy-footnote-margin-adjust" id="easy-footnote-bottom-1-166"></span>‘Using a database of 95 AI timeline predictions, it will show that these expectations are borne out in practice: expert predictions contradict each other considerably, and are indistinguishable from non-expert predictions and past failed predictions.’ – <a href="https://intelligence.org/files/PredictingAI.pdf">Armstrong and Sotala</a> 2012, p1<a class="easy-footnote-to-top" href="#easy-footnote-1-166"></a>
</div></li>
<li><div class="li">
<span class="easy-footnote-margin-adjust" id="easy-footnote-bottom-2-166"></span>For instance, in an <a href="http://lesswrong.com/r/discussion/lw/9cm/qa_with_experts_on_risks_from_ai_3/">interview with Alexander Kruel</a>, Pei Wang says ‘Here by “roughly as good as humans” I mean the AI will follow roughly the same principles as human in information processing, though it does not mean that the system will have the same behavior or capability as human, due to the difference in body, experience, motivation, etc.’Nils Nilson <a href="http://lesswrong.com/r/discussion/lw/9a1/qa_with_experts_on_risks_from_ai_2/">interprets the question differently</a>: ‘Because human intelligence is so multi-faceted, your question really should be divided into each of the many components of intelligence…A while back I wrote an essay about a replacement for the Turing test. It was called the “Employment Test.”  (See: <a href="http://ai.stanford.edu/~nilsson/OnlinePubs-Nils/General_Essays/AIMag26-04-HLAI.pdf">http://ai.stanford.edu/~nilsson/OnlinePubs-Nils/General_Essays/AIMag26-04-HLAI.pdf</a>)  How many of the many, many jobs that humans do can be done by machines?  I’ll rephrase your question to be: When will AI be able to perform around 80% of these jobs as well or better than humans perform?These researchers were asked for their predictions in a context conducive to elaboration. Had they been surveyed more briefly (as in most surveys), or chosen not to elaborate, at least one would have been misunderstood. It is an open question whether 80% of jobs being automated will roughly coincide with artificial minds using similar information processing principles to humans.<a class="easy-footnote-to-top" href="#easy-footnote-2-166"></a>
</div></li>
</ol>
</HTML>
AI Impacts Wiki

User Tools

Site Tools

Page Tools
