AI Impacts Wiki

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
====== AI Timeline predictions in surveys and statements ======

// Published 20 May, 2015; last updated 10 December, 2020 //

<HTML>
<p>Surveys seem to produce median estimates of time to human-level AI which are roughly a decade later than those produced from voluntary public statements.</p>
</HTML>


===== Details =====


<HTML>
<p>We <a href="/doku.php?id=ai_timelines:miri_ai_predictions_dataset" title="MIRI AI Predictions Dataset">compared</a> several surveys to predictions made by similar groups of people in the <a href="/doku.php?id=ai_timelines:miri_ai_predictions_dataset" title="MIRI AI Predictions Dataset">MIRI AI predictions dataset</a>, and found that predictions made in surveys were roughly 0-2 decade later. This was a rough and non-rigorous comparison, and we made no effort to control for most variables.</p>
</HTML>


<HTML>
<p>Stuart Armstrong and Kaj Sotala make a similar comparison <a href="http://lesswrong.com/r/discussion/lw/gta/selfassessment_in_expert_ai_predictions/">here</a>, and also find survey data to give later predictions. However they are comparing non-survey data largely from recent decades with survey data entirely from 1973, which we think makes the groups too different in circumstance to infer much about surveys and statements in particular. Though in the MIRI dataset (that they used), very early predictions <a href="/doku.php?id=ai_timelines:miri_ai_predictions_dataset" title="MIRI AI Predictions Dataset">tend to be</a> more optimistic than later predictions, if anything, so if they had limited themselves to predictions from similar times there would have been a larger difference (though with a very small sample of statements).</p>
</HTML>


===== Relevance =====


<HTML>
<p><strong>Accuracy of AI predictions</strong>: <a href="/doku.php?id=ai_timelines:predictions_of_human-level_ai_timelines:interpretation_of_ai_predictions:accuracy_of_ai_predictions:publication_biases_toward_shorter_predictions">some biases</a> which probably exist in public statements about AI predictions are likely to be smaller or not apply in survey data. For instance, public statements are probably more likely to be made by people who believe they have surprising or interesting views, whereas this should much less influence answers to a survey question once someone is taking a survey. Thus comparing data from surveys and voluntary statements can tell us about the strength of such biases. Given that median survey predictions are rarely more than a decade later than similar statements, and survey predictions seem unlikely to be strongly biased in this way, median statements are probably less than a decade early as a result of this bias.</p>
</HTML>
AI Impacts Wiki

User Tools

Site Tools

Page Tools
