User Tools

Site Tools


ai_timelines:group_differences_in_ai_predictions

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

ai_timelines:group_differences_in_ai_predictions [2022/09/21 07:37] (current)
Line 1: Line 1:
 +====== Group Differences in AI Predictions ======
 +
 +// Published 24 May, 2015; last updated 10 December, 2020 //
 +
 +
 +
 +<HTML>
 +<p>In 2015 AGI researchers appeared to expect human-level AI substantially sooner than other AI researchers. The difference ranges from about five years to at least about sixty years as we move from highest percentiles of optimism to the lowest. Futurists appear to be around as optimistic as AGI researchers. Other people appear to be substantially more pessimistic than AI researchers.</p>
 +</HTML>
 +
 +
 +
 +===== Details =====
 +
 +
 +==== MIRI dataset ====
 +
 +
 +<HTML>
 +<p>We categorized predictors in the <a href="/doku.php?id=ai_timelines:miri_ai_predictions_dataset" title="MIRI AI Predictions Dataset">MIRI dataset</a> as AI researchers, AGI (artificial general intelligence) researchers, Futurists and Other. We also interpreted their statements into a common format, roughly corresponding to the first year in which the person appeared to be suggesting that human-level AI was more likely than not (see ‘minPY’ described <a href="/doku.php?id=ai_timelines:miri_ai_predictions_dataset" title="MIRI AI Predictions Dataset">here</a>).</p>
 +</HTML>
 +
 +
 +<HTML>
 +<p>Recent (since 2000) predictions are shown in the figure below. Those made by people working on AGI specifically tended to be decades more optimistic than those at the same percentile of optimism working in other areas of AI. The difference ranged from around five years to at least around sixty years as we move from the soonest predictions to the latest. Those who worked in AI broadly tended to be at least a decade more optimistic than ‘others’, at any percentile of optimism within their group. Futurists were about as optimistic as AGI researchers.</p>
 +</HTML>
 +
 +
 +<HTML>
 +<p>Note that these predictions were made over a period of at least 12 years, rather than at the same time.</p>
 +</HTML>
 +
 +
 +<HTML>
 +<figure aria-describedby="caption-attachment-540" class="wp-caption alignnone" id="attachment_540" style="width: 600px">
 +<a href="http://aiimpacts.org/wp-content/uploads/2015/05/groupsAIpredictions.png"><img alt="xxx" class="wp-image-540" height="406" sizes="(max-width: 600px) 100vw, 600px" src="https://aiimpacts.org/wp-content/uploads/2015/05/groupsAIpredictions.png" srcset="https://aiimpacts.org/wp-content/uploads/2015/05/groupsAIpredictions.png 917w, https://aiimpacts.org/wp-content/uploads/2015/05/groupsAIpredictions-300x203.png 300w" width="600"/></a>
 +<figcaption class="wp-caption-text" id="caption-attachment-540">
 +<b>Figure 1: </b>Cumulative probability of AI being predicted (<a href="/doku.php?id=ai_timelines:miri_ai_predictions_dataset" title="MIRI AI Predictions Dataset">minPY</a>), for various groups, for predictions made after 2000. See <a href="https://sites.google.com/site/aiimpactslibrary/ai-timelines/predictions-of-human-level-ai-dates/miri-ai-predictions-dataset">here</a>.
 +                </figcaption>
 +</figure>
 +</HTML>
 +
 +
 +<HTML>
 +<p>Median predictions are shown below (these are also minPY predictions as defined on the <a href="/doku.php?id=ai_timelines:miri_ai_predictions_dataset" title="MIRI AI Predictions Dataset">MIRI dataset page</a>, calculated from ‘cumulative distributions’ sheet in updated dataset spreadsheet also available there).</p>
 +</HTML>
 +
 +
 +<HTML>
 +<table border="1" cellspacing="0">
 +<tbody>
 +<tr>
 +<td><b> Median AI predictions</b></td>
 +<td> AGI</td>
 +<td> AI</td>
 +<td> Futurist</td>
 +<td> Other</td>
 +<td> All</td>
 +</tr>
 +<tr>
 +<td> Early (pre-2000) (warning: noisy)</td>
 +<td></td>
 +<td> 1988</td>
 +<td> 2031</td>
 +<td> 2036</td>
 +<td> 2025</td>
 +</tr>
 +<tr>
 +<td> Late (since 2000)</td>
 +<td> 2033</td>
 +<td> 2051</td>
 +<td> 2031</td>
 +<td> 2101</td>
 +<td> 2042</td>
 +</tr>
 +</tbody>
 +</table>
 +</HTML>
 +
 +
 +==== FHI survey data ====
 +
 +
 +<HTML>
 +<p>The <a href="/doku.php?id=ai_timelines:predictions_of_human-level_ai_timelines:ai_timeline_surveys:fhi_winter_intelligence_survey" title="FHI Winter Intelligence Survey">FHI survey</a> results suggest that people’s views are not very different if they work in computer science or other parts of academia. We have not investigated this evidence in more detail.</p>
 +</HTML>
 +
 +
 +===== Implications =====
 +
 +
 +<HTML>
 +<p><b>Biases from optimistic predictors and information asymmetries: </b>Differences of opinion among groups who predict AI suggest that either some groups have more information, or that biases exist between predictions made by the groups (e.g. even among unbiased but noisy forecasters, if only people most optimistic about a field enter it, then the views of those in the field will be <a href="/doku.php?id=ai_timelines:predictions_of_human-level_ai_timelines:interpretation_of_ai_predictions:accuracy_of_ai_predictions:selection_bias_from_optimistic_experts">biased toward optimism</a>) . Either of these is valuable to know about, so that we can either look into the additional information, or try to correct for the biases.</p>
 +</HTML>
 +
 +
  
ai_timelines/group_differences_in_ai_predictions.txt · Last modified: 2022/09/21 07:37 (external edit)