ai_timelines:hardware_and_ai_timelines:computing_capacity_of_all_gpus_and_tpus
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision Last revision Both sides next revision | ||
|
ai_timelines:hardware_and_ai_timelines:computing_capacity_of_all_gpus_and_tpus [2023/06/05 18:04] rickkorzekwa Changed to first person plural |
ai_timelines:hardware_and_ai_timelines:computing_capacity_of_all_gpus_and_tpus [2024/01/09 21:17] harlanstewart |
||
|---|---|---|---|
| Line 1: | Line 1: | ||
| + | /* | ||
| + | EDITOR NOTES (publicly accessible) | ||
| + | -Harlan: I plan to update this page once global market size estimates for GPUs become available for 2023 | ||
| + | */ | ||
| ====== How much computing capacity exists in GPUs and TPUs in Q1 2023? ====== | ====== How much computing capacity exists in GPUs and TPUs in Q1 2023? ====== | ||
| Line 21: | Line 25: | ||
| ==== Estimating FLOP/s per dollar GPUs had per year ==== | ==== Estimating FLOP/s per dollar GPUs had per year ==== | ||
| - | Hobbhahn & Besiroglu (2022) used a dataset of GPUs to find trends in FLOP/s per dollar over time. This provides a simple way to convert the above estimates of total spending on GPUs per year into estimates of total GPU computing capacity produced per year. Hobbhahn & Besiroglu found no statistically significant difference in the trends of FP16 and FP32 precision compute, and We follow their example by focusing on FP32 precision for the computing capacity of GPUs.((Hobbhahn, | + | Hobbhahn & Besiroglu (2022) used a dataset of GPUs to find trends in FLOP/s per dollar over time. This provides a simple way to convert the above estimates of total spending on GPUs per year into estimates of total GPU computing capacity produced per year. Hobbhahn & Besiroglu found no statistically significant difference in the trends of FP16 and FP32 precision compute, and we follow their example by focusing on FP32 precision for the computing capacity of GPUs.((Hobbhahn, |
| * Our best guess estimate for FLOP/s per dollar over time is based on the trendline over all of the data in the dataset. | * Our best guess estimate for FLOP/s per dollar over time is based on the trendline over all of the data in the dataset. | ||
ai_timelines/hardware_and_ai_timelines/computing_capacity_of_all_gpus_and_tpus.txt · Last modified: 2024/01/24 23:06 by harlanstewart
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: CC0 1.0 Universal
