ai_timelines:hardware_and_ai_timelines:computing_capacity_of_all_gpus_and_tpus
This is an old revision of the document!
Table of Contents
How much computing capacity exists in GPUs and TPUs in Q1 2023?
A back-of-the-envelope calculation based on market size, price-performance, hardware lifespan estimates, and the sizes of Google’s data centers estimates that there is around 3.98 * 10^21 FLOP/s of computing capacity on GPUs and TPUs as of Q1 2023.
Details
Estimating dollars used to buy GPUs per year
Consulting firms reported their estimates of the world-wide GPU market size for 2017, 2018, 2019, 2020, 2021, and 2022.1)2)3)4)5)6) Unfortunately, the details of these reports are paywalled, so the methodology and scope of these estimates is not completely clear. A sample of GMI’s report on 2022 GPU market size seems to indicate that the estimate is reasonably comprehensive.7)
1)
Bhutani, Ankita, and Preeti Wadhwani. 2019. “Graphics Processing Unit (GPU) Market Size By Component, Hardware, Device Type, Service, By Deployment Model, By Application, Industry Analysis Report, Regional Outlook, Growth Potential, Competitive Market Share & Forecast, 2018 - 2024.” Global Market Insights. https://web.archive.org/web/20220303120312/https://www.gminsights.com/industry-analysis/gpu-market.
2)
“GPU Market Size, Share, Trends | Forecast 2026.” n.d. Acumen Research and Consulting. Accessed March 31, 2023. https://www.acumenresearchandconsulting.com/gpu-market.
3)
R, Rachita. 2020. “GPU Market Size, Share & Forecast by 2027 : Graphics Processing Unit.” Allied Market Research. https://www.alliedmarketresearch.com/graphic-processing-unit-market.
4)
Alsop, Thomas. 2021. “Graphics processing unit (GPU) market size worldwide in 2020 and 2028.” Statista. https://web.archive.org/web/20220901103010/https://www.statista.com/statistics/1166028/gpu-market-size-worldwide/.
5)
“Graphic Processing Unit (GPU) Market Size, Share, Trends & Forecast.” 2022. Verified Market Research. https://www.verifiedmarketresearch.com/product/graphic-processing-unit-gpu-market/.
6)
Wadhwani, Preeti, and Aayush Jain. 2023. “Graphics Processing Unit (GPU) Market Size, Share Report – 2032.” Global Market Insights. https://www.gminsights.com/industry-analysis/gpu-market.
7)
The report include revenue related to integrated GPUs, including from Apple. Because Apple does not appear to sell their integrated GPUs directly to consumers, this likely means that the report is including GPUs that come installed in Apple devices, rather than only stand-alone GPUs. If this is not the case, and the estimate only includes sales of stand-alone GPUs, then this page might significantly underestimate the total compute of all GPUs and TPUs.
ai_timelines/hardware_and_ai_timelines/computing_capacity_of_all_gpus_and_tpus.1680546554.txt.gz · Last modified: 2023/04/03 18:29 by harlanstewart
Except where otherwise noted, content on this wiki is licensed under the following license: CC0 1.0 Universal
