The server market for the near future is going to be about GPUs, GPUs, and more GPUs, according to Omdia. The market researcher estimates the volume of Nvidia H100 GPUs alone shipped during calendar Q2 added up to more than 900 tons in weight.
This headline-grabbing figure comes from the company's latest Cloud and Data Center Market Update, which notes the shift in datacenter investment priorities it previously highlighted continues apace. The report says demand for servers fitted with eight GPUs for AI processing work has had the effect of pushing up average prices, while simultaneously putting the squeeze on investment in other areas.
As a consequence, Omdia has once again lowered its estimate for annual server shipments for 2023 by another 1 million units to 11.6 million, a 17 percent decline over last year's figure. At the same time, however, the average price of a server has risen by more than 30 percent quarter-on-quarter and year-on-year because hyperscalers are pouring investment into these high-spec boxes.
The report states that just over 300,000 of Nvidia's H100 GPUs found their way into the assembly lines of server makers, with the 900 tons figure based on each GPU with its heatsink weighing in at about 3kg.