The 2025 Server Starting Point

Happy 2025 STH’ers! I just wanted to put this into a post, since it is something we may reference later. I just wanted to quickly mark the new year with what our starting point is for those buying servers. Since it is 2025, I figure this would be a good post to memorialize where we are at with the technology stack.

AMD is currently at 192 Turin Dense cores and 384 threads per socket, and 128 full cache and clock speed cores (256 threads) in Turn. Intel has its 128 core/ 256 thread Granite Rapids AP and its Sierra Forest-SP at 144 cores/ threads. The smaller Granite Rapids-SP and larger 288 core Sierra Forest-AP we expect in the second half of Q1 2025, assuming that 288 core part does not become solely a special order hyper-scale part.

On the Arm side, NVIDIA Grace is still at 72 cores for the single CPU module and 144 cores for the dual chip module. Check out our Quick Introduction to the NVIDIA GH200 aka Grace Hopper piece because the memory bandwidth varies based on the capacity. Ampere Altra Max is 128 cores and is still chugging along while the AmpereOne is at 192 cores.

On the switching side, we are at 51.2Tbps switch silicon, although the 102.4T generation should start to emerge in the next quarter or two. We already showed the Delta DC-90640 A Next-Gen 2025 102.4T Switch.

Leave a Comment