This is the Next-Gen NVIDIA ConnectX-8 SuperNIC for 800Gbps Networking

At SC24, we saw the final form of a card that we have been seeing mock-ups of for some time. Apparently, the new NVIDIA ConnectX-8 is going to look a lot more like a GPU than a simple network card of years past.

Something you will immediately notice is that this looks more like a low-profile NVIDIA GPU than a traditional NIC where perhaps we might see a heatsink.

Something notable on the back was this connector. First, the NIC needs airflow so it is interesting there is a big connector on the back for a cable. Second, we asked if this was more of a multi-host cable connection, perhaps for connecting a second CPU or if it was a PCIe switch output. An 800Gbps NIC requires PCIe Gen6 x16 or two Gen5 x16 links to push sufficient bandwidth. Since we still have PCIe Gen5 CPUs in the market, that means this NIC is faster than a single CPU can realistically push. For generations we have seen NICs that offer a second PCIe x16 connection to a second CPU in order to provide one link to a system while giving both CPUs in that system direct network access. Also, in NVIDIA Grace platforms, the company has had to use its NICs as a way to provide auxiliary connectivity to some devices due to limitations of Grace CPUs. Using a NIC is a way to keep Broadcom products out of some NVIDIA Grace servers.

It was great seeing the new card at SC24. It also looks very different from current Broadcom based-offerings. We have shown the Broadcom 400GbE NICs many times that look much more like traditional NIC designs. Even the AMD Pensando Pollara 400 UltraEthernet RDMA NIC looks like it is from an older generation. It may seem small, but visually, NVIDIA networking is going to look great in servers compared to its Broadcom and AMD competition (perhaps Intel will get back in the NIC game at some point as well.) That made it a lot of fun to see.

Leave a Comment