LITEON Shows NVIDIA GB200 NVL72 Rack at OCP Summit 2024
At OCP Summit 2024, the ORv3 rack was a hot topic. NVIDIA took the base ORv3 design and built an MGX AI rack for its high-end AI servers with a few upgrades. LITEON showed up at the OCP Summit this year with a clear message for OEMs, hyper-scalers, and more: Bring your nodes and switches. LITEON has a liquid-cooled rack with power, monitoring, and even CDUs and heat exchangers for high-end AI systems like the NVIDIA GB200 NVL72.
At OCP Summit 2024, this solution caught our eye. There was a NVIDIA MGX 48U rack from LITEON with the 33kW 1U power shelves for this generation.
Moving to the back, was perhaps more interesting. LITEON is selling entire racks with power delivery via the busbar in the rear. For those unfamiliar with the ORv3, this is the latest generation OCP rack, but with a big twist. Instead of the OCP racks we have seen in the past focused on a customer, or a handful of customers, NVIDIA’s focus on building around the ORv3 rack for its GB200 NVL72 means that there is interest in the rack not just from hyper-scalers, but also from many other companies.
There are two key innovations here. First is that busbar for power. Instead of each server having its own individual pair of power supplies, AC power is converted to 48V DC (in the current generation) and then distributed to servers in the rack via a busbar that is engaged when the server is slid into place. The second main innovation is that there are also blind mate liquid cooling nozzles at the back of the rack. As that server is slid into the rack, it can also tap into the rack’s liquid cooling loop. Instead of needing to connect each server individually, this mating of the liquid cooling and power saves time when servicing the systems.
