Nvidia just lately unveiled its DGX GB200 NVL72 supercomputer in a rack at Nvidia GTC 2024 and Patrick Kennedy at Serve the Home took a choice of nice photographs exhibiting the spectacular beast.
The identify of the DGX GB200 NVL72 tells you a whole lot of what it’s essential to know. The GB200 stands for the Grace Blackwell GB200 compute body, whereas the NVL72 denotes that there are 72 Blackwell GPUs related by NVLink.
The Blackwell platform accommodates 208 billion transistors in its two GPUs. These are related by 10 TB/second chip-to-chip hyperlink in a single unified GPU. Blackwell, scheduled to ship later this yr, will provide as much as 20 petaflops of FP4 energy and can be as much as 30 instances quicker than Hopper for AI inference duties.
Energy load of 120 kW
The rack-scale system includes ten compute nodes on the prime of the stack, every with twin Infiniband ports, 4 E1.S drive trays, and administration ports. Every node is powered by two Grace Arm CPUs related to 2 Blackwell GPUs. Underneath these nodes are 9 NVSwitch cabinets, with gold handles for straightforward elimination.
The again of the rack reveals the facility supply system designed for blind-mate energy by way of the bus bar, liquid cooling nozzles, and NVLink connections for every part. This setup permits for slight motion to make sure a correct blind match.
DGX GB200 NVL72 weighs 1.36 metric tons (3,000 lbs) and consumes 120kW, an influence load that Serve the Home level, not all knowledge facilities will be capable of deal with it. Since many can solely assist a most of 60kW racks, a future half-stack system appears a chance. The rack makes use of 2 miles (3.2 km) of copper cabling as an alternative of optics to decrease the system's energy output by 20kW.
You possibly can see the remainder of the photographs taken by Kennedy at GTC 2024 right here.
