Nvidia will also offer a single rack called the GB300 NVL72 that offers 1.1 exaflops of FP4, 20TB of HBM memory, 40TB of “fast memory,” 130TB/sec of NVLink bandwidth and 14.4 TB/sec networking.

On the near horizon — H2 2025 — Nvidia will release Blackwell Ultra, a GPU that’ll come in several configurations. A single Ultra chip will offer the same 20 petaflops of AI performance as Blackwell, but with 288GB of memory — up from 192GB in vanilla Blackwell.

The industry needs 100 times more than we thought we needed this time last year,” said Nvidia founder and CEO Jensen Huang, emphasising the insatiable demand for AI computing power. The Blackwell Ultra GB300,