Nvidia will also offer a single rack called the GB300 NVL72 that offers 1.1 exaflops of FP4, 20TB of HBM memory, 40TB of “fast memory,” 130TB/sec of NVLink bandwidth and 14.4 TB/sec networking.

On the near horizon — H2 2025 — Nvidia will release Blackwell Ultra, a GPU that’ll come in several configurations. A single Ultra chip will offer the same 20 petaflops of AI performance as Blackwell, but with 288GB of memory — up from 192GB in vanilla Blackwell.

The Ultra version of Blackwell is the fastest expansion version. Nvidia is also developing its first large server CPU with its own computing cores.