NVIDIA GB300
The NVIDIA GB300 delivers cutting-edge performance for advanced AI workloads, featuring 36 NVIDIA Grace™ CPUs and 72 NVIDIA Blackwell Ultra GPUs. It supports up to 18 TB of LPDDR5X memory with ECC and up to 21 TB of HBM3e, providing a total of up to 40 TB of ultra-fast, low-latency memory. With NVIDIA NVLink™ connectivity offering 130 TB/s GPU-to-GPU communication, the GB300 is optimized for AI reasoning inference and agentic and physical AI, enabling seamless handling of large-scale models and complex computations.
Highlights
Next-Generation AI Supercomputer
- Powered by NVIDIA Blackwell Ultra GPUs and Grace CPUs
- Designed for trillion-parameter LLMs, real-time inference, and scientific computing
Performance
- 50× overall increase in AI factory output performance vs. HGX H100
- 70× more AI FLOPs (FP4 dense) vs. HGX H100
- Supports multiple precision modes: FP4, FP8, INT8, FP16, TF32, FP32, FP64
Memory & Bandwidth
- 21 TB HBM3e memory across 72 GPUs
- Total aggregate 130 TB/s NVLink™ bandwidth via NVSwitch™
Networking & Scalability
- ConnectX-8 NICs providing 800 GB/s networking bandwidth
- Supports multi-node GPU clusters with NVLink™ interconnect
- Designed for hyperscale AI data centers
Enterprise & Cloud Ready
- Designed for multi-tenant cloud and zero-trust environments
- Supports liquid cooling and composable infrastructure
Technical Specifications
| Model | GB300 NVL72 |
|---|---|
| GPU Generation | Blackwell Ultra |
| GPU count | 72 |
| Total FP4 * | 1,100 | 1,440 PFLOPS |
| Total FP8 ** | 720 PFLOPS |
| Total Memory Size | 21TB HBM3e |
| Total Memory Bandwidth | 576TB/s |
| NVLink | 5th Generation |
| GPU-to-GPU Bandwidth | 1.8TB/s |
| Total Aggregate Bandwidth | 130TB/s |
| FP4 * | 15 | 20 PFLOPS |
|---|---|
| FP8 ** | 10 PFLOPS |
| FP16 ** | 5 PFLOPS |
| Memory Size | 288GB HBM3e |
| Memory Bandwidth | 8TB/s |
| Max TDP | 1,400W |
| * Specifications shown are dense / sparse|** Specifications shown is sparse |
Ready to Get Started with NVIDIA GB300 ?
Contact our sales team to learn more about NVIDIA GB300 and get a custom quote tailored to your needs.