====== GPU Datasheet ====== {{tag>datasheet}} ^ Brand ^ Model ^ GPU Memory ^ Memory ECC ^ Memory Bandwidth ^ Max Power Consumption ^ Host Interface (BW) ^ GPU-to-GPU Peer Interconnect (BW) ^ Slot Width ^ GPU Height/Length ^ Auxiliary Cable ^ Workload ^ | AMD | MI300X OAM | 192 GB HBM3 | Y | 5.3 TB/sec | 750W | PCIe Gen5x16 (128 GB/sec) | Infinity Fabric Link (4th Gen- 896 GB/sec) | N/A | N/A | N/A | AI / HPC | | AMD | MI210 | 64 GB HBM2e | Y | 1638 GB/sec | 300W | PCIe Gen4x16 (64 GB/sec) | Infinity Fabric Link bridge8 | DW | FHFL | CPU 8 pin | HPC/Machine learning training | | Intel | Gaudi3 PCIe | 128GB HBM3 | Y | 3.7 TB/s |  600W | PCIe Gen5x16 (128 GB/sec) | 3x200G RoCE | DW | FHFL | | AI / HPC | | Intel | Gaudi3 OAM | 128GB HBM3 | Y | 3.6TB/s | 850W | PCIe Gen5x16 (128 GB/sec) | 3x200G RoCE | N/A | N/A | N/A | AI / HPC | | Intel | Max1550 OAM | 128 GB HBM2e | Y | 3276.8 GB/sec | 600W | PCIe Gen5x16 (128 GB/sec) | Intel XeLink | N/A | N/A | N/A | AI / HPC | | Intel | Max1100 | 48 GB HBM2e | Y | 1228.8 GB/sec | 300W | PCIe Gen5x16 (128 GB/sec) | XeLink bridge8 (600GB/s) | DW | FHFL | PCIe 16 pin | AI / HPC | | Intel | Flex 140 | 12 GB GDDR6 | Y | 336 GB/Sec | 75W | PCIe Gen4 x8 (32 GB/sec) | XeLink bridge8 (336 GB/sec) | SW | HHHL/FHHL | N/A | Inferencing/Edge | | Nvidia | [[enterprise:nvidia:description:hopper:h200_nvl|H200 NVL]] | 141GB HBM3e | Y | 4.8 TB/s | 600W | PCIe Gen 5x16 (128 GB/sec) | NVLink (4th Gen - 900 GB/s) | DW | FHFL | PCIe 16 pin | AI / HPC | | Nvidia | [[enterprise:nvidia:description:h100_nvl|H100 NVL]] | 94 GB HBM3 | Y | 3.9 TB/s | 350W- 400W | PCIe Gen 5x16 (128 GB/sec) | NVLink (4th Gen - 600 GB/s) | DW | FHFL | PCIe 16 pin | AI / HPC | | Nvidia | [[enterprise:nvidia:description:B200_dlc|B200 DLC]] | 180 GB | Y | | | PCIe Gen 5x16 (128 GB/sec) | NVLink (4th Gen - 600 GB/s) | | | | | | Nvidia | H200 SXM5 (x8) DLC | 141GB HBM3e | Y | 4.8 TB/s | 700W | PCIe Gen 5x16 (128 GB/sec) | NVLink (4th Gen - 900 GB/s) | DW | | | AI / HPC | | Nvidia | [[enterprise:nvidia:description:h200_sxm5|H200 SXM5 (x8)]] | 141GB HBM3e | Y | 4.8 TB/s | 700W | PCIe Gen 5x16 (128 GB/sec) | NVLink (4th Gen - 900 GB/s) | N/A | N/A | N/A | AI / HPC | | Nvidia | [[enterprise:nvidia:description:h100_sxm5|H100 SXM5 (x8)]] | 80 GB HBM3 | Y | 3 TB/sec | 700W | PCIe Gen 5x16 (128 GB/sec) | NVLink (4th Gen - 900 GB/s) | N/A | N/A | N/A | AI / HPC | | Nvidia | [[enterprise:nvidia:description:h100_sxm5|H100 SXM5 (x4)]] | 80 GB HBM3 | Y | 3 TB/sec | 700W | PCIe Gen 5x16 (128 GB/sec) | NVLink (4th Gen - 900 GB/s) | N/A | N/A | N/A | AI / HPC | | Nvidia | A100 SXM4 (x8) | 80 GB HBM2 | Y | 2039 GB/sec | 500W | PCIe Gen 5x16 (128 GB/sec) | NVLink (3rd Gen - 600 GB/s) | N/A | N/A | N/A | HPC/AI/Database Analytics | | Nvidia | A100 SXM4 (x4) | 80 GB HBM2 | Y | 2039 GB/sec | 500W | PCIe Gen 5x16 (128 GB/sec) | NVLink (3rd Gen - 600 GB/s) | N/A | N/A | N/A | HPC/AI/Database Analytics | | Nvidia | A100 SXM4 (x4) | 40 GB HBM2 | Y | 1555 GB/sec | 400W | PCIe Gen 5x16 (128 GB/sec) | NVLink (3rd Gen - 600 GB/s) | N/A | N/A | N/A | HPC/AI/Database Analytics | | Nvidia | [[enterprise:nvidia:description:hopper:h100|H100]] | 80 GB HBM2e | Y | 2000 GB/sec | 300-350W | PCIe Gen 5x16 (128 GB/sec) | NVLink8 (4th Gen - 600 GB/s) | DW | FHFL | PCIe 16 pin | HPC/AI/Database Analytics | | Nvidia | A100 | 80 GB HBM2e | Y | 1935 GB/sec | 300W | PCIe Gen4 x16 ( 64 GB/sec) | NVLink8 (3rd Gen - 600 GB/s) | DW | FHFL | CPU 8 pin | HPC/AI/Database Analytics | | Nvidia | L40S | 48 GB GDDR6 | Y | 864 GB/sec | 350W | PCIe Gen4 x16 ( 64 GB/sec) | N/A | DW | FHFL | PCIe 16 pin | AI/Performance graphics/VDI | | Nvidia | A30 | 24 GB HBM2 | Y | 933 GB/sec | 165W | PCIe Gen4 x16 ( 64 GB/sec) | NVLink8 (3rd Gen - 200 GB/s) | DW | FHFL | CPU 8 pin | mainstream AI | | Nvidia | L40 | 48 GB GDDR6 | Y | 864 GB/sec | 300W | PCIe Gen4 x16 ( 64 GB/sec) | N/A | DW | FHFL | PCIe 16 pin | Performance graphics/VDI | | Nvidia | A40 | 48 GB GDDR6 | Y | 696 GB/sec | 300W | PCIe Gen4 x16 ( 64 GB/sec) | NVLink bridge8 (3rd Gen-112.5 GB/s) | DW | FHFL | CPU 8 pin | Performance graphics/VDI | | Nvidia | A16 | 64 GB GDDR6 | Y | 800 GB/sec | 250W | PCIe Gen4 x16 (64GB/sec) | N/A | DW | FHFL | CPU 8 pin | VDI | | Nvidia | L4 | 24 GB GDDR6 | Y | 300 GB/s  | 72W | PCIe Gen4 x16 (64GB/sec) | N/A | SW | HHHL | N/A | Inferencing/Edge/VDI | | Nvidia | L4 | 24 GB GDDR6 | Y | 300 GB/s  | 72W | PCIe Gen4 x16 (64GB/sec) | N/A | SW | FHHL | N/A | Inferencing/Edge/VDI | | Nvidia | A2 | 16 GB GDDR6 | Y | 200 GB/sec | 60W | PCIe Gen 4x8 | N/A | SW | HHHL | N/A | Inferencing/Edge/VDI | | Nvidia | A2 (v2) | 16 GB GDDR6 | Y | 200 GB/sec | 60W | PCIe Gen4 x8 (32 GB/sec) | N/A | SW | HHHL | N/A | Inferencing/Edge/VDI | | Nvidia | A2 | 16 GB GDDR6 | Y | 200 GB/sec | 60W | PCIe Gen4 x8 (32 GB/sec) | N/A | SW | FHHL | N/A | Inferencing/Edge/VDI | | Nvidia | A2 (v2) | 16 GB GDDR6 | Y | 200 GB/sec | 60W | PCIe Gen4 x8 (32 GB/sec) | N/A | SW | FHHL | N/A | Inferencing/Edge/VDI | | Nvidia | A10 | 24 GB GDDR6 | Y | 600 GB/sec | 150W | PCIe Gen4 x16 (64GB/sec) | N/A | SW | FHFL | PCIe 8 pin | mainstream graphics/VDI | | Nvidia | T4 | 16 GB GDDR6 | Y | 300 GB/sec | 70W | PCIe Gen3 x16 (32GB/sec) | N/A | SW | HHHL | N/A | Inferencing/Edge/VDI | | Nvidia | T4 | 16 GB GDDR6 | Y | 300 GB/sec | 70W | PCIe Gen3 x16 (32GB/sec) | N/A | SW | FHHL | N/A | Inferencing/Edge/VDI | | AMD | MI100 | 32 GB HBM2 | Y | 1228 GB/sec | 300W | PCIe Gen4 x16 | 64 GB/sec (PCIe 4.0) | DW | FHFL | PCIe 8 pin | HPC/Machine learning training | | Nvidia | M10 | 32 GB GDDR5 | N | 332 GB/sec | 225W | PCIe Gen3x16 | 32 GB/sec (PCIe 3.0) | DW | FHFL | PCIe 8 pin | VDI | | Nvidia | A100 | 40 GB HBM2 | Y | 1555 GB/sec | 250W | PCIe Gen4x16/ NVLink bridge8 | 64 GB/sec5 (PCIe 4.0) | DW | FHFL | CPU 8 pin | HPC/AI/Database Analytics | | Nvidia | V100S | 32 GB HBM2 | Y | 1134 GB/sec | 250W | PCIe Gen3x16 | 32 GB/sec (PCIe 3.0) | DW | FHFL | CPU 8 pin | HPC/AI/Database Analytics | | Nvidia | V100 | 32 GB HBM2 | Y | 900 GB/sec | 250W | PCIe Gen3x16 | 32 GB/sec (PCIe 3.0) | DW | FHFL | CPU 8 pin | HPC/AI/Database Analytics | | Nvidia | V100 | 16 GB HBM2 | Y | 900 GB/sec | 250W | PCIe Gen3x16 | 32 GB/sec (PCIe 3.0) | DW | FHFL | CPU 8 pin | HPC/AI/Database Analytics | | Nvidia | V100 | 32 GB HBM2 | Y | 900 GB/sec | 300W | NVIDIA NVLink | 300 GB/sec (2nd Gen NVLink) | N/A | N/A | N/A | HPC/AI/Database Analytics | | Nvidia | V100 | 16 GB HBM2 | Y | 900 GB/sec | 300W | NVIDIA NVLink | 300 GB/sec (2nd Gen NVLink) | N/A | N/A | N/A | HPC/AI/Database Analytics | | Nvidia | RTX6000 | 24 GB GDDR6 | Y | 624 GB/sec | 250W | PCIe Gen3x16/ NVLink bridge3 | 32 GB/sec3 (PCIe 3.0) | DW | FHFL | CPU 8 pin | VDI/ Performance Graphics | | Nvidia | RTX8000 | 48 GB GDDR6 | Y | 624 GB/sec | 250W | PCIe Gen3x16/ NVLink bridge3 | 32 GB/sec3 (PCIe 3.0) | DW | FHFL | CPU 8 pin | VDI/ Performance Graphics | | Nvidia | P100 | 16 GB HBM2 | Y | 732 GB/sec | 300W | NVIDIA NVlink | 160 GB/sec (1st Gen NVLink) | N/A | N/A | N/A | HPC/AI/Database Analytics | | Nvidia | P100 | 16 GB HBM | Y | 732 GB/sec | 250W | PCIe Gen3x16 | 32 GB/sec (PCIe 3.0) | DW | FHFL | CPU 8 pin | HPC/AI/Database Analytics | | Nvidia | P100 | 12 GB HBM2 | Y | 549 GB/sec | 250W | PCIe Gen3x16 | 32 GB/sec (PCIe 3.0) | DW | FHFL | CPU 8 pin | HPC/AI/Database Analytics | | Nvidia | P40 | 24 GB DDR5 | N | 346 GB/sec | 250W | PCIe Gen3x16 | 32 GB/sec (PCIe 3.0) | DW | FHFL | CPU 8 pin | HPC/AI/Database Analytics | {{page>enterprise:nvidia:description:gpu&permalink}}