Need help navigating?
( 0 )

H100 SuperPod – Medium (256 GPUs)

H100 GPU – Medium (256 GPUs)
Accelerate your AI and HPC workloads with the H100 Medium Cluster—powered by 256 NVIDIA H100 GPUs for advanced performance, scalability, and efficiency. Perfect for model training, inference, and enterprise-grade compute at scale.

Start customizing your H100 cluster below to match your workload, integration, and infrastructure needs or simply book a call with one of our IT experts.

47 people are viewing this right now
Talk to an expert

Description

256 x H100 SuperPod Implementation
GPU Cabinets 8 Network Cabinets 2 Storage Cabinets 1 Frontend Network Cabinets + Cables + Transceivers 2
Nodes/cabinet 4 IB trays/cabinet 8 Storage Nodes 4 Switches/cabinet 2
GPUs/node 8 Ports/IB tray (400G) 36 Storage/Node (TB) 500 firewalls 2
CPUs/node 2 Ports/cabinet 288 Storage/cabinet 2000
Transceivers (estimation) 552
Total GPUs 256 Total IB trays 16 Storage switches needed 2
Total CPUs 64 Total Ports (available) 576 Ports used 8 Total switches 18
Total Nodes 32
Total power/cabinet (per kW) 40 Total power/cabinet (per kW) 4.4 Total power/device (per kW) 2.2 Total power/switch device (per kW) 0.5
Total power/firewall device (per kW) 0.3
Total power for GPU cabinets (per kW) 320 Total power for IB cabinets (per kW) 8.8 Total power for Storage cabinets (per kW) 8.8 Total power for frontend network cabinet (per kW) 10.6
Cost per cabinet – Cables (USD) $25,000.00
Total Power for 256 x H100 (kW) 348.2
Cost per cabinet – Transceivers – GPU Cabinets (USD) $100,000.00
Cost per cabinet (USD) $265,000.00 Cost per cabinet (USD) $405,000.00 Cost per cabinet (USD) $1,605,000.00 Cost per cabinet (USD) $275,000.00
Cost for the SuperPod (USD) $6,210,000.00

Additional information

H100 - Cabinet

GPUs: 256, Nodes: 32, GPUs/Node: 8, CPU/Node: 2

Infiniband Networking (Mellanox)

IB trays/cabinet: 8, Port/IB tray (100G): 144, Port/IB tray (400G): 36

Performance Storage (DDN Storage - AI400X2)

Storage (PB): 2, Storage devices: 4, Storage per device (TB): 500

Frontend and Perimeter

Switches per GPU cabinet: 2, Firewalls per cluster: 2

Customers Reviews

There are no reviews yet.

Be the first to review “H100 SuperPod – Medium (256 GPUs)”
Review now to get coupon!

Your email address will not be published. Required fields are marked *

Back to Top
Product has been added to your cart