Need help navigating?
( 0 )

H100 SuperPod – Large (1000 GPUs)

H100 GPU – SuperPOD Large (1,000 GPUs)
Experience unmatched AI supercomputing with the H100 SuperPOD Large—featuring 1,000 NVIDIA H100 GPUs engineered for training large language models, generative AI, and complex simulations at hyperscale. Built for enterprises pushing the boundaries of performance.

Customize your SuperPOD below to align with your compute, networking, and deployment strategy or simply book a call with one of our IT experts.

20 people are viewing this right now
Talk to an expert

Description

1000 x H100 SuperPod Implementation
GPU Cabinets 32 Network Cabinets 4 Storage Cabinets 1 Frontend Network Cabinets + Cables + Transceivers 5
Nodes/cabinet 4 IB trays/cabinet 32 Storage Nodes 8 Swithces/cabinet 16
GPUs/node 8 Ports/IB tray (400G) 36 Storage/Node (TB) 500 firewalls 2
CPUs/node 2 Ports/cabinet 1152 Storage/cabinet 4000
Transceivers (estimation) 5220
Total GPUs 1024 Total IB trays 128 Storage switches needed 2
Total CPUs 256 Total Ports (available) 4608 Ports used 16 Total switches 80
Total Nodes 128
Total power/cabinet (per kW) 40 Total power/cabinet (per kW) 17.6 Total power/device (per kW) 2.2 Total power/switch device (per kW) 0.5
Total power/firewall device (per kW) 0.3
Total power for GPU cabinets (per kW) 1280 Total power for IB cabinets (per kW) 70.4 Total power for Storage cabinets (per kW) 17.6 Total power for frontend network cabinet (per kW) 48.6
Cost per cabinet – Cables (USD) $70,000.00
Total Power for 1000 x H100 (kW) 1416.6
Cost per cabinet – Transceivers – GPU Cabinets (USD) $550,000.00
Cost per cabinet (USD) $265,000.00 Cost per cabinet (USD) $1,605,000.00 Cost per cabinet (USD) $3,105,000.00 Cost per cabinet (USD) $1,225,000.00
Cost for the SuperPod (USD) $45,180,000.00

Additional information

H100 - Cabinet

GPUs: 1024, Nodes: 128, GPUs/Node: 8, CPU/Node: 2

Infiniband Networking (Mellanox)

IB trays/cabinet: 9, Port/IB tray (100G): 144, Port/IB tray (400G): 36

Performance Storage (DDN Storage - AI400X2)

Storage (PB): 4, Storage devices: 8, Storage per device (TB): 500

Frontend and Perimeter

Switches per GPU cabinet: 2, Firewalls per cluster: 2

Customers Reviews

There are no reviews yet.

Be the first to review “H100 SuperPod – Large (1000 GPUs)”
Review now to get coupon!

Your email address will not be published. Required fields are marked *

Back to Top
Product has been added to your cart