Innfuse Apex B300
8× NVIDIA B300 HGX Server
Overview
The Innfuse Apex B300 is an 8-GPU NVIDIA HGX server with 8× NVIDIA B300 SXM, 288 GB each (2.3 TB HBM3e), NVLink, on Dual Intel Xeon or AMD EPYC with up to 8 TB ECC of memory. It is built and tested by the platform manufacturer, and Innfuse supplies it configured to your order.
Built for
- Multi-GPU training and high-throughput inference
Every Innfuse system includes
- Factory-built and tested by the platform manufacturer
- Configured and supplied to your order
- Ubuntu with CUDA, PyTorch and vLLM preinstalled, or Windows
- Manufacturer warranty on every component
Specifications
Motherboard
Dual CPU server board.
- AMD EPYC 9005/9004 series processors (Socket SP5).
- System on Chip (SoC).
CPU
- AMD EPYC 9005/9004 series processor family
- Dual processors, 5nm
- Up to 192-core, 384 threads per processor
- cTDP up to 500W
Memory
- Up to 3072 GB DDR5 ECC Buffered
- 24 x DIMM slots
- Support DDR5 RDIMM
- 12-Channel memory per processor
NOTE: actual RAM clock speed depends on the CPU specifications and may vary.
LAN
Front:
- 2 x 10Gb/s LAN ports (Intel X710-AT2)
- 1 x 10/100/1000 management LAN (Dedicated IPMI)
Rear:
- 8 x 800 Gb/s OSFP InfiniBand XDR / Dual 400 Gb/s Ethernet, for GPU networking, via NVIDIA ConnectX-8 SuperNIC
Rear (MLAN board - CDB66):
- 1 x 10/100/1000 management LAN (Dedicated IPMI)
Optional:
- 10 Gigabit Dual Port Ethernet (2x RJ45)
- 25 Gigabit Dual Port Ethernet (2x SFP28)
- 200 Gbps Dual Port InfiniBand HDR (Mellanox ConnectX-6 VPI Adapter; 2x QSFP)
- 400 Gbps Single Port InfiniBand NDR (Mellanox ConnectX-7 VPI Adapter; 1x OSFP)
Graphics Cards
8 x NVIDIA HGX B300 GPUs (SXM5)
Storage
- 8 x 2.5" Gen5 NVMe (front hot-swap)
- 1 x M.2 (2280/22110), PCIe Gen3 x4, from CPU_1 (internal)
- 1 x M.2 (2280/22110), PCIe Gen3 x1, from CPU_0 (internal)
Peripheral Drives
N/A
Expansion Slots
- 4 x FHHL x16 (Gen5 x16), from PEX89072
Power Supply
- 12 x 3000W 80 PLUS Titanium redundant power supplies
AC Input:
- 100-127V~/ 14.2A, 50-60Hz
- 200-220V~/ 15.8A, 50-60Hz
- 220-240V~/ 14.9A, 50-60Hz
DC Input:
- 240Vdc/ 14A
DC Output:
- Max 1450W/ 100-127V~
- +54V/ 26.6A
- +12Vsb/ 3A
- Max 2900W/ 200-220V
- +54V/ 53.4A
- +12Vsb/ 3A
- Max 3002.4W/ 220-240V
- +54V/ 55.6A
- +12Vsb/ 3A
NOTE: X9000 G5 comes with 12 x 3000W Redundant (6+6) power supplies. Total 12 power supplies (6 main + 6 backups).
That means that maximum output power is 18000 W (6 x 3000W) with 18000W (6 x 3000W) for backup power supplies.
If one or two power supplies will fail, the other backup power supply starts running to keep the computer powered up.
The switch between the power supplies is seamless, so as not to interrupt the normal use of the computer.
Power cord requirements:
C19 (PSU) to 5-15P (regular US home outlet).
C19 (PSU) to C20 (plug) (PDU).
Dimensions & Weight
Case
- Rackmountable; 8U; horizontal placement
- Height: 13.8 inches (35.1 cm)
- Width: 17.3 inches (44.7 cm)
- Depth: 36.2 inches (92.3 cm)
Shipping Package
- Height: 24.4 inches (62.0 cm)
- Width: 31.5 inches (80.0 cm)
- Length: 47.2 inches (120.0 cm)
- Weight: 185.2 lbs (84.5 kg) (shipped on a pallet)
Motherboard
Dual CPU server board.
- Intel Xeon Scalable Processors LGA 4710 (Socket E2).
- System on Chip.
CPU
- Intel Xeon 6500-Series / 6700-Series Processors
- Dual processors
- Up to 64-core, 128 threads per processor
- cTDP up to 350W
Memory
- Up to 4096 GB DDR5 ECC Buffered
- 32 x DIMM slots
- Support DDR5 RDIMM/MRDIMM
- 8-Channel memory per processor
NOTE: actual RAM clock speed depends on the CPU specifications and may vary.
LAN
Front:
- 2 x 10Gb/s LAN ports (Intel X710-AT2)
- 1 x 10/100/1000 management LAN (Dedicated IPMI)
Rear:
- 8 x 800 Gb/s OSFP InfiniBand XDR / Dual 400 Gb/s Ethernet, for GPU networking, via NVIDIA ConnectX-8 SuperNIC
Rear (MLAN board):
- 1 x 10/100/1000 management LAN (Dedicated IPMI)
Optional:
- 10 Gigabit Dual Port Ethernet (2x RJ45)
- 25 Gigabit Dual Port Ethernet (2x SFP28)
- 200 Gbps Dual Port InfiniBand HDR (Mellanox ConnectX-6 VPI Adapter; 2x QSFP)
- 400 Gbps Single Port InfiniBand NDR (Mellanox ConnectX-7 VPI Adapter; 1x OSFP)
Graphics Cards
8 x NVIDIA B300 GPUs (SXM5)
Storage
- 8 x 2.5" Gen5 NVMe/SATA (front hot-swap)
- 1 x M.2 (2280/22110), PCIe Gen5 x4, from CPU_1 (internal)
- 1 x M.2 (2280/22110), PCIe Gen5 x2, from CPU_1 (internal)
Peripheral Drives
N/A
Expansion Slots
- 4 x FHHL x16 (Gen5 x16), from PEX89072
Power Supply
- 12 x 3000W 80 PLUS Titanium redundant power supplies
AC Input:
- 100-127V~/ 14.2A, 50-60Hz
- 200-220V~/ 15.8A, 50-60Hz
- 220-240V~/ 14.9A, 50-60Hz
DC Input:
- 240Vdc/ 14A
DC Output:
- Max 1450W/ 100-127V~
- +54V/ 26.6A
- +12Vsb/ 3A
- Max 2900W/ 200-220V
- +54V/ 53.4A
- +12Vsb/ 3A
- Max 3002.4W/ 220-240V or 240Vdc Input
- +54V/ 55.6A
- +12Vsb/ 3A
NOTE: X9000 G5 comes with 12 x 3000W Redundant (6+6) power supplies. Total 12 power supplies (6 main + 6 backups).
That means that maximum output power is 18000 W (6 x 3000W) with 18000W (6 x 3000W) for backup power supplies.
If one or two power supplies will fail, the other backup power supply starts running to keep the computer powered up.
The switch between the power supplies is seamless, so as not to interrupt the normal use of the computer.
Power cord requirements:
C19 (PSU) to 5-15P (regular US home outlet).
C19 (PSU) to C20 (plug) (PDU).
Dimensions & Weight
Case
- Rackmountable; 8U; horizontal placement
- Height: 13.8 inches (35.1 cm)
- Width: 17.3 inches (44.7 cm)
- Depth: 36.2 inches (92.3 cm)
Shipping Package
- Height: 24.4 inches (62.0 cm)
- Width: 31.5 inches (80.0 cm)
- Length: 47.2 inches (120.0 cm)
- Weight: 185.2 lbs (84.5 kg) (shipped on a pallet)