Lenovo ThinkSystem SR680a V4
Lenovo's 8U air-cooled AI server (machine type 7DMK) with two Intel Xeon 6700-series "Granite Rapids" processors and an integrated 8-GPU NVIDIA HGX B300 NVL8 complex (288 GB HBM3e per GPU), eight 800 Gb/s OSFP GPU-Direct network ports, up to 4 TB of DDR5, and 8 x 2.5-inch PCIe 5.0 NVMe drive bays. Built for large-scale generative-AI training and inference.
Memory
- Slots
- 32 DIMM (16 per processor; 8 channels per CPU, 2 DIMMs per channel)
- Types
- Lenovo TruDDR5 RDIMM: 64 GB, 96 GB, 128 GB (x4); all installed DIMMs must be identical part numbers
- Speed
- 1 DPC up to 6400 MHz; 2 DPC (RDIMM) up to 5200 MHz
- Max
- 4 TB using 32 x 128 GB RDIMMs and two processors
- Protection
- ECC, SDDC and ADDDC (x4-based DIMMs), memory mirroring
Storage
- Front bays
- 8 x 2.5" hot-swap drive bays on a single 8-bay backplane, PCIe 5.0 x4 NVMe per drive
- Boot
- 1 or 2 front hot-swap M.2 2280 NVMe drives with integrated RAID (Broadcom-based B550p/B540p adapter)
- Capacity
- Up to 122.88 TB using 8 x 15.36 TB 2.5" NVMe SSDs
- Controller
- Onboard PCIe 5.0 x4 NVMe per drive, integrated in the processor; JBOD only, no RAID; no VROC on the 2.5" bays
- Encryption
- SED-capable drives supported; "encryption-ready" configurator option requires XCC3 Premier
Graphics
- GPU board
- NVIDIA HGX B300 NVL8 8-GPU complex, integrated in the lower half of the chassis (feature CBAG)
- Per-GPU spec
- NVIDIA SXM6 B300: 288 GB HBM3e, 7.7 TB/s bandwidth, 1100 W TDP, up to 7 MIGs @ 34 GB
- Performance (per GPU)
- 75 TFLOPS FP32; 2,250 TFLOPS TF32 Tensor; 4,500 TFLOPS BF16/FP16 Tensor*; 9,000 TFLOPS FP8 Tensor*; 18,000 TFLOPS FP4 Tensor*; 375 TOPS INT8* (* with structural sparsity)
- Interconnect
- NVLink between GPUs 1.8 TB/s full mesh; NVLink to CPUs 450 GB/s per GPU; PCIe Gen6 x16 256 GB/s per GPU
Expansion
- Slot 1 (OCP)
- PCIe 5.0 x16, connected to CPU 1; dedicated OCP 3.0 slot, tool-less thumbscrew/pull-tab, shared BMC network sideband
- Slot 2
- PCIe 5.0 x16 FHHL, connected to CPU 1
- Slot 3
- PCIe 5.0 x16 FHHL, connected to CPU 2
- Slot 4
- PCIe 5.0 x16 FHHL, connected to CPU 1
- Slot 5
- PCIe 5.0 x16 FHHL, connected to CPU 2
- Layout
- All 4 PCIe slots plus the OCP slot are located at the front of the server
- GPU networking
- 8 x front-accessible OSFP cages wired to 8 integrated NVIDIA ConnectX-8 switches on the GPU board, each cage up to 800 Gb/s InfiniBand or Ethernet (GPU Direct)
Networking
- OCP adapters (Slot 1)
- ThinkSystem Mellanox ConnectX-6 Lx 10/25GbE SFP28 2-port; Nvidia ConnectX-6 Dx 100GbE QSFP56 2-port
- PCIe adapters (Slots 2-5)
- Intel X710-T2L/T4L 10GBASE-T; Mellanox ConnectX-6 Lx 10/25GbE SFP28; Mellanox ConnectX-6 Dx 100GbE QSFP56
- GPU-Direct fabric
- 8 x OSFP 800 Gb/s ports via integrated ConnectX-8 switches; NDR/XDR optical transceivers and DAC/optical cables offered by Lenovo
- Management
- 1 x RJ-45 1GbE XClarity Controller port, front-mounted
Power
- PSU options
- 3200 W 230V/115V AC Titanium (C19 connector) or 3800 W HVAC/HVDC Titanium (2007G connector); all PSUs in a server must be identical
- Quantity
- 6 or 8 hot-swap power supplies
- Redundancy
- 3200 W AC: N+1 with 6 or 8 installed. 3800 W HVAC/HVDC: N+1 with 6 or 8 installed; N+N with 8 installed and input above 249V AC / 260V DC
- Input (3200W AC)
- 200-240V AC nominal (180-300 VDC China only); 200V AC 15A (max 2700W output), 230V AC 15.3A, 240V AC 14.5A
- Input (3800W HVAC)
- 200-277V AC / 240-380 VDC; up to 16A at 200V AC
- Cooling
- 6 x front dual-rotor 60 mm fans (CPU/memory/slots, N+1) at up to 20.9K RPM; 15 x rear dual-rotor 80 mm fans (GPUs/drives/PCIe switches, N+1) at up to 19.5K RPM; a fan in each PSU; max airflow 1777 CFM
Ports
- Front
- 4 x USB 3 (5 Gb/s, one shared with XCC local management), 1 x VGA video, 1 x RJ-45 1GbE XCC management port, 1 x front Mini DisplayPort video (max 1920x1200 @ 60Hz)
- Rear
- None; all I/O is front-accessible
Physical
- Form factor
- 8U rack
- Dimensions
- 447 mm W x 351 mm H x 924 mm D (17.6 x 13.8 x 36.3 in); 483 mm across front EIA flanges
- Weight
- Maximum 124.7 kg (275 lb)
- Machine type
- 7DMK, 3-year warranty
- Environment
- ASHRAE Class A2 (10-35 C); max altitude 3,050 m
Management
- BMC
- XClarity Controller 3 (XCC3), OpenBMC-based on an ASPEED AST2600 controller (dual-core ARM Cortex A7 @ 1.2 GHz); includes XCC3 Premier (remote KVM, virtual media, boot capture, Neighbor Groups, System Guard, CNSA/FIPS 140-3 modes)
- Local
- Integrated Diagnostics Panel with pull-out LCD display and status LEDs; MicroSD slot on the System I/O Board for extra XCC RDOC/firmware storage
- Interfaces
- IPMI 2.0, SNMPv3 (no SNMP v1/SET), CIM-XML, Redfish REST API, serial-over-LAN
- Software
- XClarity Provisioning Manager, XClarity One, XClarity Administrator, XClarity Orchestrator, XClarity Integrator plugins, XClarity Energy Manager, XClarity Mobile (via front management USB port)
- Security
- Power-on and administrator passwords; Root of Trust module (TPM 2.0 + Platform Firmware Resiliency / NIST SP800-193)
Operating systems
- Supported
- Red Hat Enterprise Linux 9.6, Ubuntu Server 24.04 LTS
Processors
- Intel Xeon 6740P
- Intel Xeon 6747P
- Intel Xeon 6760P
- Intel Xeon 6767P
- Intel Xeon 6776P
- Intel Xeon 6787P