Lenovo ThinkSystem SD665-N V3
A single-node, GPU-dense, direct-water-cooled server tray for the ThinkSystem DW612S enclosure, pairing one or two 5th/4th Gen AMD EPYC processors with four NVIDIA H200 or H100 SXM GPUs on NVLink, for large-scale AI training and HPC clusters.
Memory
- Slots
- 24 DIMM (12 per processor)
- Type
- Lenovo TruDDR5 RDIMM, 3DS RDIMM, 9x4 RDIMM
- Speed
- Up to 6400 MT/s (5th Gen EPYC), up to 4800 MT/s (4th Gen EPYC)
- Max
- 3 TB per node (24 x 128 GB 3DS RDIMM)
- Channels
- 12 per processor, 1 DIMM per channel
- Protection
- ECC, SDDC, Patrol/Demand Scrubbing, Bounded Fault, DRAM Address Command Parity with Replay, DRAM Uncorrected ECC Error Retry, On-die ECC, ECS, Post Package Repair
- Persistent memory
- Not supported
Storage
- Drive bays
- Internal, not hot-swap, not front-accessible: 2x E3.S 1T (PCIe 5.0 NVMe), or 2x 7mm 2.5" (PCIe 5.0 NVMe), or 1x 15mm 2.5" (PCIe 5.0 NVMe) - drives connect to CPU 1 only
- Drive support
- NVMe only; SATA and SAS not supported; no hardware RAID
- M.2
- 1x PCIe 4.0 x4 M.2 NVMe boot drive on an adapter mounted above the front processor
- Max capacity
- 30.72 TB (2x 15.36 TB E3.S NVMe); 7.68 TB (2x 3.84 TB 7mm NVMe); 3.84 TB (1x 3.84 TB 15mm NVMe)
- Optical
- No internal bay; external USB drive only
Expansion
- Slots
- None (PCIe lanes are dedicated to the 4 onboard GPUs and networking)
Networking
- Onboard
- 2x 25 Gb Ethernet SFP28 (Mellanox ConnectX-6 Lx, 10/25 Gb); 1x 1 Gb Ethernet RJ45 (Intel I210)
- GPU-direct InfiniBand
- Optional 2x OSFP 800 Gb/s cages providing GPU Direct InfiniBand NDRx2 connectivity via 4 onboard NVIDIA ConnectX-7 controllers (dual 400 Gb or single 800 Gb per cage)
- Shared NIC
- 1 Gb port and 25 Gb port 1 can optionally share with XCC for Wake-on-LAN/NC-SI
Power
- Enclosure supplies
- 6x or 9x 2400W/2600W 230V hot-swap air-cooled (80 PLUS Platinum/Titanium), or 2x or 3x 7200W hot-swap water-cooled (Titanium)
- GPU power modes
- Configurable Total Graphics Power (TGP/EDPc) per node: 700W (max performance), 600W (performance optimized), 500W (power efficiency), set at the factory
- Redundancy
- N+1 or N+N, depending on configuration and node population
- Input
- 200-240V AC nominal, 50/60 Hz
- Power cords
- 1x C19 per air-cooled PSU; 3x C19 per water-cooled PSU
Ports
- Node front
- External diagnostics port; console connector (breakout cable provides 1x VGA, 1x USB 3.1 Gen1 (5 Gb/s), 1x DB9 serial); 2x 25Gb SFP28; 1x 1Gb RJ45; optional 2x OSFP 800Gb
- Enclosure (SMM)
- 2x RJ45 10/100/1000 Ethernet, daisy-chainable across up to 7 enclosures
Physical
- Tray dimensions
- 438 x 41 x 714 mm (17.2 x 1.6 x 28.1 in), 1U tray holding 1 node
- Tray weight
- 23.6 kg (52.0 lb)
- Enclosure
- ThinkSystem DW612S, 6U rack-mounted, 447 x 264 x 933 mm (17.6 x 10.4 x 36.7 in)
- Enclosure capacity
- Up to 6x SD665-N V3 nodes (1 node per tray) per DW612S enclosure
- Enclosure weight
- Empty 24.3 kg (53.5 lb); fully configured 182.9-188.7 kg (403-416 lb) without water manifold
- Cooling
- 5th-generation Lenovo Neptune direct water cooling, fan-less; operating water 2-45 degC (ASHRAE W45), operating air 10-35 degC (ASHRAE A2)
Management
- BMC
- XClarity Controller 2 (XCC2) on ASPEED AST2600
- Enclosure management
- System Management Module (SMM2) in the DW612S enclosure
- Protocols
- IPMI 2.0, SNMP 3.0, Redfish REST API
- Optional
- XCC Platinum: remote KVM, remote media, FIPS 140-3
- Power monitoring
- TI INA226-based power/energy meter, >97% accuracy, 100 Hz sampling
- Video
- Embedded 2D graphics with 16 MB memory in XCC; max 1920x1200 32bpp @ 60 Hz
- Security
- TPM 2.0, power-on/admin passwords, Secure Boot
Operating systems
- Certified
- Red Hat Enterprise Linux, SUSE Linux Enterprise Server, Ubuntu
- Tested
- Rocky Linux
Processors
- AMD EPYC 9135
- AMD EPYC 9175F
- AMD EPYC 9255
- AMD EPYC 9275F
- AMD EPYC 9335
- AMD EPYC 9355
- AMD EPYC 9355P
- AMD EPYC 9365
- AMD EPYC 9375F
- AMD EPYC 9455
- AMD EPYC 9455P
- AMD EPYC 9475F
- AMD EPYC 9535
- AMD EPYC 9555
- AMD EPYC 9555P
- AMD EPYC 9565
- AMD EPYC 9575F
- AMD EPYC 9655
- AMD EPYC 9655P
- AMD EPYC 9645
- AMD EPYC 9745
- AMD EPYC 9825
- AMD EPYC 9845
- AMD EPYC 9124
- AMD EPYC 9174F
- AMD EPYC 9224
- AMD EPYC 9254
- AMD EPYC 9274F
- AMD EPYC 9334
- AMD EPYC 9354
- AMD EPYC 9354P
- AMD EPYC 9374F
- AMD EPYC 9454
- AMD EPYC 9454P
- AMD EPYC 9474F
- AMD EPYC 9534
- AMD EPYC 9554
- AMD EPYC 9554P
- AMD EPYC 9634
- AMD EPYC 9654
- AMD EPYC 9654P
- AMD EPYC 9184X
- AMD EPYC 9384X
- AMD EPYC 9684X
- AMD EPYC 9734
- AMD EPYC 9754