Dell PowerEdge XE8640
Dell's 2-socket, 4U Intel Xeon Scalable server with 4 NVIDIA HGX H100 SXM5 GPUs fully interconnected with NVLink, liquid-assisted air cooling for the GPUs, and DDR5/PCIe Gen5/NVMe I/O for AI training, inferencing, and HPC modeling and simulation.
Memory
- Slots
- 32 DDR5 DIMM (16 per socket, 8 channels/socket, 2 DIMMs/channel)
- Max
- 4 TB
- Speed
- Up to 5600 MT/s 1DPC / 4400 MT/s 2DPC (5th Gen Xeon); up to 4800 MT/s 1DPC (4th Gen Xeon)
- Type
- Registered ECC DDR5 RDIMM only
Storage
- Bays
- Up to 8 x 2.5" SATA/SAS/NVMe SSD, or up to 8 x E3.S NVMe SSD, max 122.88 TB
- Controllers
- PERC H965i internal controller; Software RAID S160; internal boot BOSS-N1 (NVMe, HWRAID 1, 2 x M.2 SSDs)
Graphics
- Options
- 4 x NVIDIA HGX H100 80GB 700W SXM5 GPUs, fully interconnected with NVIDIA NVLink, up to 900 GB/s GPU-GPU bandwidth; supports NVIDIA Multi-Instance GPU (MIG) and GPUDirect Storage (GDS)
Expansion
- Slots
- Up to 4 PCIe Gen5 x16 slots (2-CPU configuration)
- OCP
- 1 x OCP NIC 3.0 slot (x8 PCIe lanes)
Networking
- Embedded NIC
- 2 x 1 GbE
- OCP
- 1 x OCP 3.0 card (optional)
Power
- Supplies
- Redundant hot-swap: 2800 W Titanium (200-240 V AC or 240 V DC), or 3200 W Titanium (277 V AC or 260-400 V DC)
- Cooling
- Air cooling for processors; liquid-assisted air cooling for GPUs (no facility water required); up to 6 standard fans in mid tray plus up to 5 high-performance Gold-grade fans on the front, all hot-swap; rated up to 35 degC ambient
Ports
- Front
- 1 x iDRAC Direct (Micro-AB USB), 1 x USB 2.0, 1 x VGA
- Rear
- 1 x USB 2.0, 1 x USB 3.0, 1 x VGA, 1 x RJ45 dedicated iDRAC9 Ethernet port
Physical
- Dimensions
- 174.3 mm H (6.86 in) x 481.91 mm W (18.97 in) x 901.4 mm D with bezel (865.54 mm without bezel)
- Weight
- 61.4 kg (135.36 lb)
- Form factor
- 4U rack server
- Bezel
- Optional LCD bezel or security bezel
Management
- Embedded
- iDRAC9, iDRAC Direct, iDRAC RESTful API with Redfish, iDRAC Service Module
- Console
- OpenManage Enterprise, CloudIQ for PowerEdge plugin, OpenManage Power Manager, OpenManage Update Manager, OpenManage Service plugin, integrations for VMware vCenter, Microsoft System Center, Windows Admin Center
- Integrations
- BMC Truesight, ServiceNow, Red Hat Ansible Modules, Terraform Providers, VMware vRealize Operations Manager
- Security
- Cryptographically signed firmware, Data at Rest Encryption (SEDs), Secure Boot, Secured Component Verification, Secure Erase, Silicon Root of Trust, System Lockdown (requires iDRAC9 Enterprise/Datacenter), TPM 2.0 FIPS/CC-TCG certified (TPM 2.0 China NationZ variant)
Operating systems
- Supported
- Canonical Ubuntu Server LTS, Red Hat Enterprise Linux
Processors
- Intel Xeon Platinum 8592+
- Intel Xeon Platinum 8580
- Intel Xeon Platinum 8568Y+
- Intel Xeon Platinum 8562Y+
- Intel Xeon Platinum 8480+
- Intel Xeon Platinum 8470
- Intel Xeon Platinum 8468
- Intel Xeon Platinum 8462Y+
- Intel Xeon Platinum 8460Y+
- Intel Xeon Platinum 8452Y
- Intel Xeon Gold 6548Y+
- Intel Xeon Gold 6542Y
- Intel Xeon Gold 6448Y
- Intel Xeon Gold 6442Y
- Intel Xeon Gold 5418Y