Supermicro Top-Loading SuperStorage 6049P-E1CR45L+
45 Hot-Swap 3.5" SAS3/SATA3 Drive Bays with SES3; 2 Rear Hot-Swap 2.5" Drive Bays

Features:

Executive Summary

Supermicro top-loading, capacity-maximized SuperStorage family is ideal to meet growing capacity challenges, with use cases such as object storage, data backup & replication, archive and cold storage, video streaming and surveillance. The complete offering of dense servers and JBOD enclosures provides customers with more choices to deploy massive capacity in a growing software-defined ecosystem.

This paper details the design advantages of Supermicro’s top-loading SuperStorage family and how our density optimized system deliver the highest performance to support data intensive workloads. In addition offering usability features to improved operational efficiency for high capacity storage deployments.

The High Density Storage Challenge

The key benefit of BigTwin is the no-compromise design.  Historically multi-node systems traded off features and capacity for higher density.  They were deployed for workloads that did not require the highest performance or the highest memory density on a single node. The new 2U BigTwin design is a breakthrough multi-node system that supports the highest performing CPUs, full 24 DIMMs of memory and up to 24 all-flash NVMe SSD drives.

Drive for Operational Efficiency
So how does one accommodate a tripling of demand for storage in existing facilities? The answer lies with dense devices packed in high density storage systems.

Comparative cost per GB Comparison with traditional front-loading servers

The acquisition cost per GB of a 4U top-loading storage system is approximately 61% percent lower than a traditional 2U 12-bay system, providing a far more economical storage cost model. With similar system configurations (CPU, memory and etc), the toploading system provides an estimated 249GB per watt better power efficiency advantage, when compared to a traditional 2U 12-bay system. This represents around two and a half times more storage capacity per watt, reducing operating costs in data centers.

The Supermicro Top-loading Advantage

Supermicro’s top-loading storage products are built on best-in-class 12GB/s SAS technology providing optimal performance for all SAS/SATA media including SSDs. In a head-to-head benchmark with a competing 60-bay system, Supermicro’s robust design demonstrates aggregate performance advantages with the greatest flexibility in both media and CPU selection. Supermicro leads the top-loading category with support for dual CPUs up to 205W each and up to 3TB of memory across 24 DIMM slots.

	Other Tier1	Supermicro	Why?
Processor	16-22 cores (80W-165W)	Up to 28 core CPU (205W)	Supports intensive workloads - Ability to do more
Memory	Up to 2 TB (12-16 DIMMs)	Up to 3 TB (24 DIMMs)	Flexible population – From Maximum to Cost Optimized
Networking	Dual 10GBase-T On board	Flexible SIOM networking	More bandwidth – Up to 3x PCI-E 3.0 x16
Disks	60 HDD + 8 NVMe or 36 HDD+24 SSD + 8 NVMe	45 or 60 HDD + SSD + 6 NVMe	More bandwidth – Flexible controller options
Depth (excluding CMA)	42”	26” for 45-bay server & JBOD 30” for 60-bay server & JBOD	Short depth - Fits hyper-scale DC to on premise SMB
Cooling & Vibration	4 fans	5 fans (higher CFM)	Supports More Powerful System - More Performance
Price / Performance	Single vendor HDD support, fixed configuration.	Media from all vendors (off the shelf), flexible configurations.	Configure to order! – Flexible user choices

Supermicro supports the fastest x86 CPU and Memory
While other Tier-1 vendors top-loading systems support limited archival applications the Supermicro Top-loading storage server offers the highest x86 specifications for both CPU and memory, making it an ideal platform for the latest software defined storage applications. Supermicro top-loading storage systems support up to the highest performance Intel Xeon Scalable processors with 205W TDP, providing the more cores at higher base frequencies to deliver optimal system performance for both throughput and IOP intensive workloads.

BigTwin’s 96% Efficiency 2200W Power Stick Design

Balanced System Resources for Maximum I/O
With equivalent I/O bandwidth on both the frontend and backend, users get great performance from the start. This also enables advanced users the ability to configure the hardware and optimize their software to meet their application requirements. With 24 DIMM slots, users have most options for memory population, allowing up to 3TB of memory to be installed or the flexibility to populate with lower capacity DIMMs for the best value / TCO.

Innovative technology
Free floating drive bay design not only eliminate weight and vibration from the drives, it also improve system airflow, which allow lower fan speeds, lower noise, and lower power consumption.

Designed for Efficiency & Performance
The optimized opening of the 3.5” drive bay structure provides the best air flow, allowing for efficient heat transfer to cool the drive. This structure also physically supports the media to reduce stress between the drive bays and the backplane, isolating each bay from the rotational vibration of its neighboring drive bay.

Drive Performance vs Temperature, Supermicro vs Other Tier 1 Competitor

Designed for Mixed Workloads
One of the key server features is the support for up to six NVMe drives. NVMe can deliver a massive performance boost for IOP intensive operations. In application testing using the 45-Bay system with Ceph, we have found that 6x NVMe configured as a fast pool of storage, the NVMe pool has even greater performance than all 45 HDDs. By including NVMe in the design, the Supermicro top-loaders can meet a wider number of application requirements.

Right-depth to Fit Every Rack

The popularity of the mainstream top-loading servers for large scale data centers inspired Supermicro designers to develop a top-loading server family that will fit in any server rack.

The 45- and 60-bay servers offer identical server specification, including Dual Intel Xeon Scalable processors with up to 24 DIMM slots for powerful no-compromise compute performance. The 45-bay server is designed to fit in even the tighest co-location environments with only 26" chassis depth.

A front-mounted LCD control panel gives the status of all critical components such as power supplies, disk drives, network connections, and environmental monitoring. This makes servicing any failed component much faster, as it can be quickly identified and addressed.

SuperStorage Top-Loading 45- or 60-Bay Storage Server (Front View)

Supermicro onboard SIOM offers flexible high performance networking up to 100GbE, Infiniband, OmniPath, and more while simultaneously saving a PCI-E slot for other add-on cards. Three PCI-E slots are provided; two with 16 lanes, and one with 8 lanes.

SuperStorage Top-Loading 45- or 60-Bay Storage Server (Front View)

This combination of processing power, large memory support, NVMe, and SIOM networking, coupled with the capacity of up to 60 drives, allows these storage servers to handle the most demanding applications. Five rear exhaust fans and two power supplies are provided for redundancy, and all are hot-swappable.

Top-loading JBOD enclosures for storage expansion

The 4U top-loading storage enclosures provide JBOD expansion options with the latest SAS3 12Gb/s expander provided industry best available performance and storage density. Storage expansion can lower overall TCO of storage deployments.

These top-loading enclosures feature double-slide rails with cable management arm for easy access to the each drive bay without interrupting system power and network connectivity. With HDD LED indicators on each drive bay, user can easily locate bad drives and tool-less lock/ release clip make the swap of drive a breeze.

Both SuperStorage systems and JBOD enclsoures can be easily managed via a dedicated IPMI interface with SNMP for remote system power on/off control and system monitoring such as backplane and power supply temperature, power supply health status, and fan speed monitor and control. Standard IPMI protocol allows users to manage multiple systems and JBOD enclosures with a single utility.

High Capacity in a Compact Package

The 45- and 60-bay short depth servers are the ultimate storage products for existing infrastructure or limited colocation facilities. The 45-bay with its compact 26-inch depth makes it very easy to deploy in any rack environment. The server will fit in a standard 40” depth standard rack, even accounting for cable arms. This is substantially less depth than other top loading enclosures and even some of the most popular servers in the market place. This allows a more efficient utilization of space in the datacenter, reducing infrastructure costs.

These storage servers are ideal for enterprise applications such as high capacity container and virtual server applications, HPC, and large scale-out object stores such as Ceph. Because of its feature rich Dual CPU/ 24DIMM main board as well as NVMe support it can handle the most demanding environments.

An illustration of server depths in a data center setting

Specifications:

Top-Loading SuperStorage 6049P-E1CR45L+ Specifications
Motherboard	Super X11DSC+
Processor/Cache
CPU	Dual Socket P (LGA 3647) Intel Xeon Scalable Processors, 3 UPI up to 10.4GT/s Support CPU TDP 70-205W
Cores	Up to 28 Cores with Intel HT Technology
System Memory
Memory Capacity	24 DIMM slots Up to 3TB ECC 3DS LRDIMM, 512GB ECC RDIMM, DDR4 up to 2666MHz
Memory Type	2666/2400/2133MHz ECC DDR4 SDRAM
On-Board Devices
Chipset	Intel C621 chipset
SAS	SAS3 (12Gbps) via Broadcom 3616 AOC; IT Mode, x16 SAS Controller
SATA	SATA3 (6Gbps) with RAID 0, 1, 5, 10
IPMI	Support for Intelligent Platform Management Interface v.2.0 IPMI 2.0 with virtual media over LAN and KVM-over-LAN support
Graphics	ASPEED AST2500 BMC
Input / Output
Serial ATA	4 SATA3 (6Gbps) ports
LAN	1 RJ45 Dedicated IPMI LAN port
USB	2 USB 3.0 ports (rear) 1 Type A
VGA	1 VGA D-Sub connector port
Serial Port / Header	1 Fast UART 16550 port / 1 Header
System BIOS
BIOS Type	AMI UEFI
Management
Software	Intel Node Manager IPMI 2.0 NMI SSM, SPM, SUM SuperDoctor 5 Watch Dog
PC Health Monitoring
CPU	Monitors for CPU Cores, Chipset Voltages, Memory. 4+1 Phase-switching voltage regulator
FAN	Fans with tachometer monitoring Status monitor for speed control Pulse Width Modulated (PWM) fan connectors
Temperature	Monitoring for CPU and chassis environment Thermal Control for fan connectors
Chassis
Form Factor	4U Rackmount
Model	CSE-946LTS-R1K66P
Dimensions and Weight
Width	17.2" (437mm)
Height	7" (178mm)
Depth	26" (660mm)
Package	28" (W) x 23" (H) x 42.5" (D)
Weight	Gross Weight: 120 lbs (54.43 kg) Net Weight: 85 lbs (38.56 kg)
Available Colors	Black
Front Panel
Buttons	Power On/Off button System Reset button
LEDs	Power status LED Hard drive activity LED Network activity LEDs System Overheat LED Power fail LED
Expansion Slots
PCI-Express	2 PCI-E 3.0 x16 slots 1 PCI-E 3.0 x8 slot 1 SIOM card support (must bundle with network card)
Drive Bays / Storage
Hot-swap	45 Hot-swap 3.5" SAS3/SATA3 drive bays 2 Rear Hot-swap 2.5" SATA drive bays
Backplane
Backplane	SAS3/SATA3 single expander per backplane
System Cooling
Fans	5 Hot-swap 8cm rear exhaust PWM fans
Power Supply
Power	1600W Redundant Power Supplies with PMBus
Total Output Power	1000W/1600W
Dimension (W x H x L)	73.5 x 40 x 265 mm
Input	100-127Vac / 12.9A Max / 50-60Hz 200-240Vac / 9.5A Max / 50-60Hz
+12V	Max: 82A / Min: 0.1A (100-127Vac) Max: 132A / Min: 0.1A (200-240Vac)
12Vsb	Max: 2A / Min: 0A
Output Type	25 Pairs Gold Finger Connector
Certification	Platinum Level
Operating Environment
RoHS	RoHS Compliant
Environmental Spec.	Operating Temperature: 10°C ~ 35°C (50°F ~ 95°F) Non-operating Temperature: -40°C to 60°C (-40°F to 140°F) Operating Relative Humidity: 8% to 90% (non-condensing) Non-operating Relative Humidity: 5% to 95% (non-condensing)
Compliance
Compliance	FCC, CE, RCM, VCCI, UL and CB

Parts List:

Parts List - (Items Included)
	Part Number	Qty	Description
Motherboard / Chassis	MBD-X11DSC+	1	Super X11DSC+ Motherboard
	CSE-946LTS-R1K66P	1	4U Chassis
Add-on Card / Module	AOM-S3616-L-X11DSC-P	1	16-port SAS PCI x16 Controller (Mezzanine),HF,RoHS
Backplane	BPN-SAS3-826TQ-B2B	1	2-port 2U SAS3 12Gbps backplane, support up to 2x 2.5-inch SAS3/SATA3 HDD/SSD
	BPN-SAS3-946LEL1	1	45-port 4U SC946L Top-load SAS3 12Gbps expander backplane, support up to 45x 3.5-inch SAS3/SATA3 HDD/SSD
Cable 1	CBL-0481L	2	SATA,INT,ROUND,ST-ST,81CM,30AWG
Cable 2	CBL-CDAT-0728	1	4 Pin to 4 Pin I2C cable, 65cm, 26AWG, 4 wires, pinout 1-1, for vpp header(jnvi2c1),RoHS/REACH
Cable 3	CBL-PWCD-0578	2	PWCD,US,IEC60320 C14 TO C13,3FT,14AWG
Cable 4	CBL-PWEX-0863	1	Powerlug to 5.7 Radsok, yel 12AWG, 32cm for SC946S
Cable 5	CBL-PWEX-1024	1	Powerlug to 5.7 Radsok, black 12AWG, 45cm,RoHS
Cable 6	CBL-SAST-1029	2	SLIMLINE SAS to MiniSAS HD,INT,20CM,34AWG
Cable 7	CBL-SAST-1030	2	SLIMLINE SAS to MiniSAS HD,INT,60CM,32AWG
Heatsink / Retention	SNK-P0068PS	2	2U Passive CPU Heat Sink for X11 Purley Platform Equipped with a Narrow Retention Mechanism
Power Supply	PWS-1K66P-1R	2	1U 1600W Redundant Platinum Power Supply 73.5mm width,RoHS/REACH,PBF
FAN 1	FAN-0184L4	5	80x80x38 mm, 14.4K RPM, Rear Exhaust Fan for SC946S Chassis (60-bay)
Rear Window	MCP-240-94601-0N	-	SC946S rear window w/ 3x LP slots for X10DSC+
	MCP-290-00132-0N	-	SIOM dummy cover for 226S/826S/946S
Optional Parts List
	Part Number	Qty	Description
6 NVMe Bays	AOC-SLG3-2E4R MCP-220-94607-0N CBL-SAST-0818 CBL-SAST-0850	1 1 4 2	NVMe AOC SC946S NVMe kits w/ cage, tray, cable, BPN (no NVMe cable)OCuLink v.91,INT,PCIe NVMe SSD, 55CM,34AWG OCuLink to MiniSAS HD V.91, INT, PCIe NVMe SSD, 37CM, 15D15F7D, 34AWG
Global Services & Support	OS4HR3/2/1	-	3/2/1-year onsite 24x7x4 service
	OSNBD3/2/1	-	3/2/1-year onsite NBD service
Software	SFT-OOB-LIC	1	OOB Management Package (per node license)
	SFT-DCMS-Single	1	DataCenter Management Package (per node license)
SIOM Network Card(s)	AOC-MGP-I2 AOC-MGP-I4 AOC-MTG-I2T AOC-MTG-I4T AOC-MTGN-I2S AOC-MTG-I4S	- - - - - -	SIOM 2-port GbE, Intel i350-AM2 SIOM 4-port GbE, Intel i350-AM4 SIOM 2-port 10GBase-T, Intel X550 SIOM 4-port 10GBase-T, Intel X550 SIOM 2-port 10G SFP+, Intel 82599ES SIOM 4-port 10G SFP+, Intel XL710

Views:

Angled View

Top View

Front View

Rear View

Integrated Board:

X11DSC+ (For SuperServer Only)

Key Features

• Intel Xeon Scalable Processors., Dual Socket P (LGA 3647) supported, CPU TDP support 205W, 3 UPI up to 10.4 GT/s
• Intel C621
• Up to 3TB 3DS ECC RDIMM, DDR4-2666MHz; Up to 3TB 3DS ECC LRDIMM, in 24 DIMM slots
• Intel C621 controller for 4 SATA3 (6 Gbps) ports; RAID 0,1,5,10
• Intel Node Manager, IPMI (Intelligent Platform Management Interface) v2.0 with KVM support, KVM with dedicated LAN, NMI, SPM, SSM, SUM, SuperDoctor 5, Watchdog
• 2 PCI-E 3.0 x16, 1 PCI-E 3.0 x8, 1 PCI-E 3.0 x8+x8 for SAS3 Add-On-Module
• 4 PCI-E 3.0 NVMe x4 Internal Port(s)

X11DSC+ Specifications
Physical Stats
Form Factor	Proprietary
Dimensions	16.9" x 11" (42.93cm x 27.94cm)
Processor/Cache (per Node)
CPU	Intel Xeon Scalable Processors. Dual Socket P (LGA 3647) supported, CPU TDP support 205W, 3 UPI up to 10.4 GT/s
Cores / Cache	Up to 28 cores / Up to 60 MB cache
System Memory
Memory Capacity	Up to 3TB 3DS ECC RDIMM, DDR4-2666MHz; Up to 3TB 3DS ECC LRDIMM, in 24 DIMM slots
Memory Type	2666/2400/2133MHz ECC DDR4 RDIMM, LRDIMM
DIMM Sizes	RDIMM: 32GB LRDIMM: 64GB 3DS LRDIMM: 128GB
Memory Voltage	1.2V
Error Detection	Corrects single-bit errors
On-Board Devices
Chipset	Intel C621
SATA	Intel C621 controller for 4 SATA3 (6 Gbps) ports; RAID 0,1,5,10
IPMI	ASPEED AST2500
Network Controllers	N/A
Graphics	Aspeed AST2500 BMC
Input / Output
SATA	2 Flexible LAN expansion via SIOM module
USB	3 USB 3.0 ports (2 rear + 1 Type A)
Video Output	1 VGA D-Sub Connector port
Serial Port / Header	1 COM Port (1 rear)
TPM	1 TPM Header
Expansion Slots
PCI-E	2 PCI-E 3.0 x16, 1 PCI-E 3.0 x8, 1 PCI-E 3.0 x16 for Add-On-Module (AOM)
System BIOS
BIOS Type	AMI 32Mb SPI Flash ROM
BIOS Features	ACPI 6.0
Management
Software	Intel Node Manager, IPMI (Intelligent Platform Management Interface) v2.0 with KVM support, KVM with dedicated LAN, NMI, SPM, SSM, SUM, SuperDoctor 5, Watchdog
Power Configurations	ACPI / ACPM Power Management Power-on mode for AC power recovery
PC Health Monitoring
Voltage	+1.8V, +3.3V, +5V, +5V standby, 5 (4-pin), 5+1 Phase-switching voltage regulator, Chassis intrusion header, Chipset Voltage, Supports system management utility, VBAT
FAN	5x 4-pin fan headers (up to 5 fans), 5 fans with tachometer status monitoring, Pulse Width Modulated (PWM) fan connectors, Status monitoring for speed control
Temperature	N/A
LED	CPU / System Overheat LED, Suspend static indicator LED, UID/Remote UID
Other Features	Chassis intrusion detection, Chassis intrusion header, RoHS
Operating Environment
Operating Temperature Range	10°C - 35°C (50°F - 95°F)
Non-Operating Temperature Range	-40°C - 70°C (-40°F - 158°F)
Operating Relative Humidity Range	8% - 90% (non-condensing)
Non-Operating Relative Humidity Range	5% - 95% (non-condensing)

Videos:

Supermicro SuperMinute: Top Loading Storage Family

At 4U rack space, Supermicro capacity maximized, top-loading family of storage systems are right-sized for every data center deployments with short-depth, easy to deploy 45 Bay, mainstream 60 bay and extreme density 90 bay. With 12 TB hard drives, the top loading storage family delivers over 10 PB capacity per rack.

Documentation:

Download the Supermicro SuperStorage Datasheet (.PDF)