Disk Drive Performance Becoming Insufficient

The latest crop of nearly SAS enterprise drives (aka enterprise SATA drives) gets between 108 MiB/sec and 132 MiB/sec of performance, while some of the fastest RAID controllers get around 40 GiB/sec. When you do the math on this, you see that the number of disk drives required to sustain this performance equals:

Near-Line Disk Average Performance

Enterprise 2.5-Inch Average Performance

20 GiB/sec controller



40 GiB/sec controller



If you take these numbers and multiply them by the size of the largest disk drives from those categories you get:

Amount of Storage

Amount of Storage in TB





This is not a great deal of storage, especially if you are considering enterprise 2.5 inch SAS drives. Only 220 TB of space sustains the bandwidth of the 40 GiB/sec controllers. No, of course you are not going to achieve 100 percent of the bandwidth of the drives, and I am using average performance, not the performance of the inner cylinders. However, the picture is clear in my opinion, and controller bandwidth has not kept up with disk performance and density. The question is, what does this mean for the future design of controllers? Ten years ago we still had large SMP machines from a number of vendors.

My understanding is that the biggest cost for those machines was designing the memory interconnect. Today, most of those machines have been replaced by machines with NUMA memory. Interconnect performance is far less than a standard SMP of yesteryears. The new Quadcore SandyBridge/Romley systems have great I/O bandwidth, but I am afraid nothing more will be done for these designs, beyond Quadcore, to improve controller performance. I think we are going the way of the SMP vendors for the future, and controllers will be designed in clusters of boxes based on commodity hardware.

Labels: Storage Performance,controller,disk drives

posted by: Henry Newman

Henry Newman, InfoStor Blogger
by Henry Newman
InfoStor Blogger

Henry Newman is CEO and CTO of Instrumental Inc. and has worked in HPC and large storage environments for 29 years. The outspoken Mr. Newman initially went to school to become a diplomat, but was firmly told during his first year that he might be better suited for a career that didn't require diplomatic skills. Diplomacy's loss was HPC's gain.

Previous Posts