Storage device options continue to broaden for end users, integrators, and storage system OEMs. For enterprise applications, hard disk drives (HDDs) are now available in several form factors, configured with parallel SCSI, Fibre Channel, Serial ATA (SATA), or Serial Attached SCSI (SAS) interfaces. An increasing number of solid-state disks (SSDs) are now also shipping for enterprise applications. DRAM-based SSDs have for many years satisfied the needs of very high-performance, latency-sensitive environments, but at a high cost. Now, with the price declines in NAND flash and advances in technology, NAND-based SSDs have a growing opportunity in data-center environments. Similar to HDDs, flash-based SSDs are offered with several interface options.

Today’s diversity of storage device options for enterprise applications contrasts sharply with the limited selection available just five years ago. Consider the changes that have taken place just with hard disk drives. In 2003, essentially two HDD form factors serviced the majority of enterprise data-center storage demands: 3.5-inch 10,000 rpm and 3.5-inch 15,000rpm HDDs. Today, in addition to 3.5-inch devices, the HDD industry also ships 2.5-inch 10,000rpm and 15,000rpm enterprise-class small-form-factor (SFF) drives. Collectively, IDC classifies these drives as performance-optimized HDDs. By 2009, 2.5-inch performance-optimized HDDs will out-ship 3.5-inch drives.

HDD vendors have done an admirable job increasing the average capacity of performance-optimized disk drives, but the growth rate is slowing. At the same time, 2.5-inch performance- optimized HDDs have less storage capacity than 3.5-inch drives due to smaller diameter disks and a lower maximum number of disks per drive. Given the migration to 2.5-inch enterprise HDD products, the resulting overall average capacity of performance-optimized drives shipping to enterprise applications has remained relatively flat over the past few years.

Meanwhile, IT managers are faced with the dilemma of how to meet capacity growth requirements exceeding 50% per year. Of course, one solution was to simply increase the number of HDDs per array, arrays per system, or number of systems per datacenter to reach the required amount of capacity. Instead, the HDD industry responded by delivering high-capacity drives that store 3× to 4× more data than traditional performance-optimized drives, and are suitable for 24×7 use in rack-mount environments. Use of these capacity-optimized drives helped IT managers meet storage growth requirements and resulted in a steady increase of the average HDD capacity shipping to data centers. Capacity-optimized drives will increasingly penetrate the data center as users learn how to better leverage these devices. In 2007, about 10.8 million capacity-optimized HDDs shipped in data-center storage solutions. Over time, IDC expects a growing percentage of terabytes will be stored on capacity-optimized disk drives (see figure, above).

Meanwhile, there has been a growing disconnect between the I/O capabilities of server/controller CPUs and HDD performance. To highlight this further, consider a few of the various techniques that are employed today to increase storage performance, such as striping data across multiple disks, using HDDs with faster spin speeds (15,000rpm versus 10,000rpm), or even short-stroking the disk drive (using only the outer tracks of the disk where sequential data rates are fastest).

Generally, SSDs have much higher I/O capabilities than hard disk drives. When leveraged properly, SSDs can accelerate an entire enterprise system by ensuring the I/O capability of the storage devices is in balance with the rest of the system. IDC believes that enterprise storage applications can benefit from the use of SSDs. In particular, storage applications requiring high I/Os-per-second (IOPS) rates to support the data architecture and performance requirements of the computer system are ideal candidates for SSD-enabled acceleration.

IT managers also face a growing challenge with power and cooling. It is not easy to predict the exact cost of electricity, but it is easy to anticipate the direction: up. A number of strategies have emerged, and will continue to emerge, to help reduce the energy associated with storage. “Green” requirements will undoubtedly set in motion greener storage solutions, including at the device level.

Taken together, the result is a challenging environment for product positioning by HDD and SSD vendors. There are myriad storage device options available to end users and integrators. Some may employ a combination of performance-optimized and capacity-optimized HDDs, while some may leverage SSDs and capacity-optimized HDDs.

Given the options available today and in the near future, the permutations of storage system configurations is almost mind-boggling. Nevertheless, within this environment, standardized solutions are needed wherever possible to achieve economies of scale necessary to help IT managers cope with rising storage costs.

Serial interface adoption

Amid the confusion with device proliferation is one certainty: Storage devices, including HDDs and SSDs, are increasingly migrating to standardized serial interfaces. Historically, storage technology or form-factor transitions in the enterprise take time, interfaces included. But in comparison to other relatively recent technology transitions in the enterprise, the migration from parallel SCSI to SAS technology has been relatively quick (see figure).

In addition to the rapid transition to SAS for performance-optimized drives, the vast majority of capacity-optimized drives shipping for enterprise applications today employ the SATA interface. When accounting for all performance and capacity-optimized HDDs that shipped in 2007, more than 65% shipped with SATA or SAS interfaces.

More on SAS

The SAS interface was introduced in 2005 with a 3Gbps data rate. The 3Gbps data rate adequately supports the majority of storage systems requirements in the market today. But requirements change, and the SAS interface is being improved to meet these needs.

The second generation of the SAS interface, dubbed SAS-2, is now being readied for product launches later this year. SAS-2 will have a 6Gbps data rate and will be backward-compatible with existing 1.5Gbps SATA and 3Gbps SAS/SATA devices and infrastructure.

The 6Gbps SAS interface not only enables faster data rates, but it also offers some new benefits and opportunities for enterprise applications, including the ability to spread I/O requests over a greater number of HDDs. It also provides a higher-performance interface for future SSD devices designed with very fast I/O and data-rate capabilities. The 6Gbps SAS interface also allows for the design of SAS solutions that could compete with storage systems currently leveraging the Fibre Channel interface

Amid the multitude of transitions taking place for enterprise-class storage devices, and the growing importance of dynamics such as power and cooling, HDD and SSD OEMs will have additional market dynamics to navigate.

The success of products that integrate the various storage device types, along with pricing and product portfolio decisions, will all factor into specific HDD and SSD device demand. Despite the uncertainty within this environment, one element is certain: Data-center storage requirements for organizations continue to grow. Given the strong demand for storage capacity, the outlook for HDDs is solid, and the industry will likely post successive years of record-breaking shipments and revenue.