SPC releases benchmark results

By Dave Simpson

The Storage Performance Council has begun posting results of the SPC Benchmark 1 (SPC-1) tests, which are designed to test performance of disk subsystems. Full test results, as well as an explanation of test methodology, are available at www.storageperformance.org.

Participating in the first round of tests were IBM, LSI Logic, and Sun. Other SPC member companies include Adaptec, Compaq, Dell, Evaluator Group (an analyst firm), Hitachi, Hewlett-Packard, Ideas International (analyst firm), NEC, Unisys, and Veritas Software. Conspicuously absent from the organization is market leader EMC, which pulled out of the SPC about two years ago.

SPC members expect end users to use the benchmark results to help them come up with "short lists" of potential suppliers.

Manufacturers first run the tests, and then the results are certified by an independent auditor and sent out for a 60-day peer-review process. In the case of disputes, a five-member SPC technical advisory board will arbitrate.

The first round of tests were based primarily on two benchmarks:

  • SPC-1 IOPS (I/Os per second) measures maximum I/O throughput of a storage subsystem and
  • SPC-1 Least Response Time (LRT) measures I/O request response times.

The tests emulate random-I/O streams in environments such as OLTP and Web/database/e-mail servers. Price-performance metrics are also available. The tests do not take into account features such as reliability, availability, and serviceability.

This article was originally published on June 01, 2002