Interconnection Architectures for Petabyte-Scale High-Performance Storage Systems

Appeared in Proceedings of the 21st IEEE / 12th NASA Goddard Conference on Mass Storage Systems and Technologies.

Abstract

As demand for storage bandwidth and capacity grows, designers have proposed the construction of petabyte-scale storage systems. Rather than relying upon a few very large storage arrays, these petabyte-scale systems have thousands of individual disks working together to provide aggregate storage system bandwidth exceeding 100 GB/s. However, providing this bandwidth to storage system clients becomes difficult due to limits in network technology. This paper discusses different interconnection topologies for large disk-based systems, drawing on previous experience from the parallel computing community. By choosing the right network, storage system designers can eliminate the need for expensive high-bandwidth communication links and provide a highly-redundant network resilient against single node failures. We analyze several different topology choices and explore the tradeoffs between cost and performance. Using simulations, we uncover potential pitfalls, such as the placement of connections between the storage system network and its clients, that may arise when designing such a large system.

Publication date:
April 2004

Authors:
Andy Hospodor
Ethan L. Miller

Projects:
Ultra-Large Scale Storage

Available media

Full paper text: PDF

Bibtex entry

@inproceedings{hospodor-msst04,
  author       = {Andy Hospodor and Ethan L. Miller},
  title        = {Interconnection Architectures for Petabyte-Scale High-Performance Storage Systems},
  booktitle    = {Proceedings of the 21st IEEE / 12th NASA Goddard Conference on Mass Storage Systems and Technologies},
  pages        = {273-281},
  month        = apr,
  year         = {2004},
}