Intelligent Metadata Management for a Petabyte-Scale File System

Appeared in 2nd Intelligent Storage Workshop.

Abstract

In petabyte-scale distributed file systems that decouple read and write from metadata operations, behavior of the metadata server cluster will be critical to overall system performance. We examine aspects of the workload that make it difficult to distribute effectively, and present a few potential strategies to demonstrate the issues involved. Finally, we describe the advantages of intelligent metadata management and a simulation environment we have developed to validate design possibilities.

Publication date:
May 2004

Authors:
Sage Weil
Scott A. Brandt
Ethan L. Miller
Kristal Pollack

Projects:
Ultra-Large Scale Storage

Available media

Full paper text: PDF

Bibtex entry

@inproceedings{weil-isw04,
  author       = {Sage Weil and Scott A. Brandt and Ethan L. Miller and Kristal Pollack},
  title        = {Intelligent Metadata Management for a Petabyte-Scale File System},
  booktitle    = {2nd Intelligent Storage Workshop},
  month        = may,
  year         = {2004},
}