Abstract | ||
---|---|---|
This paper examines the application of Tornado codes, a class of low density parity check (LDPC) erasure codes, to archival storage systems based on massive arrays of idle disks (MAID). We present a log- structured extent-based archival file system based on Tornado Coded stripe storage. The file system is combined with a MAID simulator to emulate the behavior of a large-scale storage system with the goal of employing Tornado Codes to provide fault tolerance and performance in a power-constrained environment. The effect of power conservation constraints on system throughput is examined, and a policy of placing multiple data nodes on a single device is shown to increase read throughput at the cost of a measurable, but negligible, decrease in fault tolerance. Finally, a system prototype is implemented on a 100 TB Lustre storage cluster, providing GridFTP accessible storage with higher reliability and availability than the underlying storage architecture. |
Year | DOI | Venue |
---|---|---|
2007 | 10.1109/MSST.2007.33 | San Diego, CA |
Keywords | Field | DocType |
file system,large-scale storage system,tb lustre storage cluster,gridftp accessible storage,stripe storage,tornado codes,system prototype,storage system,maid archival storage,underlying storage architecture,fault tolerance,fault tolerant,low density parity check,information retrieval systems,erasure code | File system,Tornado,Computer data storage,Low-density parity-check code,Computer science,Fault tolerance,GridFTP,Tornado code,Erasure code,Operating system,Embedded system | Conference |
ISBN | Citations | PageRank |
0-7695-3025-7 | 3 | 0.43 |
References | Authors | |
8 | 2 |
Name | Order | Citations | PageRank |
---|---|---|---|
Matthew Woitaszek | 1 | 57 | 7.46 |
Henry M. Tufo | 2 | 113 | 13.95 |