Title | ||
---|---|---|
Progressive Decoding for Data Availability and Reliability in Distributed Networked Storage |
Abstract | ||
---|---|---|
To harness the ever growing capacity and decreasing cost of storage,
providing an abstraction of dependable storage in the presence of crash-stop
and Byzantine failures is compulsory. We propose a decentralized Reed Solomon
coding mechanism with minimum communication overhead. Using a progressive data
retrieval scheme, a data collector contacts only the necessary number of
storage nodes needed to guarantee data integrity. The scheme gracefully adapts
the cost of successful data retrieval to the number of storage node failures.
Moreover, by leveraging the Welch-Berlekamp algorithm, it avoids unnecessary
computations. Compared to the state-of-the-art decoding scheme, the
implementation and evaluation results show that our progressive data retrieval
scheme has up to 35 times better computation performance for low Byzantine node
rates. Additionally, the communication cost in data retrieval is derived
analytically and corroborated by Monte-Carlo simulation results. Our
implementation is flexible in that the level of redundancy it provides is
independent of the number of data generating nodes, a requirement for
distributed storage systems |
Year | Venue | Keywords |
---|---|---|
2010 | Clinical Orthopaedics and Related Research | reed solomon code,data integrity,byzantine failures,monte carlo simulation,data retrieval,cluster computing |
Field | DocType | Volume |
Computer science,Data retrieval,Distributed data store,Byzantine fault tolerance,Coding (social sciences),Reed–Solomon error correction,Real-time computing,Redundancy (engineering),Data integrity,Decoding methods,Distributed computing | Journal | abs/1011.4 |
Citations | PageRank | References |
0 | 0.34 | 9 |
Authors | ||
3 |
Name | Order | Citations | PageRank |
---|---|---|---|
Yunghsiang S. Han | 1 | 2472 | 159.76 |
Soji Omiwade | 2 | 5 | 1.34 |
Rong Zheng | 3 | 24 | 5.58 |