Title
Systematic Erasure Codes with Optimal Repair Bandwidth and Storage.
Abstract
Erasure codes are widely used in distributed storage systems to prevent data loss. Traditional codes suffer from a typical repair-bandwidth problem in which the amount of data required to reconstruct the lost data, referred to as the repair bandwidth, is often far more than the theoretical minimum. While many novel codes have been proposed in recent years to reduce the repair bandwidth, these codes either require extra storage and computation overhead or are only applicable to some special cases. To address the weaknesses of the existing solutions to the repair-bandwidth problem, we propose Z Codes, a general family of codes capable of achieving the theoretical lower bound of repair bandwidth versus storage. To the best of our knowledge, the Z codes are the first general systematic erasure codes that jointly achieve optimal repair bandwidth and storage. Further, we generalize the Z codes to the GZ codes to gain the Maximum Distance Separable (MDS) property. Our evaluations of a real system indicate that Z/GZ and Reed-Solomon (RS) codes show approximately close encoding and repairing speeds, while GZ codes achieve over 37.5% response time reduction for repairing the same size of data, compared to the RS and Cauchy Reed-Solomon (CRS) codes.
Year
DOI
Venue
2017
10.1145/3109479
TOS
Keywords
Field
DocType
Distributed storage system, erasure codes, failure tolerance, repair bandwidth
Online codes,Concatenated error correction code,Luby transform code,Computer science,Fountain code,Turbo code,Block code,Real-time computing,Linear code,Tornado code
Journal
Volume
Issue
ISSN
13
3
1553-3077
Citations 
PageRank 
References 
0
0.34
18
Authors
5
Name
Order
Citations
PageRank
Qing Liu1494.41
Dan Feng21845188.16
Hong Jiang389.37
Yuchong Hu432227.44
Tianfeng Jiao500.34