Paper Info
Title
Efficient techniques of parallel recovery for erasure-coding-based distributed file systems
Abstract
Replication has been widely used to ensure the data availability in a distributed file system. In recent years, erasure coding (EC) has been adopted to overcome the problem of space efficiency in Replication. However, EC has various performance degrading factors such as parity calculation and degraded input/output. In particular, the recovery performance of EC is degraded because of various factors when the distributed file systems become large. Nonetheless, few studies have been conducted to improve the recovery performance. Thus, this paper proposes an efficient parallel recovery technique in an EC-based distributed file system. We describe the contention avoidance method, chunk allocation method, and asynchronous recovery method, to improve the parallel recovery performance. The contention avoidance method can minimize the contention for resources. The chunk allocation method and asynchronous recovery method can increase the efficiency of the parallel recovery. Finally, we verify that when the proposed parallel recovery technique in this paper is applied to actual distributed file systems, its recovery performance is improved by 263% compared to that of existing methods in the performance evaluation.
Year
DOI
Venue
2019
10.1007/s00607-019-00714-7
Computing
Keywords
Field
DocType
Distributed file system, Erasure coding, Parallel recovery, ExSTorus-FS
Distributed File System,Asynchronous communication,Mathematical optimization,Data availability,Erasure code,Mathematics,Distributed computing
Journal
Volume
Issue
ISSN
101
12
1436-5057
Citations 
PageRank 
References 
0
0.34
0
Authors
4
Name
Order
Citations
PageRank
Dong-Oh Kim1156.72
Hongyeon Kim244.76
Youngkyun Kim3338.68
Jeong-Joon Kim454.11