Title
Leveraging Locality to Boost the Update Performance of Network-Coding-Based Storage Systems
Abstract
Network coding is becoming a very important technology to improve the reconstructing performance of distributed storage systems due to its high reliability and low redundancy. Update is a typical and important operation involved in the network-coding-based systems. However, the overhead incurred by the update operation has a significant impact on the system performance. Traditionally, the small updated data are aggregated as different big logs and then flushed to the back-end storage nodes, thus reducing the I/O overhead. We investigate a large volume of traces and find that the updated data normally contain very strong locality. Based on this observation, this paper proposes a Locality-based Update Scheme (LUS) which maintains the update related data in the cache longer to leverage the locality. The subsequent update related data will be cached, thus significantly decreasing the data accesses going to back-end storage nodes and the bandwidth required to transfer the data. Experimental results demonstrate that in contrast to a state-ofthe-art approach, LUS reduces the bandwidth consumption and update time up to 30% and 24.57%, respectively.
Year
DOI
Venue
2016
10.1109/HPCC-SmartCity-DSS.2016.0033
2016 IEEE 18th International Conference on High Performance Computing and Communications; IEEE 14th International Conference on Smart City; IEEE 2nd International Conference on Data Science and Systems (HPCC/SmartCity/DSS)
Keywords
Field
DocType
Network Coding,Distributed Storage System,Regenerating Code,Cache,Data Update
Linear network coding,Locality,Computer science,Cache,Distributed data store,Computer network,Real-time computing,Redundancy (engineering),Fault tolerance,Bandwidth (signal processing),Distributed database,Distributed computing
Conference
ISBN
Citations 
PageRank 
978-1-5090-4298-2
0
0.34
References 
Authors
0
4
Name
Order
Citations
PageRank
Bingxing Liu110.69
Yuhui Deng233139.56
Cheng Hu3164.65
Laurence T. Yang46870682.61