Title
A Novel Approach for Improving Security and Storage Efficiency on HDFS
Abstract
Distributed file system for the storage of massive files have obvious advantages compared with the conventional file system. For instance, Hadoop Distributed File System (HDFS) implemented with commodity hardware has the advantages of low cost, high fault tolerance, scalability, etc. However, HDFS has the potential safety hazard due to the unencrypted data stored in Datanode, which may cause data leakage during the manipulation. In this paper, we purpose a new architecture based on HDFS, combined with network coding and multi-node reading, to improve the security and storage efficiency of the distributed file system. Experiments have shown that the method proposed in this paper greatly improves the safety of files transfer and storage, while the speed of files reading has increased threefold compared to the original HDFS model.
Year
DOI
Venue
2015
10.1016/j.procs.2015.05.062
Procedia Computer Science
Keywords
Field
DocType
HDFS,Network code,safety,high-efficiency ,
Distributed File System,Linear network coding,File system,Network code,Computer science,Storage efficiency,Fault tolerance,Commodity hardware,Operating system,Scalability
Conference
Volume
ISSN
Citations 
52
1877-0509
1
PageRank 
References 
Authors
0.35
2
6
Name
Order
Citations
PageRank
Yannan Ma130.75
Yu Zhou2514.51
Yao Yu310.35
Chenglei Peng4186.78
Ziqiang Wang510.35
Sidan Du631431.20