Paper Info
Title
A Heterogeneity-Aware Region-Level Data Layout for Hybrid Parallel File Systems.
Abstract
Parallel file systems (PFS) are commonly used in high-end computing systems. With the emergence of solid state drives (SSD), hybrid PFSs, which consist of both HDD and SSD servers, provide a practical I/O system solution for data-intensive applications. However, most existing PFS layout schemes are inefficient for hybrid PFSs due to their lack of awareness of the performance differences between heterogeneous servers and the workload changes between different parts of a file. This lack of recognition can result in severe I/O performance degradation. In this study, we propose a heterogeneity-aware region-level (HARL) data layout scheme to improve the data distribution of a hybrid PFS. HARL first divides a file into fine-grained, varying sized regions according to the changes of an application's I/O workload, then chooses appropriate file stripe sizes on heterogeneous servers based on the server performance for each file region. Experimental results of representative benchmarks show that HARL can greatly improve the I/O system performance.
Year
DOI
Venue
2015
10.1109/ICPP.2015.43
ICPP
Keywords
Field
DocType
Parallel I/O System, Parallel File system, Solid State Drive, Data Layout
Distributed File System,Virtual file system,Self-certifying File System,Computer science,Server,Parallel computing,Device file,Solid-state drive,File system fragmentation,Benchmark (computing),Operating system,Distributed computing
Conference
ISSN
Citations 
PageRank 
0190-3918
1
0.35
References 
Authors
28
5
Name
Order
Citations
PageRank
Shuibing He110920.45
Xian-he Sun21987182.64
Yang Wang3839.61
Antonis Kougkas410.35
Adnan Haider5192.39