Title | ||
---|---|---|
Heterogeneity-Aware Collective I/O for Parallel I/O Systems with Hybrid HDD/SSD Servers. |
Abstract | ||
---|---|---|
Collective I/O is a widely used middleware technique that exploits I/O access correlation among multiple processes to improve I/O system performance. However, most existing implementations of collective I/O strategies are designed and optimized for homogeneous I/O systems. In practice, the homogeneity assumptions do not hold in heterogeneous parallel I/O systems, which consist of multiple HDD and SSD-based servers and become increasingly promising. In this paper, we propose a heterogeneity-aware collective-I/O (HACIO) strategy to enhance the performance of conventional collective I/O operations. HACIO reorganizes the order of I/O requests for each aggregator with awareness of the storage performance of heterogeneous servers, so that the hardware of the systems can be better utilized. We have implemented HACIO in ROMIO, a widely used MPI-IO library. Experimental results show that HACIO can significantly increase the I/O throughputs of heterogeneous I/O systems. |
Year | DOI | Venue |
---|---|---|
2017 | 10.1109/TC.2016.2637353 | IEEE Trans. Computers |
Keywords | Field | DocType |
Servers,Hardware,System performance,Middleware,Layout,Electronic mail,Sun | Middleware,Computer science,Server,Input/output,Real-time computing,Solid-state drive,Distributed computing,Multipath I/O,Parallel computing,Solaris Multiplexed I/O,Asynchronous I/O,Parallel I/O,Embedded system | Journal |
Volume | Issue | ISSN |
66 | 6 | 0018-9340 |
Citations | PageRank | References |
1 | 0.36 | 16 |
Authors | ||
5 |
Name | Order | Citations | PageRank |
---|---|---|---|
Shuibing He | 1 | 109 | 20.45 |
Yang Wang | 2 | 188 | 45.73 |
Xian-he Sun | 3 | 1987 | 182.64 |
Huang Chuanhe | 4 | 61 | 10.92 |
Z. Chen | 5 | 3443 | 271.62 |