Paper Info
Title
Cooperative Client-Side File Caching for MPI Applications
Abstract
Client-side file caching is one of many I/O strategies adopted by today's parallel file systems that were initially designed for distributed systems. Most of these implementations treat each client independently because clients' computations are seldom related to each other in a distributed environment. However, it is misguided to apply the same assumption directly to high-performance computers where many parallel I/O operations come from a group of processes working within the same parallel application. Thus, file caching could perform more effectively if the scope of processes sharing the same file is known. In this paper, we propose a client-side file caching system for MPI applications that perform parallel I/O operations on shared files. In our design, an I/O thread is created and runs concurrently with the main thread in each MPI process. The MPI processes that collectively open a shared file use the I/O threads to cooperate with each other to handle file requests, cache page access, and coherence control. By bringing the caching subsystem closer to the applications as a user space library, it can be incorporated into an MPI I/O implementation to increase its portability. Performance evaluations using three I/O benchmarks demonstrate a significant improvement over traditional methods that use either byte-range file locking or rely on coherent I/O provided by the file system.
Year
DOI
Venue
2007
10.1177/1094342007077857
IJHPCA
Keywords
Field
DocType
mpi applications,parallel file system,file system,client-side file caching,o operation,cooperative client-side file caching,o benchmarks,o implementation,o thread,file request,shared file,client-side file,distributed system,coherent control,cache coherence,distributed environment
SSH File Transfer Protocol,Self-certifying File System,Computer science,Device file,Parallel computing,Unix file types,Versioning file system,Parallel I/O,Operating system,File locking,Computer file,Distributed computing
Journal
Volume
Issue
ISSN
21
2
1094-3420
Citations 
PageRank 
References 
7
0.56
11
Authors
4
Name
Order
Citations
PageRank
Wei-keng Liao1109587.98
Kenin Coloma21379.36
Alok N. Choudhary324222.44
Lee Ward41859.81