Name
Abstract | ||
|---|---|---|
We investigate the message passing interface input/output (MPI I/O) implementation issues for two overlapping access patterns: the overlaps among processes within a single I/O operation and the overlaps across a sequence of I/O operations. The former case considers whether I/O atomicity can be obtained in the overlapping regions. The latter focuses on the file consistency problem on parallel machines with client-side file caching enabled. Traditional solutions for both overlapping I/O problems use whole file or byte-range file locking to ensure exclusive access to the overlapping regions and bypass the file system cache. Unfortunately, not only can file locking serialize I/O, but it can also increase the aggregate communication overhead between clients and I/O servers. For atomicity, we first differentiate MPI's requirements from the portable operating system interface (POSIX) standard and propose two scalable approaches, graph coloring and process-rank ordering, which can resolve access conflicts and maintain I/O parallelism. For solving the file consistency problem across multiple I/O operations, we propose a method called persistent file domains, which tackles cache coherency with additional information and coordination to guarantee safe cache access without using file locks |
Year | DOI | Venue |
|---|---|---|
2006 | 10.1109/TPDS.2006.163 | IEEE Trans. Parallel Distrib. Syst. |
Keywords | Field | DocType |
file atomicity,network operating systems,o operation,o parallelism,cache storage,client-side file caching,cache coherence,posix standard,overlapping i/o.,file consistency,process-rank ordering,mpi i/o,o problem,graph colouring,input-output programs,mpi parallel overlapping i/o,scalable design,file consistency problem,o atomicity,overlapping region,whole file,atomic i/o,message passing interface input/output operation,client-server systems,mpi,message passing,portable operating system interface,graph coloring,file lock,parallel machines,file system cache,operating system,input output,message passing interface | File system,Self-certifying File System,Computer science,Device file,Parallel computing,Versioning file system,Unix file types,Memory-mapped file,File descriptor,File locking,Distributed computing | Journal |
Volume | Issue | ISSN |
17 | 11 | 1045-9219 |
Citations | PageRank | References |
9 | 0.55 | 15 |
Authors | ||
6 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Wei-keng Liao | 1 | 1095 | 87.98 |
| Kenin Coloma | 2 | 137 | 9.36 |
| Alok Choudhary | 3 | 9 | 0.55 |
| Lee Ward | 4 | 185 | 9.81 |
| Eric Russell | 5 | 9 | 0.55 |
| Neil Pundit | 6 | 51 | 14.13 |