Name
Abstract | ||
|---|---|---|
Many parallel scientific applications use high-level I/O APIs that offer atomic I/O capabilities. Atomic I/O in current parallel file systems is often slow when multiple processes simultaneously access interleaved, shared files. Current atomic I/O solutions are not optimized for handling noncontiguous access patterns because current locking systems have a fixed file system block-based granularity and do not leverage high-level access pattern information. In this paper we present a hybrid lock protocol that takes advantage of new list and datatype byte-range lock description techniques to enable high performance atomic I/O operations for these challenging access patterns. We implement our scalable distributed lock manager (DLM) in the PVFS parallel file system and show that these techniques improve locking throughput over a naive noncontiguous locking approach by several orders of magnitude in an array of lock-only tests. Additionally, in two scientific I/O benchmarks, we show the benefits of avoiding false sharing with our byte-range granular DLM when compared against a block-based lock system implementation. |
Year | DOI | Venue |
|---|---|---|
2007 | 10.1145/1362622.1362658 | SC |
Keywords | Field | DocType |
parallel file system,challenging access pattern,datatype byte-range lock description,o operation,o benchmarks,o capability,block-based lock system implementation,o solution,high-level access pattern information,o apis,hybrid lock protocol,data mining,cache memory,out of order,protocols,system testing,servers,concurrent computing,throughput,computational modeling,application software,benchmark testing,government | Double-checked locking,File system,Lock (computer science),Computer science,CPU cache,Server,Parallel computing,Distributed lock manager,False sharing,Concurrent computing | Conference |
Citations | PageRank | References |
6 | 0.59 | 20 |
Authors | ||
5 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Avery Ching | 1 | 221 | 16.21 |
| Wei-keng Liao | 2 | 1095 | 87.98 |
| Alok Choudhary | 3 | 322 | 31.06 |
| Robert Ross | 4 | 2717 | 173.13 |
| Lee Ward | 5 | 49 | 6.70 |