Name
Abstract | ||
|---|---|---|
There is a critical problem of metadata performance scalability in high-performance computing when accessing many small files from millions of clients. This paper proposes a design of PPMDS, a scalable distributed metadata server, to improve metadata performance and scalability. To efficiently manage hierarchical namespace of file system across multiple servers, it manages inode entries using a parent inode number and an entry name as a key. To update multiple inode entries atomically, it uses a nonblocking distributed transaction based on an algorithm of dynamic software transactional memory. It improves the metadata performance by introducing server-side transaction processing, multi-reader, and a shared lock mode to reduce the number of remote procedure calls and to prevent unnecessary blocking. A prototype implementation achieves 62,000 operations per second when creating files in a single directory using 8 metadata servers, which is 2.58x performance improvement compared to a single metadata performance. |
Year | DOI | Venue |
|---|---|---|
2018 | 10.1109/SNAMS.2018.8554478 | 2018 Fifth International Conference on Social Networks Analysis, Management and Security (SNAMS) |
Keywords | DocType | ISBN |
Distributed metadata server,distributed file system,nonblocking distributed transaction | Conference | 978-1-5386-9589-0 |
Citations | PageRank | References |
0 | 0.34 | 8 |
Authors | ||
3 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Kohei Hiraga | 1 | 25 | 2.02 |
| Osamu Tatebe | 2 | 309 | 42.94 |
| Hideyuki Kawashima | 3 | 79 | 19.63 |