Title
Octopus+: An RDMA-Enabled Distributed Persistent Memory File System
Abstract
AbstractNon-volatile memory and remote direct memory access (RDMA) provide extremely high performance in storage and network hardware. However, existing distributed file systems strictly isolate file system and network layers, and the heavy layered software designs leave high-speed hardware under-exploited. In this article, we propose an RDMA-enabled distributed persistent memory file system, Octopus+, to redesign file system internal mechanisms by closely coupling non-volatile memory and RDMA features. For data operations, Octopus+ directly accesses a shared persistent memory pool to reduce memory copying overhead, and actively fetches and pushes data all in clients to rebalance the load between the server and network. For metadata operations, Octopus+ introduces self-identified remote procedure calls for immediate notification between file systems and networking, and an efficient distributed transaction mechanism for consistency. Octopus+ is enabled with replication feature to provide better availability. Evaluations on Intel Optane DC Persistent Memory Modules show that Octopus+ achieves nearly the raw bandwidth for large I/Os and orders of magnitude better performance than existing distributed file systems.
Year
DOI
Venue
2021
10.1145/3448418
ACM Transactions on Storage
Keywords
DocType
Volume
Storage system, distributed system, remote direct memory access, persistent memory
Journal
17
Issue
ISSN
Citations 
3
1553-3077
0
PageRank 
References 
Authors
0.34
0
5
Name
Order
Citations
PageRank
Bohong Zhu100.34
Youmin Chen2284.24
Qing Wang355.47
Youyou Lu435630.81
Jiwu Shu570972.71