Title
Multi-Path Transport For Rdma In Datacenters
Abstract
RDMA is becoming prevalent because of its low latency, high throughput and low CPU overhead. However, current RDMA remains a single path transport which is prone to failures and falls short to utilize the rich parallel paths in datacenters. Unlike previous multipath approaches, which mainly focus on TCP, this paper presents a multi-path transport for RDMA, i.e. MP-RDMA, which efficiently utilizes the rich network paths in datacenters. MP-RDMA employs three novel techniques to address the challenge of limited RDMA NICs on-chip memory size: 1) a multi-path ACK-clocking mechanism to distribute traffic in a congestion-aware manner without incurring per-path states; 2) an out-of-order aware path selection mechanism to control the level of out-of-order delivered packets, thus minimizes the meta data required to them; 3) a synchronise mechanism to ensure in-order memory update whenever needed. With all these techniques, MP-RDMA only adds 66B to each connection state compared to single-path RDMA. Our evaluation with an FPGA-based prototype demonstrates that compared with single-path RDMA, MP-RDMA can significantly improve the robustness under failures (2x similar to 4x higher throughput under 0.5%similar to 10% link loss ratio) and improve the overall network utilization by up to 47%.
Year
Venue
Field
2018
PROCEEDINGS OF THE 15TH USENIX SYMPOSIUM ON NETWORKED SYSTEMS DESIGN AND IMPLEMENTATION (NSDI'18)
Multi path,Computer science,Remote direct memory access,Distributed computing
DocType
Citations 
PageRank 
Conference
1
0.35
References 
Authors
20
9
Name
Order
Citations
PageRank
Yuanwei Lu1352.66
Guo Chen2113.96
Bojie Li3635.85
Kun Tan4135098.64
Yongqiang Xiong570845.84
Peng Cheng6315.56
Jiansong Zhang759648.98
Enhong Chen82106165.57
Thomas Moscibroda94047200.40