Title
Fast In-Memory Transaction Processing Using RDMA and HTM.
Abstract
DrTM is a fast in-memory transaction processing system that exploits advanced hardware features such as remote direct memory access (RDMA) and hardware transactional memory (HTM). To achieve high efficiency, it mostly offloads concurrency control such as tracking read/write accesses and conflict detection into HTM in a local machine and leverages the strong consistency between RDMA and HTM to ensure serializability among concurrent transactions across machines. To mitigate the high probability of HTM aborts for large transactions, we design and implement an optimized transaction chopping algorithm to decompose a set of large transactions into smaller pieces such that HTM is only required to protect each piece. We further build an efficient hash table for DrTM by leveraging HTM and RDMA to simplify the design and notably improve the performance. We describe how DrTM supports common database features like read-only transactions and logging for durability. Evaluation using typical OLTP workloads including TPC-C and SmallBank shows that DrTM has better single-node efficiency and scales well on a six-node cluster; it achieves greater than 1.51, 34 and 5.24, 138 million transactions per second for TPC-C and SmallBank on a single node and the cluster, respectively. Such numbers outperform a state-of-the-art single-node system (i.e., Silo) and a distributed transaction system (i.e., Calvin) by at least 1.9X and 29.6X for TPC-C.
Year
DOI
Venue
2017
10.1145/3092701
ACM Trans. Comput. Syst.
Keywords
Field
DocType
In-memory transactions,distributed transactions,hardware transactional memory,remote direct memory access,key-value stores
Transaction processing,Serializability,Computer science,Real-time computing,Transactional memory,Transactions per second,Remote direct memory access,Transaction processing system,Distributed computing,Parallel computing,Online transaction processing,Distributed transaction,Operating system
Journal
Volume
Issue
ISSN
35
1
0734-2071
Citations 
PageRank 
References 
7
0.49
51
Authors
8
Name
Order
Citations
PageRank
Haibo Chen11749123.40
Rong Chen258630.22
Xingda Wei3424.20
Jiaxin Shi434918.02
Yanzhe Chen51533.82
zhaoguo wang61328.56
Binyu Zang798462.75
Haibing Guan81106105.35