Title
Chisel: Reshaping Queries to Trim Latency in Key-Value Stores
Abstract
It is challenging for key-value data stores to trim user (tail) latency of requests as the workloads are observed to have skewed number of key-value pairs and commonly retrieved via multiget operation, i.e., all keys at the same time. In this paper we present Chisel, a novel client side solution to efficiently reshape the query size at the data store by adaptively splitting big requests into chunks to reap the benefits of parallelism and merge small requests into a single query to amortize latency overheads per request. We derive a novel layered queueing model that can quickly and approximately steer the decisions of Chisel. We extensively evaluate Chisel on memcached clusters hosted on a testbed, across a large number of scenarios with different workloads and system configurations. Our evaluation results show that Chisel can overturn the inherent high variability of requests into a judicious operational region, showcasing significant gains for the mean and 95th percentile of user perceived latency, compared to the state-of-art query processing policy.
Year
DOI
Venue
2019
10.1109/ICAC.2019.00016
2019 IEEE International Conference on Autonomic Computing (ICAC)
Keywords
Field
DocType
key value stores,split merge latency model
Client-side,Chisel,Trim,Latency (engineering),Computer science,Computer network,Testbed,Queueing theory,Merge (version control),Overhead (business),Distributed computing
Conference
ISSN
ISBN
Citations 
2474-0764
978-1-7281-2412-4
0
PageRank 
References 
Authors
0.34
0
5
Name
Order
Citations
PageRank
Robert Birke114317.83
Juan F. Pérez210611.80
Sonia Ben Mokhtar359644.86
Navaneeth Rameshan400.34
Lydia Y. Chen543252.24