Title
Lightweight and Accurate Memory Allocation in Key-Value Cache
Abstract
The use of key-value caches in modern web servers is becoming more and more ubiquitous. Representatively, Memcached as a widely used key-value cache system, originally intended for speeding up dynamic web applications by alleviating database load. One of the key factors affecting the performance of Memcached is the memory allocation among different item classes. How to obtain the most efficient partitioning scheme with low time and space consumption is a focus of attention. In this paper, we propose a lightweight and accurate memory allocation scheme in Memcached, by sampling access patterns, analyzing data locality, and reassigning the memory space. One early study on optimizing memory allocation is LAMA, which uses footprint-based MRC to optimize memory allocation in Memcached. However, LAMA does not model deletion operations in Memcached and its spatial overhead is quite large. We propose a method that consumes only 3% of LAMA space and can handle read, write and deletion operations. Moreover, evaluation results show that the average stable-state miss ratio is reduced by 15.0% and the average stable-state response time is reduced by 12.3% when comparing our method to LAMA.
Year
DOI
Venue
2019
10.1007/s10766-018-0616-4
International Journal of Parallel Programming
Keywords
Field
DocType
Key-value cache, Lightweight and accurate memory allocation, Performance prediction and optimization
Locality,Hit ratio,Computer science,Cache,Parallel computing,Response time,Memory management,Sampling (statistics),Footprint,Distributed computing,Web server
Journal
Volume
Issue
ISSN
47
3
1573-7640
Citations 
PageRank 
References 
0
0.34
20
Authors
5
Name
Order
Citations
PageRank
Cheng Pan100.34
Lan Zhou2264.44
Yingwei Luo331541.30
Xiaolin Wang415531.70
Zhenlin Wang515015.89