Title
Infinicache: Exploiting Ephemeral Serverless Functions To Build A Cost-Effective Memory Cache
Abstract
Internet-scale web applications are becoming increasingly storage-intensive and rely heavily on in-memory object caching to attain required I/O performance. We argue that the emerging serverless computing paradigm provides a well-suited, cost-effective platform for object caching. We present INFINICACHE, a first-of-its-kind in-memory object caching system that is completely built and deployed atop ephemeral serverless functions. INFINICACHE exploits and orchestrates serverless functions' memory resources to enable elastic pay-per-use caching. INFINICACHE' s design combines erasure coding, intelligent billed duration control, and an efficient data backup mechanism to maximize data availability and cost effectiveness while balancing the risk of losing cached state and performance. We implement INFINICACHE on AWS Lambda and show that it: (1) achieves 31 - 96 x tenant-side cost savings compared to AWS ElastiCache for a large-object-only production workload, (2) can effectively provide 95.4% data availability for each one hour window, and (3) enables comparative performance seen in a typical in-memory cache.
Year
Venue
DocType
2020
PROCEEDINGS OF THE 18TH USENIX CONFERENCE ON FILE AND STORAGE TECHNOLOGIES
Conference
Citations 
PageRank 
References 
0
0.34
0
Authors
9
Name
Order
Citations
PageRank
Ao Wang173.16
Zhang Jingyuan200.34
Ma Xiaolong300.34
Ali Anwar411314.83
Lukas Rupprecht56010.88
Skourtis Dimitrios600.34
Vasily Tarasov719918.98
Yan Feng800.34
Yue Cheng9759.77