Name
Abstract | ||
|---|---|---|
LSM-tree has been widely used in data management production systems for write-intensive workloads. However, as read and write workloads co-exist under LSM-tree, data accesses can experience long latency and low throughput due to the interferences to buffer caching from the compaction, a major and frequent operation in LSM-tree. After a compaction, the existing data blocks are reorganized and written to other locations on disks. As a result, the related data blocks that have been loaded in the buffer cache are invalidated since their referencing addresses are changed, causing serious performance degradations. In order to re-enable high-speed buffer caching during intensive writes, we propose Log-Structured buffered-Merge tree (simplified as LSbM-tree) by adding a compaction buffer on disks, to minimize the cache invalidations on buffer cache caused by compactions. The compaction buffer efficiently and adaptively maintains the frequently visited data sets. In LSbM, strong locality objects can be effectively kept in the buffer cache with minimum or without harmful invalidations. With the help of a small on-disk compaction buffer, LSbM achieves a high query performance by enabling effective buffer caching, while retaining all the merits of LSM-tree for write-intensive data processing, and providing high bandwidth of disks for range queries. We have implemented LSbM based on LevelDB. We show that with a standard buffer cache and a hard disk, LSbM can achieve 2x performance improvement over LevelDB. We have also compared LSbM with other existing solutions to show its strong effectiveness. |
Year | DOI | Venue |
|---|---|---|
2017 | 10.1109/ICDCS.2017.70 | 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS) |
Keywords | Field | DocType |
LSM-tree,buffer cache,Key-Value store | Disk buffer,Cache,Computer science,Server,Parallel computing,Range query (data structures),Computer network,Write buffer,Buffer underrun,Throughput,Performance improvement | Conference |
ISSN | ISBN | Citations |
1063-6927 | 978-1-5386-1793-9 | 2 |
PageRank | References | Authors |
0.39 | 11 | 7 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Dejun Teng | 1 | 3 | 0.74 |
| Lei Guo | 2 | 41 | 2.54 |
| Rubao Lee | 3 | 872 | 41.41 |
| Feng Chen | 4 | 1041 | 47.36 |
| Siyuan Ma | 5 | 97 | 8.33 |
| Yanfeng Zhang | 6 | 3 | 2.76 |
| Xiaodong Zhang | 7 | 5378 | 355.72 |