Paper Info
Title
Data Blocks: Hybrid OLTP and OLAP on Compressed Storage using both Vectorization and Compilation.
Abstract
This work aims at reducing the main-memory footprint in high performance hybrid OLTP & OLAP databases, while retaining high query performance and transactional throughput. For this purpose, an innovative compressed columnar storage format for cold data, called Data Blocks is introduced. Data Blocks further incorporate a new light-weight index structure called Positional SMA that narrows scan ranges within Data Blocks even if the entire block cannot be ruled out. To achieve highest OLTP performance, the compression schemes of Data Blocks are very light-weight, such that OLTP transactions can still quickly access individual tuples. This sets our storage scheme apart from those used in specialized analytical databases where data must usually be bit-unpacked. Up to now, high-performance analytical systems use either vectorized query execution or just-in-time (JIT) query compilation. The fine-grained adaptivity of Data Blocks necessitates the integration of the best features of each approach by an interpreted vectorized scan subsystem feeding into JIT-compiled query pipelines. Experimental evaluation of HyPer, our full-fledged hybrid OLTP & OLAP database system, shows that Data Blocks accelerate performance on a variety of query workloads while retaining high transaction throughput.
Year
DOI
Venue
2016
10.1145/2882903.2882925
SIGMOD/PODS'16: International Conference on Management of Data San Francisco California USA June, 2016
Field
DocType
ISBN
Pipeline transport,Tuple,Computer science,Online transaction processing,Parallel computing,Vectorization (mathematics),Footprint,Throughput,Online analytical processing,Database transaction,Database
Conference
978-1-4503-3531-7
Citations 
PageRank 
References 
30
0.87
34
Authors
6
Name
Order
Citations
PageRank
Harald Lang1554.24
Tobias Mühlbauer221712.21
Florian Funke3937.86
Peter Boncz42517244.81
Thomas Neumann52523156.50
Alfons Kemper63519769.50