Paper Info
Title
High availability, elasticity, and strong consistency for massively parallel scans over relational data
Abstract
An elastic and highly available data store is a key component of many cloud applications. Existing data stores with strong consistency guarantees are designed and optimized for small updates, key-value access, and (if supported) small range queries over a predefined key column. This raises performance and availability problems for applications which inherently require large updates, non-key access, and large range queries. This paper presents a solution to these problems: Crescando/RB; a distributed, scan-based, main memory, relational data store (single table) with robust performance and high availability. The system addresses a real, large-scale industry use case: the Amadeus travel management system. This paper focuses on the distribution layer of Crescando/RB, the problem and theory behind it, the rationale underlying key design decisions, and the novel multicast protocol and replication framework it is composed of. Highlighting the key features of the distribution layer, we present experimental results showing that even under permanent node failures and large-scale data repartitioning, Crescando/RB remains fully available and capable of sustaining a heavy query and update load.
Year
DOI
Venue
2014
10.1007/s00778-013-0343-9
VLDB J.
Keywords
Field
DocType
Scan-only query processing,Dynamic partial replication,High availability,Atomic multicast
Relational database,Computer science,Massively parallel,Range query (data structures),Multicast,Strong consistency,High availability,Management system,Database,Cloud computing,Distributed computing
Journal
Volume
Issue
ISSN
23
4
1066-8888
Citations 
PageRank 
References 
8
0.45
67
Authors
3
Name
Order
Citations
PageRank
Philipp Unterbrunner1362.18
Gustavo Alonso25476612.79
Donald Kossmann36220603.55