Title
S-Store: Streaming Meets Transaction Processing.
Abstract
Stream processing addresses the needs of real-time applications. Transaction processing addresses the coordination and safety of short atomic computations. Heretofore, these two modes of operation existed in separate, stove-piped systems. In this work, we attempt to fuse the two computational paradigms in a single system called S-Store. In this way, S-Store can simultaneously accommodate OLTP and streaming applications. We present a simple transaction model for streams that integrates seamlessly with a traditional OLTP system, and provides both ACID and stream-oriented guarantees. We chose to build S-Store as an extension of H-Store - an open-source, in-memory, distributed OLTP database system. By implementing S-Store in this way, we can make use of the transaction processing facilities that H-Store already provides, and we can concentrate on the additional features that are needed to support streaming. Similar implementations could be done using other main-memory OLTP platforms. We show that we can actually achieve higher throughput for streaming workloads in S-Store than an equivalent deployment in H-Store alone. We also show how this can be achieved within H-Store with the addition of a modest amount of new functionality. Furthermore, we compare S-Store to two state-of-the-art streaming systems, Esper and Apache Storm, and show how S-Store can sometimes exceed their performance while at the same time providing stronger correctness guarantees.
Year
DOI
Venue
2015
10.14778/2831360.2831367
Proceedings of The Vldb Endowment
Field
DocType
Volume
Transaction processing,Data mining,Computer science,Online transaction processing,Correctness,Throughput,Stream processing,Distributed transaction,Extreme Transaction Processing,Database,Transaction processing system
Journal
abs/1503.01143
Issue
ISSN
Citations 
13
2150-8097
30
PageRank 
References 
Authors
1.02
32
13
Name
Order
Citations
PageRank
John Meehan1694.27
Nesime Tatbul23415239.74
Stanley B. Zdonik391861660.15
Cansu Aslantas4392.26
Ugur Çetintemel53099208.64
Jiang Du6332.43
Tim Kraska72226133.57
Samuel Madden8161011176.38
David Maier956391666.90
Andrew Pavlo101614122.03
Michael Stonebraker11124634310.17
Kristin Tufte121241146.09
Hao Wang13301.02