Abstract | ||
---|---|---|
Stream processing addresses the needs of real-time applications. Transaction processing addresses the coordination and safety of short atomic computations. Heretofore, these two modes of operation existed in separate, stove-piped systems. In this work, we attempt to fuse the two computational paradigms in a single system called S-Store. In this way, S-Store can simultaneously accommodate OLTP and streaming applications. We present a simple transaction model for streams that integrates seamlessly with a traditional OLTP system, and provides both ACID and stream-oriented guarantees. We chose to build S-Store as an extension of H-Store - an open-source, in-memory, distributed OLTP database system. By implementing S-Store in this way, we can make use of the transaction processing facilities that H-Store already provides, and we can concentrate on the additional features that are needed to support streaming. Similar implementations could be done using other main-memory OLTP platforms. We show that we can actually achieve higher throughput for streaming workloads in S-Store than an equivalent deployment in H-Store alone. We also show how this can be achieved within H-Store with the addition of a modest amount of new functionality. Furthermore, we compare S-Store to two state-of-the-art streaming systems, Esper and Apache Storm, and show how S-Store can sometimes exceed their performance while at the same time providing stronger correctness guarantees. |
Year | DOI | Venue |
---|---|---|
2015 | 10.14778/2831360.2831367 | Proceedings of The Vldb Endowment |
Field | DocType | Volume |
Transaction processing,Data mining,Computer science,Online transaction processing,Correctness,Throughput,Stream processing,Distributed transaction,Extreme Transaction Processing,Database,Transaction processing system | Journal | abs/1503.01143 |
Issue | ISSN | Citations |
13 | 2150-8097 | 30 |
PageRank | References | Authors |
1.02 | 32 | 13 |
Name | Order | Citations | PageRank |
---|---|---|---|
John Meehan | 1 | 69 | 4.27 |
Nesime Tatbul | 2 | 3415 | 239.74 |
Stanley B. Zdonik | 3 | 9186 | 1660.15 |
Cansu Aslantas | 4 | 39 | 2.26 |
Ugur Çetintemel | 5 | 3099 | 208.64 |
Jiang Du | 6 | 33 | 2.43 |
Tim Kraska | 7 | 2226 | 133.57 |
Samuel Madden | 8 | 16101 | 1176.38 |
David Maier | 9 | 5639 | 1666.90 |
Andrew Pavlo | 10 | 1614 | 122.03 |
Michael Stonebraker | 11 | 12463 | 4310.17 |
Kristin Tufte | 12 | 1241 | 146.09 |
Hao Wang | 13 | 30 | 1.02 |