Title
Teddies: trained Eddies for reactive stream processing
Abstract
In this paper, we present an adaptive stream query processor, Teddies, that combines the key advantages of the Eddies system with the scalability of the more traditional dataflow model. In particular, we introduce the notion of adaptive packetization of tuples to overcome the large memory requirements of the Eddies system. The Teddies optimizer groups tuples with the same history into data packets which are then scheduled on a per packet basis through the query tree. Corresponding to the introduction of this second dimension - the packet granularity-we propose an adaptive scheduler that can react to not only the varying statistics of the input streams and the selectivity of the operators, but also to the fluctuations in the internal packet sizes. The scheduler degrades to the Eddies scheduler in the worst case scenario. We present experimental results that compare both the reaction time as well as the scalability of the Teddies system with the Eddies and the data flow systems, and classify the conditions under which the Teddies' simple packet optimizer strategy outperforms the per-tuple Eddies optimizer strategy.
Year
DOI
Venue
2008
10.1007/978-3-540-78568-2_18
DASFAA
Keywords
Field
DocType
reaction time,stream processing,database system
Eddy,Data mining,Computer science,Tuple,Network packet,Operator (computer programming),Worst-case scenario,Stream processing,Database,Data flow diagram,Scalability
Conference
Volume
ISSN
ISBN
4947
0302-9743
3-540-78567-1
Citations 
PageRank 
References 
2
0.36
16
Authors
2
Name
Order
Citations
PageRank
Kajal T. Claypool158064.35
Mark Claypool264751.06