Title
Frequency-based load shedding over a data stream of tuples
Abstract
Usually the data generation rate of a data stream is unpredictable, and some data elements of the data stream cannot be processed in real time if the generation rate exceeds the capacity of a data stream processing algorithm. In order to overcome this situation gracefully, a load shedding technique is recommended. This paper proposes a frequency-based load shedding technique over a data stream of tuples. In many data stream processing applications, such as mining frequent patterns, data elements having high frequency can be considered more significant than others having low frequency. Based on this observation, in the proposed technique, only frequent elements of a data stream are processed in real time while the others are trimmed. The decision to shed a load from the data stream or not is controlled automatically by the data generation rate of a data stream. Consequently, an unnecessary load shedding operation is not allowed in the proposed technique.
Year
DOI
Venue
2009
10.1016/j.ins.2009.01.014
Inf. Sci.
Keywords
Field
DocType
proposed technique,data stream processing algorithm,data element,data generation rate,unnecessary load,frequency-based load,real time,generation rate,data stream,data stream processing application,low frequency,high frequency
Data stream processing,Computer science,Data stream,Tuple,Real-time computing,Test data generation,Load Shedding
Journal
Volume
Issue
ISSN
179
21
0020-0255
Citations 
PageRank 
References 
6
0.47
22
Authors
2
Name
Order
Citations
PageRank
Joong Hyuk Chang140119.81
Hye-Chung (Monica) Kum2193.61