Title
Subscription-based data aggregation techniques for top-k monitoring queries.
Abstract
With the increase of data generation in distributed fashions such as peer-to-peer systems and sensor networks, top-k query processing which is a way to aggregate only a small set of data that sufficiently satisfies many users' preferences, becomes a substantial issue. When data are periodically updated in each epoch e.g., weather information, without any techniques, a naive solution is to aggregate all data and their updates to ensure the completeness of final answers, however, it is too costly in terms of data transfer especially for data aggregator nodes (intermediate nodes). In this paper, we propose a top-k monitoring query processing method in 2-tier distributed systems based on a publish-subscribe scheme. A set of top-k subscriptions specifying summary scope of users' interests is informed to aggregators to limit the number of transferred data records for each epoch. In addition, instead of issuing subscriptions of all queries, our method identifies a small set of minimal subscriptions as well as utilizes some adaptive heuristic rules to efficiently maintain those subscriptions resulting in lower communication overhead. Our experiments through both synthetic and real datasets show that our technique is efficient and outperforms other comparative reactive methods.
Year
DOI
Venue
2017
10.1007/s11280-016-0385-1
World Wide Web
Keywords
Field
DocType
Distributed databases,Query processing,Top-k query,Monitoring query,Publish-subscribe system
Data mining,Heuristic,Data transmission,Computer science,Distributed database,Small set,Wireless sensor network,Data aggregator,Completeness (statistics),Test data generation
Journal
Volume
Issue
ISSN
20
2
1386-145X
Citations 
PageRank 
References 
2
0.37
34
Authors
3
Name
Order
Citations
PageRank
Kamalas Udomlamlert132.07
Takahiro Hara21819193.85
Shojiro Nishio31853374.68