Paper Info
Title
A sequence-oriented stream warehouse paradigm for network monitoring applications
Abstract
Network administrators are faced with the increasingly challenging task of monitoring their network's health in real time, drawing upon diverse and voluminous measurement data feeds and extensively mining them. The role of database systems in network monitoring has traditionally been that of data repositories; even if an application uses a database, the application logic is implemented using external programs. While such programs are flexible, they tend to be ad-hoc, opaque, inefficient and hard to maintain over time. In this paper, we propose a new way of implementing network monitoring applications: directly within a database as continually updated tables defined using a declarative query language (SQL). We also address a crucial technical issue with realizing this approach: SQL was designed for set-oriented data transformations, but network monitoring involves sequence-oriented analysis. To solve this problem, we propose an extension to SQL that makes sequence-oriented analysis easier to express and faster to evaluate. Using a prototype implementation in a large-scale production data warehouse, we demonstrate how the declarative sequence-oriented query language simplifies application development and how the associated system optimizations improve application performance.
Year
DOI
Venue
2012
10.1007/978-3-642-28537-0_6
PAM
Keywords
Field
DocType
sequence-oriented analysis,sequence-oriented stream warehouse paradigm,application logic,data repository,network administrator,large-scale production data warehouse,network monitoring application,network monitoring,simplifies application development,set-oriented data transformation,application performance
Data warehouse,SQL,Data stream management system,Query language,Software engineering,Data transformation (statistics),Computer science,Computer network,Data definition language,Query by Example,Network monitoring,Database
Conference
Citations 
PageRank 
References 
7
0.48
17
Authors
4
Name
Order
Citations
PageRank
Lukasz Golab1126380.95
Theodore Johnson21457275.42
Subhabrata Sen34098301.31
Jennifer Yates479064.51