Title
Efficient multidimensional aggregation for large scale monitoring
Abstract
Today, network monitoring becomes necessary on many levels: Internet Service Providers, large companies as well as smaller entities. Since network monitoring supports many applications in various fields (security, service provisioning, etc), it may consider multiple sources of information such as network traffic, user activity, network events and logs, etc. All these ones produce voluminous amount of data which need to be stored, visualized and analyzed for administration purposes. Various techniques to cope with scalability have been proposed as for example sampling or aggregation. In this paper, we introduce an aggregation technique which is able to handle multiple kinds of dimension, i.e. features, like traffic capture or host locations, without giving any preference a priori to a particular feature for ordering the aggregation process among dimensions. Furthermore, feature space granularity is determined on the fly depending on the desired events to monitor. We propose optimizations to keep the computational overhead low. In particular, the technique is applied to network related data involving multiple dimensions: source and destination IP addresses, services, geographical location of hosts, DNS names, etc. Thus, our approach is validated through multiple scenarios using different dimensions, measuring the impact of the aggregation process and the optimizations as well as by highlighting the ability to figure out important facts or changes in the network.
Year
Venue
Keywords
2012
LISA
multiple scenario,feature space granularity,aggregation technique,efficient multidimensional aggregation,multiple kind,network monitoring,large scale monitoring,multiple dimension,network traffic,multiple source,aggregation process,network event
Field
DocType
Citations 
Overhead (computing),Data mining,Feature vector,Computer science,A priori and a posteriori,Domain Name System,Granularity,Network monitoring,Art history,Multiple time dimensions,Distributed computing,Scalability
Conference
4
PageRank 
References 
Authors
0.41
29
3
Name
Order
Citations
PageRank
Lautaro Dolberg1213.60
Jérôme François217021.81
Thomas Engel353859.08