Title
Unsupervised Learning Based Distributed Detection Of Global Anomalies
Abstract
Anomaly detection has recently become an important problem in many industrial and financial applications. Very often, the databases from which anomalies have to be found are located at multiple local sites and cannot be merged due to privacy reasons or communication overhead. In this paper, a novel general framework for distributed anomaly detection is proposed. The proposed method consists of three steps: (i) building local models for distributed data sources with unsupervised anomaly detection methods and computing quality measure of local models; (ii) transforming local unsupervised local models into sharing models; and (iii) reusing sharing models for new data and combining their results by considering both quality and diversity of them to detect anomalies in a global view. In experiments performed on synthetic and real-life large data set, the proposed distributed anomaly detection method achieved prediction performance comparable or even slightly better than the global anomaly detection algorithm applied on the data set obtained when all distributed data set were merged.
Year
DOI
Venue
2010
10.1142/S0219622010004172
INTERNATIONAL JOURNAL OF INFORMATION TECHNOLOGY & DECISION MAKING
Keywords
Field
DocType
Distributed anomaly detection, global anomalies, combining models
Data mining,Anomaly detection,Computer science,Reuse,Global anomaly,Unsupervised learning,Artificial intelligence,Machine learning
Journal
Volume
Issue
ISSN
9
6
0219-6220
Citations 
PageRank 
References 
4
0.40
12
Authors
6
Name
Order
Citations
PageRank
Junlin Zhou1296.44
Aleksandar Lazarevic2115756.50
Kuo-Wei Hsu3536.38
Jaideep Srivastava45845871.63
Yan Fu5335.22
Y. Wu61178139.36