Title
An effective information detection method for social big data.
Abstract
In data mining and knowledge discovery applications, outlier detection is a fundamental problem for robust machine learning and anomaly discovery. There are many successful outlier detection methods, including Local Outlier Factor (LOF), Angle-Based Outlier Factor (ABOF), Local Projection Score (LPS), etc. In this paper, we assume that outliers lie in lower density region and they are at relatively larger distance from any points with a higher local density. In order to identify such outliers quantitatively, the paper proposed a decision graph based outlier detection (DGOD) method. The DGOD method works by firstly calculating the decision graph score (DGS) for each sample, where the DGS is defined as ratio between discriminant distance and local density, next ranking samples according to their DGS values, and finally, returning samples with top-r largest DGS values as outliers. Experimental results on synthetic and real-world datasets have confirmed its effectiveness on outlier detection problems, and it is a general and effective information detection method, which is robust to data shape and dimensionality.
Year
DOI
Venue
2018
10.1007/s11042-017-5523-y
Multimedia Tools Appl.
Keywords
Field
DocType
Outlier detection, Decision graph, Local density, Discriminant distance, Outlier score, Social big data
Local outlier factor,Anomaly detection,Pattern recognition,Ranking,Discriminant,Computer science,Outlier,Curse of dimensionality,Artificial intelligence,Knowledge extraction,Big data
Journal
Volume
Issue
ISSN
77
9
1380-7501
Citations 
PageRank 
References 
2
0.37
24
Authors
2
Name
Order
Citations
PageRank
Jinrong He1195.82
Naixue Xiong22413194.61