Title
Classifier evaluation and attribute selection against active adversaries
Abstract
Many data mining applications, such as spam filtering and intrusion detection, are faced with active adversaries. In all these applications, the future data sets and the training data set are no longer from the same population, due to the transformations employed by the adversaries. Hence a main assumption for the existing classification techniques no longer holds and initially successful classifiers degrade easily. This becomes a game between the adversary and the data miner: The adversary modifies its strategy to avoid being detected by the current classifier; the data miner then updates its classifier based on the new threats. In this paper, we investigate the possibility of an equilibrium in this seemingly never ending game, where neither party has an incentive to change. Modifying the classifier causes too many false positives with too little increase in true positives; changes by the adversary decrease the utility of the false negative items that are not detected. We develop a game theoretic framework where equilibrium behavior of adversarial classification applications can be analyzed, and provide solutions for finding an equilibrium point. A classifier's equilibrium performance indicates its eventual success or failure. The data miner could then select attributes based on their equilibrium performance, and construct an effective classifier. A case study on online lending data demonstrates how to apply the proposed game theoretic framework to a real application.
Year
DOI
Venue
2011
10.1007/s10618-010-0197-3
Data Min. Knowl. Discov.
Keywords
DocType
Volume
Adversarial classification,Game theory,Attribute selection,Simulated annealing
Journal
22
Issue
ISSN
Citations 
1-2
1384-5810
23
PageRank 
References 
Authors
1.24
11
3
Name
Order
Citations
PageRank
Murat Kantarcioglu12470168.03
Bowei Xi21159.58
Chris Clifton33327544.44