Title
A parameterless feature ranking algorithm based on MI
Abstract
A parameterless feature ranking approach is presented for feature selection in the pattern classification task. Compared with Battiti's mutual information feature selection (MIFS) and Kwak and Choi's MIFS-U methods, the proposed method derives an estimation of the conditional MI between the candidate feature f"i and the output class C given the subset of selected features S, i.e. I(C;f"i|S), without any parameters like @b in MIFS and MIFS-U methods to be preset. Thus, the intractable problem can be avoided completely, which is how to choose an appropriate value for @b to achieve the tradeoff between the relevance to the output classes and the redundancy with the already-selected features. Furthermore, a modified greedy feature selection algorithm called the second order MI feature selection approach (SOMIFS) is proposed. Experimental results demonstrate the superiority of SOMIFS in terms of both synthetic and benchmark data sets.
Year
DOI
Venue
2008
10.1016/j.neucom.2007.04.012
Neurocomputing
Keywords
Field
DocType
second order,feature selection,mutual information,machine learning
Data mining,Data set,Mutual information feature selection,Feature selection,Feature ranking,Redundancy (engineering),Artificial intelligence,Pattern recognition,Feature (computer vision),Algorithm,Minimum redundancy feature selection,Mutual information,Machine learning,Mathematics
Journal
Volume
Issue
ISSN
71
7-9
0925-2312
Citations 
PageRank 
References 
12
0.56
34
Authors
3
Name
Order
Citations
PageRank
Jinjie Huang11567.63
Yunze Cai234624.82
Xiaoming Xu322310.15