Abstract | ||
---|---|---|
A parameterless feature ranking approach is presented for feature selection in the pattern classification task. Compared with Battiti's mutual information feature selection (MIFS) and Kwak and Choi's MIFS-U methods, the proposed method derives an estimation of the conditional MI between the candidate feature f"i and the output class C given the subset of selected features S, i.e. I(C;f"i|S), without any parameters like @b in MIFS and MIFS-U methods to be preset. Thus, the intractable problem can be avoided completely, which is how to choose an appropriate value for @b to achieve the tradeoff between the relevance to the output classes and the redundancy with the already-selected features. Furthermore, a modified greedy feature selection algorithm called the second order MI feature selection approach (SOMIFS) is proposed. Experimental results demonstrate the superiority of SOMIFS in terms of both synthetic and benchmark data sets. |
Year | DOI | Venue |
---|---|---|
2008 | 10.1016/j.neucom.2007.04.012 | Neurocomputing |
Keywords | Field | DocType |
second order,feature selection,mutual information,machine learning | Data mining,Data set,Mutual information feature selection,Feature selection,Feature ranking,Redundancy (engineering),Artificial intelligence,Pattern recognition,Feature (computer vision),Algorithm,Minimum redundancy feature selection,Mutual information,Machine learning,Mathematics | Journal |
Volume | Issue | ISSN |
71 | 7-9 | 0925-2312 |
Citations | PageRank | References |
12 | 0.56 | 34 |
Authors | ||
3 |
Name | Order | Citations | PageRank |
---|---|---|---|
Jinjie Huang | 1 | 156 | 7.63 |
Yunze Cai | 2 | 346 | 24.82 |
Xiaoming Xu | 3 | 223 | 10.15 |