Title
Heterogeneous feature subset selection using mutual information-based feature transformation
Abstract
Conventional mutual information (MI) based feature selection (FS) methods are unable to handle heterogeneous feature subset selection properly because of data format differences or estimation methods of MI between feature subset and class label. A way to solve this problem is feature transformation (FT). In this study, a novel unsupervised feature transformation (UFT) which can transform non-numerical features into numerical features is developed and tested. The UFT process is MI-based and independent of class label. MI-based FS algorithms, such as Parzen window feature selector (PWFS), minimum redundancy maximum relevance feature selection (mRMR), and normalized MI feature selection (NMIFS), can all adopt UFT for pre-processing of non-numerical features. Unlike traditional FT methods, the proposed UFT is unbiased while PWFS is utilized to its full advantage. Simulations and analyses of large-scale datasets showed that feature subset selected by the integrated method, UFT-PWFS, outperformed other FT-FS integrated methods in classification accuracy.
Year
DOI
Venue
2015
10.1016/j.neucom.2015.05.053
Neurocomputing
Keywords
DocType
Volume
Feature subset selection,Feature transformation,Mutual information,Heterogeneous features
Journal
168
Issue
ISSN
Citations 
C
0925-2312
14
PageRank 
References 
Authors
0.51
41
3
Name
Order
Citations
PageRank
Min Wei1151.20
Tommy W. S. Chow21904141.76
Rosa H M Chan318222.79