Title
Adaptive graph-based generalized regression model for unsupervised feature selection
Abstract
Unsupervised feature selection is an important method to reduce dimensions of high-dimensional data without labels, which is beneficial to avoid “curse of dimensionality” and improve the performance of subsequent machine learning tasks, like clustering and retrieval. A lot of methods have been developed in recent years. However, most of them only focus on selecting discriminative features but ignore the redundancy of features. Besides, these methods construct the similarity structure of data in the original input space and remain fixed during feature selection. The similarity structure is easily affected by the noises and outliers. Then the reliability of the similarity structure will be reduced in the procedure of feature selection. In order to address these issues, we present a novel generalized regression model equipped with an uncorrelated constraint and the ℓ2,1-norm regularization. It can simultaneously select the uncorrelated and discriminative features as well as reduce the variance of these data points belonging to the same neighborhood, which is helpful for the clustering task. Furthermore, to obtain the similarity structure of data and alleviate the influence of noises and outliers, we propose to adaptively learn a similarity-induced graph matrix in the reduced space and integrate it into the generalized regression model. An alternative iterative optimization algorithm is developed to solve the final objective function. A series of experiments are carried out on nine real-world data sets to demonstrate the effectiveness of the proposed method in comparison with other competing approaches.
Year
DOI
Venue
2021
10.1016/j.knosys.2021.107156
Knowledge-Based Systems
Keywords
DocType
Volume
Unsupervised feature selection,Generalized regression model,Adaptive graph learning
Journal
227
ISSN
Citations 
PageRank 
0950-7051
2
0.36
References 
Authors
41
5
Name
Order
Citations
PageRank
Yanyong Huang1193.57
Zongxin Shen220.70
Fuxu Cai320.36
Tianrui Li43176191.76
Fengmao Lv5273.49