Name
Abstract | ||
|---|---|---|
Feature selection, especially for large data sets, is a challenging problem in areas such as pattern recognition, machine learning and data mining. With the development of data collection and storage technologies, the data has become bigger than ever, thus making it difficult for learning from large data sets with traditional methods. In this paper, we introduce the partition differentiation entropy from the viewpoint of partition in rough sets to measure the significance and uncertainty of attributes, and present a feature selection method for large-scale data sets based on the information-theoretical measurement of attribute significance. Given a large-scale decision information system, the proposed method first divides it into small sub information systems according to the decision classes. Then by computing partition differentiation entropy in the sub-systems, the partition differentiation entropy of the attribute subset in the original decision information system is obtained. Accordingly, the important features are selected based on the value of partition differentiation entropy. The experimental results show that the idea of the proposed method is feasible and valid. |
Year | DOI | Venue |
|---|---|---|
2016 | 10.1016/j.ins.2015.10.002 | Information Sciences |
Keywords | Field | DocType |
Feature selection,Partition differentiation entropy,Attributes significance,Large-scale data sets,Uncertainty | Information system,Data mining,Data collection,Data set,Feature selection,Rough set,Artificial intelligence,Partition (number theory),Partition refinement,Machine learning,Mathematics | Journal |
Volume | ISSN | Citations |
329 | 0020-0255 | 11 |
PageRank | References | Authors |
0.53 | 27 | 3 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Fachao Li | 1 | 157 | 22.30 |
| Zan Zhang | 2 | 16 | 2.65 |
| Chenxia Jin | 3 | 101 | 13.20 |