Title
Hierarchical attribute reduction algorithms for big data using MapReduce.
Abstract
Attribute reduction is one of the important research issues in rough set theory. Most existing attribute reduction algorithms are now faced with two challenging problems. On one hand, they have seldom taken granular computing into consideration. On the other hand, they still cannot deal with big data. To address these issues, the hierarchical encoded decision table is first defined. The relationships of hierarchical decision tables are then discussed under different levels of granularity. The parallel computations of the equivalence classes and the attribute significance are further designed for attribute reduction. Finally, hierarchical attribute reduction algorithms are proposed in data and task parallel using MapReduce. Experimental results demonstrate that the proposed algorithms can scale well and efficiently process big data.
Year
DOI
Venue
2015
10.1016/j.knosys.2014.09.001
Knowledge-Based Systems
Keywords
Field
DocType
Hierarchical attribute reduction,Granular computing,Data and task parallelism,MapReduce,Big data
Data mining,Decision table,Computer science,Algorithm,Theoretical computer science,Rough set,Granular computing,Granularity,Equivalence class,Big data,Computation
Journal
Volume
Issue
ISSN
73
1
0950-7051
Citations 
PageRank 
References 
42
1.04
35
Authors
5
Name
Order
Citations
PageRank
Jin Qian1947.10
Ping Lv2495.00
Xiaodong Yue324821.94
Caihui Liu41375.89
Zhengjun Jing5421.38