Title
Extract Interpretability-Accuracy balanced Rules from Artificial Neural Networks: A Review
Abstract
Artificial neural networks (ANN) have been widely used and have achieved remarkable achievements. However, neural networks with high accuracy and good performance often have extremely complex internal structures such as deep neural networks (DNN). This shortcoming makes the neural networks as incomprehensible as a black box, which is unacceptable in some practical applications. But pursuing excessive interpretation of the neural networks will make the performance of the model worse. Based on this contradictory issue, we first summarize the mainstream methods about quantitatively evaluating the accuracy and interpretability of rule set. And then review existing methods on extracting rules from Multilayer Perceptron (MLP) and DNN in three categories: Decomposition Approach (Extract rules in neuron level such as visualizing the structure of network), Pedagogical Approach (By studying the correspondence between input and output such as by computing gradient) and Eclectics Approach (Combine the above two ideas). Some potential research directions about extracting rules from DNN are discussed in the last.
Year
DOI
Venue
2020
10.1016/j.neucom.2020.01.036
Neurocomputing
Keywords
DocType
Volume
Rule extraction,Accuracy,Interpretability,Multilayer Perceptron,Deep neural network
Journal
387
Issue
ISSN
Citations 
C
0925-2312
2
PageRank 
References 
Authors
0.36
0
3
Name
Order
Citations
PageRank
Congjie He120.36
Meng Ma27815.71
Ping Wang314914.37