Title
Relating Input Concepts to Convolutional Neural Network Decisions.
Abstract
Many current methods to interpret convolutional neural networks (CNNs) use visualization techniques and words to highlight concepts of the input seemingly relevant to a CNNu0027s decision. The methods hypothesize that the recognition of these concepts are instrumental in the decision a CNN reaches, but the nature of this relationship has not been well explored. To address this gap, this paper examines the quality of a conceptu0027s recognition by a CNN and the degree to which the recognitions are associated with CNN decisions. The study considers a CNN trained for scene recognition over the ADE20k dataset. It uses a novel approach to find and score the strength of minimally distributed representations of input concepts (defined by objects in scene images) across late stage feature maps. Subsequent analysis finds evidence that concept recognition impacts decision making. Strong recognition of concepts frequently-occurring in few scenes are indicative of correct decisions, but recognizing concepts common to many scenes may mislead the network.
Year
Venue
Field
2017
arXiv: Learning
Convolutional neural network,Concept recognition,Artificial intelligence,Machine learning,Mathematics,Creative visualization
DocType
Volume
Citations 
Journal
abs/1711.08006
2
PageRank 
References 
Authors
0.40
13
5
Name
Order
Citations
PageRank
Ning Xie1709.29
Md. Kamruzzaman Sarker231.76
Derek Doran3153.76
Pascal Hitzler42383191.06
michael l raymer57011.20