Title
Visualizing the Hidden Activity of Artificial Neural Networks.
Abstract
In machine learning, pattern classification assigns high-dimensional vectors (observations) to classes based on generalization from examples. Artificial neural networks currently achieve state-of-the-art results in this task. Although such networks are typically used as black-boxes, they are also widely believed to learn (high-dimensional) higher-level representations of the original observations. In this paper, we propose using dimensionality reduction for two tasks: visualizing the relationships between learned representations of observations, and visualizing the relationships between artificial neurons. Through experiments conducted in three traditional image classification benchmark datasets, we show how visualization can provide highly valuable feedback for network designers. For instance, our discoveries in one of these datasets (SVHN) include the presence of interpretable clusters of learned representations, and the partitioning of artificial neurons into groups with apparently related discriminative roles.
Year
DOI
Venue
2017
10.1109/TVCG.2016.2598838
IEEE Trans. Vis. Comput. Graph.
Keywords
Field
DocType
Neurons,Visualization,Data visualization,Training,Neural networks,Computational modeling,Benchmark testing
Data visualization,Dimensionality reduction,Computer science,Visualization,Artificial intelligence,Artificial neural network,Contextual image classification,Discriminative model,Machine learning,Benchmark (computing)
Journal
Volume
Issue
ISSN
23
1
1077-2626
Citations 
PageRank 
References 
67
1.72
28
Authors
4
Name
Order
Citations
PageRank
Paulo E. Rauber1976.74
Samuel G. Fadel2945.34
Alexandre X. Falcão31877132.30
Alexandru Telea41520107.14