Title
The metric structure of weight space
Abstract
We describe symmetries of feedforward networks in terms of theircorresponding groups, which naturally act on and partition weight space.This leads to an algorithm that generates representative weight vectors ina specific fundamental domain. The closure of this domain turns out to bea manifold with singular points. We derive a canonical metric for themanifold that can be implemented efficiently even for large networks. Oneapplication would be the clustering of resulting weight vectors of anexperiment in order to identify inadequate models or learning methods.
Year
DOI
Venue
1997
10.1023/A:1009657318698
Neural Processing Letters
Keywords
Field
DocType
canonical metric,clustering in weight space,fundamental domain,symmetries,weight space
Topology,Fisher information metric,Pseudometric space,Convex metric space,Intrinsic metric,Metric (mathematics),Statistical manifold,Pseudo-Riemannian manifold,Mathematics,Injective metric space
Journal
Volume
Issue
ISSN
5
2
1573-773X
Citations 
PageRank 
References 
2
0.42
4
Authors
2
Name
Order
Citations
PageRank
Stefan M. Rüger149951.53
Arnfried Ossen271.72