Title
Manitest: Are classifiers really invariant?
Abstract
Invariance to geometric transformations is a highly desirable property of automatic classifiers in many image recognition tasks. Nevertheless, it is unclear to which extent state-of-the-art classifiers are invariant to basic transformations such as rotations and translations. This is mainly due to the lack of general methods that properly measure such an invariance. In this paper, we propose a rigorous and systematic approach for quantifying the invariance to geometric transformations of any classifier. Our key idea is to cast the problem of assessing a classifier's invariance as the computation of geodesics along the manifold of transformed images. We propose the Manitest method, built on the efficient Fast Marching algorithm to compute the invariance of classifiers. Our new method quantifies in particular the importance of data augmentation for learning invariance from data, and the increased invariance of convolutional neural networks with depth. We foresee that the proposed generic tool for measuring invariance to a large class of geometric transformations and arbitrary classifiers will have many applications for evaluating and comparing classifiers based on their invariance, and help improving the invariance of existing classifiers.
Year
DOI
Venue
2015
10.5244/C.29.106
british machine vision conference
Field
DocType
Volume
Pattern recognition,Invariant (physics),Convolutional neural network,Computer science,Fast marching method,Random subspace method,Transformation geometry,Invariant (mathematics),Artificial intelligence,Classifier (linguistics),Machine learning,Computation
Journal
abs/1507.06535
Citations 
PageRank 
References 
8
1.95
18
Authors
2
Name
Order
Citations
PageRank
Alhussein Fawzi176636.80
Pascal Frossard23015230.41