Title
Discriminative Learning of Deep Convolutional Feature Point Descriptors
Abstract
Deep learning has revolutionalized image-level tasks such as classification, but patch-level tasks, such as correspondence, still rely on hand-crafted features, e.g. SIFT. In this paper we use Convolutional Neural Networks (CNNs) to learn discriminant patch representations and in particular train a Siamese network with pairs of (non-)corresponding patches. We deal with the large number of potential pairs with the combination of a stochastic sampling of the training set and an aggressive mining strategy biased towards patches that are hard to classify. By using the L2 distance during both training and testing we develop 128-D descriptors whose euclidean distances reflect patch similarity, and which can be used as a drop-in replacement for any task involving SIFT. We demonstrate consistent performance gains over the state of the art, and generalize well against scaling and rotation, perspective transformation, non-rigid deformation, and illumination changes. Our descriptors are efficient to compute and amenable to modern GPUs, and are publicly available.
Year
DOI
Venue
2015
10.1109/ICCV.2015.22
ICCV
Keywords
Field
DocType
discriminative learning,deep convolutional feature point descriptors,convolutional neural networks,CNN,discriminant patch representations,Siamese network training,stochastic sampling,mining strategy,Euclidean distance,SIFT,L2 distance,image classification
Scale-invariant feature transform,Convolutional neural network,Computer science,Artificial intelligence,Euclidean geometry,Deep learning,Scaling,Computer vision,Pattern recognition,Discriminant,Feature extraction,Sampling (statistics),Machine learning
Conference
Volume
Issue
ISSN
2015
1
1550-5499
Citations 
PageRank 
References 
116
2.40
21
Authors
6
Search Limit
100116
Name
Order
Citations
PageRank
Edgar Simo-Serra164627.31
Eduard Trulls231811.07
Luis Ferraz31333.40
Iasonas Kokkinos4252888.22
Pascal Fua512768731.45
Francesc Moreno-Noguer6164793.46