Title
Cultural Event Recognition with Visual ConvNets and Temporal Models.
Abstract
This paper presents our contribution to the ChaLearn Challenge 2015 on Cultural Event Classification. The challenge in this task is to automatically classify images from 50 different cultural events. Our solution is based on the combination of visual features extracted from convolutional neural networks with temporal information using a hierarchical classifier scheme. We extract visual features from the last three fully connected layers of both CaffeNet (pre trained with ImageNet) and our fine tuned version for the ChaLearn challenge. We propose a late fusion strategy that trains a separate low-level SVM on each of the extracted neural codes. The class predictions of the low-level SVMs form the input to a higher level SVM, which gives the final event scores. We achieve our best result by adding a temporal refinement step into our classification scheme, which is applied directly to the output of each low-level SVM. Our approach penalizes high classification scores based on visual features when their time stamp does not match well an event-specific temporal distribution learned from the training and validation data. Our system achieved the second best result in the ChaLearn Challenge 2015 on Cultural Event Classification with a mean average precision of 0.767 on the test set.
Year
DOI
Venue
2015
10.1109/CVPRW.2015.7301334
CVPR Workshops
Field
DocType
Volume
Convolutional neural network,Computer science,Artificial intelligence,Hierarchical classifier,Metadata,Computer vision,Pattern recognition,Visualization,Support vector machine,Feature extraction,Timestamp,Machine learning,Test set
Journal
abs/1504.06567
Issue
ISSN
Citations 
1
2160-7508
11
PageRank 
References 
Authors
0.58
21
5
Name
Order
Citations
PageRank
Amaia Salvador11227.62
Daniel Manchon-Vizuete2110.58
Andrea Calafell3110.58
Xavier Giró428832.23
Matthias Zeppelzauer518621.35