Title
Mining Exoticism from Visual Content with Fusion-based Deep Neural Networks.
Abstract
Exoticism is the charm of the unfamiliar or something remote. It has received significant interest in different kinds of arts, but although visual concept classification in images and videos for semantic multimedia retrieval has been researched for years, the visual concept of exoticism has not been investigated yet from a computational perspective. In this paper, we present the first approach to automatically classify images as exotic or non-exotic. We have gathered two large datasets that cover exoticism in a general as well as a concept-specific way. The datasets have been annotated in a crowdsourcing approach. To circumvent cultural differences in the annotation, only North American crowdworkers are employed for this task. Two deep learning architectures to learn the concept of exoticism are evaluated. Besides deep learning features, we also investigate the usefulness of hand-crafted features, which are combined with deep features in our proposed fusion-based approach. Different machine learning models are compared with the fusion-based approach, which is the best performing one, reaching an accuracy over 83% and 91% on two different datasets. Comprehensive experimental results provide insights into which features contribute at most to recognizing exoticism. The estimation of image exoticism could be applied in fields like advertising and travel suggestions, as well as to increase serendipity and diversity of recommendations and search results.
Year
DOI
Venue
2019
10.1145/3206025.3206044
ICMR
Keywords
DocType
ISBN
Image retrieval, Visual concept classification, Exoticism
Journal
978-1-4503-5046-4
Citations 
PageRank 
References 
0
0.34
41
Authors
3
Name
Order
Citations
PageRank
Andrea Ceroni1547.52
Chenyang Ma200.34
Ralph Ewerth322234.62