Paper Info
Title
Delving Deep into Personal Photo and Video Search.
Abstract
The ubiquity of mobile devices and cloud services has led to an unprecedented growth of online personal photo and video collections. Due to the scarcity of personal media search log data, research to date has mainly focused on searching images and videos on the web. However, in order to manage the exploding amount of personal photos and videos, we raise a fundamental question: what are the differences and similarities when users search their own photos versus the photos on the web? To the best of our knowledge, this paper is the first to study personal media search using large-scale real-world search logs. We analyze different types of search sessions mined from Flickr search logs and discover a number of interesting characteristics of personal media search in terms of information needs and click behaviors. The insightful observations will not only be instrumental in guiding future personal media search methods, but also benefit related tasks such as personal photo browsing and recommendation. Our findings suggest there is a significant gap between personal queries and automatically detected concepts, which is responsible for the low accuracy of many personal media search queries. To bridge the gap, we propose the deep query understanding model to learn a mapping from the personal queries to the concepts in the clicked photos. Experimental results verify the efficacy of the proposed method in improving personal media search, where the proposed method consistently outperforms baseline methods.
Year
DOI
Venue
2017
10.1145/3018661.3018736
WSDM
Keywords
Field
DocType
Content-based Image Search, Search Log Analysis, Deep Learning, Recurrent Neural Networks
Data mining,World Wide Web,Information needs,Information retrieval,Semantic search,Personal information management,Computer science,Mobile device,Artificial intelligence,Deep learning,Photo browsing,Cloud computing
Conference
Citations 
PageRank 
References 
6
0.47
40
Authors
6
Name
Order
Citations
PageRank
Jiang Lu175537.16
Yannis Kalantidis286233.05
liangliang cao3181690.71
Sachin Sudhakar Farfade41244.94
Jiliang Tang53323140.81
Alexander G. Hauptmann67472558.23