Title
Photo Recall: Using the Internet to Label Your Photos
Abstract
We describe a system for searching your personal photos using an extremely wide range of text queries, including dates and holidays (\"Halloween\"), named and categorical places (\"Empire State Building\" or \"park\"), events and occasions (\"Radiohead concert\" or \"wedding\"), activities (\"skiing\"), object categories (\"whales\"), attributes (\"outdoors\"), and object instances (\"Mona Lisa\"), and any combination of these--all with no manual labeling required. We accomplish this by correlating information in your photos--the timestamps, GPS locations, and image pixels--to information mined from the Internet. This includes matching dates to holidays listed on Wikipedia, GPS coordinates to places listed on Wikimapia, places and dates to find named events using Google, visual categories using classifiers either pre-trained on ImageNet or trained on-the-fly using results from Google Image Search, and object instances using interest point-based matching, again using results from Google Images. We tie all of these disparate sources of information together in a unified way, allowing for fast and accurate searches using whatever information you remember about a photo. We quantitatively evaluate several aspects of our system and show excellent performance in all respects. Please watch a video demonstrating our system in action on a large range of queries at http://youtu.be/Se3bemzhAiY.
Year
DOI
Venue
2014
10.1109/CVPRW.2014.120
Computer Vision and Pattern Recognition Workshops
Keywords
Field
DocType
global positioning system,internet,content-based retrieval,geographic information systems,search engines,gps coordinates,gps locations,google image search,imagenet,wikimapia,wikipedia,dates matching,holidays,image pixels,information correlation,interest point-based matching,personal photo searching,photo organization,photo recall,text queries,timestamps,visual categories,content-based image retrieval,events,gps,image search,on-the-fly visual classification
Computer vision,World Wide Web,Information retrieval,Categorical variable,Computer science,Geographic coordinate system,Artificial intelligence,Timestamp,Global Positioning System,Recall,Content-based image retrieval,The Internet
Conference
ISSN
Citations 
PageRank 
2160-7508
2
0.37
References 
Authors
16
2
Name
Order
Citations
PageRank
Neeraj Kumar1162374.67
Steven M. Seitz28729495.13