Title
Describable Visual Attributes for Face Verification and Image Search
Abstract
We introduce the use of describable visual attributes for face verification and image search. Describable visual attributes are labels that can be given to an image to describe its appearance. This paper focuses on images of faces and the attributes used to describe them, although the concepts also apply to other domains. Examples of face attributes include gender, age, jaw shape, nose size, etc. The advantages of an attribute-based representation for vision tasks are manifold: they can be composed to create descriptions at various levels of specificity; they are generalizable, as they can be learned once and then applied to recognize new objects or categories without any further training; and they are efficient, possibly requiring exponentially fewer attributes (and training data) than explicitly naming each category. We show how one can create and label large datasets of real-world images to train classifiers which measure the presence, absence, or degree to which an attribute is expressed in images. These classifiers can then automatically label new images. We demonstrate the current effectiveness -- and explore the future potential -- of using attributes for face verification and image search via human and computational experiments. Finally, we introduce two new face datasets, named FaceTracer and PubFig, with labeled attributes and identities, respectively.
Year
DOI
Venue
2011
10.1109/TPAMI.2011.48
Pattern Analysis and Machine Intelligence, IEEE Transactions
Keywords
Field
DocType
content-based retrieval,face recognition,image classification,image representation,image retrieval,FaceTracer,PubFig,attribute classification,attribute-based representation,content-based image retrieval,describable visual attributes,face recognition,face verification,feature selection,image search,Face recognition,attribute classification,classifier training,content-based image retrieval,feature selection,image search.
Face verification,Computer vision,Facial recognition system,Data set,Pattern recognition,Feature selection,Visualization,Computer science,Image retrieval,Artificial intelligence,Contextual image classification,Content-based image retrieval
Journal
Volume
Issue
ISSN
33
10
0162-8828
Citations 
PageRank 
References 
222
6.77
50
Authors
4
Search Limit
100222
Name
Order
Citations
PageRank
Neeraj Kumar1162374.67
Alexander C. Berg210554630.24
Peter N. Belhumeur3122421001.27
Shree K. Nayar4123941538.46