Title
Weakly Supervised Learning for Attribute Localization in Outdoor Scenes
Abstract
In this paper, we propose a weakly supervised method for simultaneously learning scene parts and attributes from a collection of images associated with attributes in text, where the precise localization of the each attribute left unknown. Our method includes three aspects. (i) Compositional scene configuration. We learn the spatial layouts of the scene by Hierarchical Space Tiling (HST) representation, which can generate an excessive number of scene configurations through the hierarchical composition of a relatively small number of parts. (ii) Attribute association. The scene attributes contain nouns and adjectives corresponding to the objects and their appearance descriptions respectively. We assign the nouns to the nodes (parts) in HST using nonmaximum suppression of their correlation, then train an appearance model for each noun+adjective attribute pair. (iii) Joint inference and learning. For an image, we compute the most probable parse tree with the attributes as an instantiation of the HST by dynamic programming. Then update the HST and attribute association based on the inferred parse trees. We evaluate the proposed method by (i) showing the improvement of attribute recognition accuracy, and (ii) comparing the average precision of localizing attributes to the scene parts.
Year
DOI
Venue
2013
10.1109/CVPR.2013.400
CVPR
Keywords
Field
DocType
compositional scene configuration,attribute association,scene configuration,localizing attribute,scene part,scene attribute,attribute localization,attribute recognition accuracy,outdoor scenes,weakly supervised learning,adjective attribute pair,weakly supervised method,image segmentation,dynamic programming,text analysis,semantics,nouns,learning artificial intelligence,appearance model,dictionaries,layout,support vector machines
Computer vision,Parse tree,Pattern recognition,Computer science,Support vector machine,Noun,Supervised learning,Image segmentation,Active appearance model,Artificial intelligence,Parsing,Attribute domain
Conference
Volume
Issue
ISSN
2013
1
1063-6919
Citations 
PageRank 
References 
23
0.81
14
Authors
4
Name
Order
Citations
PageRank
Shuo Wang1362.41
Jungseock Joo2524.61
Yizhou Wang3116286.04
Song-Chun Zhu46580741.75