Title
Multi-scale context for scene labeling via flexible segmentation graph.
Abstract
Using contextual information for scene labeling has gained substantial attention in the fields of image processing and computer vision. In this paper, a fusion model using flexible segmentation graph (FSG) is presented to explore multi-scale context for scene labeling problem. Given a family of segmentations, the representation of FSG is established based on the spatial relationship of these segmentations. In the scenario of FSG, the labeling inference process is formulated as a contextual fusion model, trained from the discriminative classifiers. Compared to previous approaches, which usually employ Conditional Random Fields (CRFs) or hierarchical models to explore contextual information, our FSG representation is flexible and efficient without hierarchical constraint, allowing us to capture a wide variety of visual context for the task of scene labeling. Our approach yields state-of-the-art results on the MSRC dataset (21 classes) and the LHI dataset (15 classes), and near-record results on the SIFT Flow dataset (33 classes) and PASCAL VOC segmentation dataset (20 classes), while producing a 320×240 scene labeling in less than a second. A remarkable fact is that our approach also outperforms recent CNN-based methods. HighlightsWe propose a novel flexible segmentation graph (FSG) representation to capture multi-scale visual context for scene labeling problem.In the scenario of FSG, we establish a contextual fusion model to formulate multi-scale context.We have evaluated our method on four datasets. Our model yields similar to or better labeling result than competing models, and is also computationally efficient.
Year
DOI
Venue
2016
10.1016/j.patcog.2016.03.023
Pattern Recognition
Keywords
Field
DocType
Scene labeling,Semantic segmentation,Multi-scale context,Flexible segmentation graph,Feature extraction,Classification
Conditional random field,Scale-invariant feature transform,Pattern recognition,Segmentation,Computer science,Image processing,Feature extraction,Artificial intelligence,Connected-component labeling,Discriminative model,CRFS,Machine learning
Journal
Volume
Issue
ISSN
59
C
0031-3203
Citations 
PageRank 
References 
14
0.54
38
Authors
4
Name
Order
Citations
PageRank
Quan Zhou1565.31
Baoyu Zheng2100882.73
Wei-Ping Zhu355562.46
Longin Jan Latecki43301176.88