Title
A global energy optimization framework for 2.1D sketch extraction from monocular images
Abstract
The 2.1D sketch is a layered image representation, which assigns a partial depth ordering of over-segmented regions in a monocular image. This paper presents a global optimization framework for inferring the 2.1D sketch from a monocular image. Our method only uses over-segmented image regions (i.e., superpixels) as input, without any information of objects in the image, since (1) segmenting objects in images is a difficult problem on its own and (2) the objective of our proposed method is to be generic as an initial module useful for downstream high-level vision tasks. This paper formulates the inference of the 2.1D sketch using a global energy optimization framework. The proposed energy function consists of two components: (1) one is defined based on the local partial ordering relations (i.e., figure-ground) between two adjacent over-segmented regions, which captures the marginal information of the global partial depth ordering and (2) the other is defined based on the same depth layer relations among all the over-segmented regions, which groups regions of the same object to account for the over-segmentation issues. A hybrid evolution algorithm is utilized to minimize the global energy function efficiently. In experiments, we evaluated our method on a test data set containing 100 diverse real images from Berkeley segmentation data set (BSDS500) with the annotated ground truth. Experimental results show that our method can infer the 2.1D sketch with high accuracy.
Year
DOI
Venue
2014
10.1016/j.gmod.2014.03.015
Graphical Models
Keywords
Field
DocType
2.1d sketch,global optimization,hybrid differential evolution,local features
Computer vision,Global optimization,Segmentation,Ground truth,Test data,Artificial intelligence,Real image,Monocular,Partially ordered set,Mathematics,Sketch
Journal
Volume
Issue
ISSN
76
5
1524-0703
Citations 
PageRank 
References 
11
0.53
26
Authors
5
Name
Order
Citations
PageRank
Cheng-Chi Yu1241.45
Yong-Jin Liu283772.83
Matt Tianfu Wu3110.53
Kai-Yun Li4110.53
Xiaolan Fu578660.72