Title
Learning to Group and Label Fine-Grained Shape Components.
Abstract
A majority of stock 3D models in modern shape repositories are assembled with many fine-grained components. The main cause of such data form is the component-wise modeling process widely practiced by human modelers. These modeling components thus inherently reflect some function-based shape decomposition the artist had in mind during modeling. On the other hand, modeling components represent an over-segmentation since a functional part is usually modeled as a multi-component assembly. Based on these observations, we advocate that labeled segmentation of stock 3D models should not overlook the modeling components and propose a learning solution to grouping and labeling of the fine-grained components. However, directly characterizing the shape of individual components for the purpose of labeling is unreliable, since they can be arbitrarily tiny and semantically meaningless. We propose to generate part hypotheses from the components based on a hierarchical grouping strategy, and perform labeling on those part groups instead of directly on the components. Part hypotheses are mid-level elements which are more probable to carry semantic information. A multi-scale 3D convolutional neural network is trained to extract context-aware features for the hypotheses. To accomplish a labeled segmentation of the whole shape, we formulate higher-order conditional random fields (CRFs) to infer an optimal label assignment for all components. Extensive experiments demonstrate that our method achieves significantly robust labeling results on raw 3D models from public shape repositories. Our work also contributes the first benchmark for component-wise labeling.
Year
DOI
Venue
2018
10.1145/3272127.3275009
ACM Trans. Graph.
Keywords
DocType
Volume
data-driven shape analysis, fine-grained components, part hypotheses, semantic labeling, shape segmentation
Journal
abs/1809.05050
Issue
ISSN
Citations 
6
ACM Transactions on Graphics, 2018
3
PageRank 
References 
Authors
0.38
25
6
Name
Order
Citations
PageRank
Xiaogang Wang1918.84
Bin Zhou2253.80
Haiyue Fang330.38
Xiaowu Chen460545.05
Qinping Zhao536343.20
Kai Xu693450.68