Title
3d Shape Segmentation Based On Viewpoint Entropy And Projective Fully Convolutional Networks Fusing Multi-View Features
Abstract
This paper introduces an architecture for segmenting 3D shapes into labeled semantic parts. Our architecture combines viewpoint selection method based on viewpoint entropy, multi-view image-based Fully Convolutional Networks (FCNs) and graph cuts optimization method to yield coherent segmentation of 3D shapes. First, we select iteratively a fixed number of perspectives with the maximum viewpoint entropy from existing viewpoints that can cover the shape's triangles, to maximally and automatically adjust the distance between the viewpoint and the center point of the shape to make sure the shape projected to fill the render window as wide as possible. Second, the image-based FCN is used for efficient view-based reasoning about 3D shape parts. In this process, global features generated by max view pooling are concatenated with every single view's feature in the fully connected layer before upsampling. Then, the multi-view FCN outputs confidence maps per part, which are then input into the projection layer that contains the mapping relationship of every shape's triangles and their projective pixels' positions in the rendered images from selected perspectives. And then, the FCN outputs are projected back onto 3D shape surfaces. and max view pooling is applied to the output of the projection layer so that every triangle of each shape has a unique probability for each label. Finally, graph cuts algorithm is implemented for the final segmentation result.
Year
DOI
Venue
2018
10.1109/ICPR.2018.8545586
2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR)
Keywords
Field
DocType
3D shape segmentation, viewpoint entropy, CNN, FCN, graph cuts
Cut,Computer vision,Pattern recognition,Segmentation,Computer science,Pooling,Image segmentation,Concatenation,Pixel,Artificial intelligence,Upsampling,Projective test
Conference
ISSN
Citations 
PageRank 
1051-4651
0
0.34
References 
Authors
0
7
Name
Order
Citations
PageRank
Panpan Shui100.34
zhengxing sun225245.27
Fenggen Yu371.76
Bingyang Hu442.11
Yuan Gan5754.03
Kun Liu65715.38
yan zhang76720.55