Title
GLSNet: Global and Local Streams Network for 3D Point Cloud Classification
Abstract
We propose a novel deep architecture for semantic labeling of 3D point clouds referred to as Global and Local Streams Network (GLSNet) which is designed to capture both global and local structures and contextual information for large scale 3D point cloud classification. Our GLSNet tackles a hard problem - large differences of object sizes in large-scale point cloud segmentation including extremely large objects like water, and small objects like buildings and trees, and we design a two-branch deep network architecture to decompose the complex problem to separate processing problems at global and local scales and then fuse their predictions. GLSNet combines the strength of Submanifold Sparse Convolutional Network [1] for learning global structure with the strength of PointNet++ [2] for incorporating local information. The first branch of GLSNet processes a full point cloud in the global stream, and it captures long range information about the geometric structure by using a U-Net structured Submanifold Sparse Convolutional Network (SSCN-U) architecture. The second branch of GLSNet processes a point cloud in the local stream, and it partitions 3D points into slices and processes one slice of the cloud at a time by using the PointNet ++ architecture. The two streams of information are fused by max pooling over their classification prediction vectors. Our results on the IEEE GRSS Data Fusion Contest Urban Semantic 3D, Track 4 (DFT4) [3] [4] [5] point cloud classification dataset have shown that GLSNet achieved performance gains of almost 4% in mIOU and 1% in overall accuracy over the individual streams on the held-back testing dataset.
Year
DOI
Venue
2019
10.1109/AIPR47015.2019.9174587
2019 IEEE Applied Imagery Pattern Recognition Workshop (AIPR)
Keywords
DocType
ISSN
Point clouds,3D semantic segmentation,Global and local streams
Conference
1550-5219
ISBN
Citations 
PageRank 
978-1-7281-4733-8
0
0.34
References 
Authors
2
5
Name
Order
Citations
PageRank
Rina Bao101.01
Kannappan Palaniappan292075.13
Yunxin Zhao3807121.74
Guna Seetharaman458444.59
wenjun zeng52029220.14