Title
Scalable Scene Flow From Point Clouds in the Real World
Abstract
Autonomous vehicles operate in highly dynamic environments necessitating an accurate assessment of which aspects of a scene are moving and where they are moving to. A popular approach to 3D motion estimation, termed scene flow, is to employ 3D point cloud data from consecutive LiDAR scans, although such approaches have been limited by the small size of real-world, annotated LiDAR data. In this work, we introduce a new largescale dataset for scene flow estimation derived from corresponding tracked 3D objects, which is similar to 1, 000x larger than previous real-world datasets in terms of the number of annotated frames. We demonstrate how previous works were bounded by the amount of real LiDAR data available, suggesting that larger datasets are required to achieve state-of-the-art predictive performance. Furthermore, we show how previous heuristics such as down-sampling heavily degrade performance, motivating a new class of models that are tractable on the full point cloud. To address this issue, we introduce the FastFlow3D architecture which provides real time inference on the full point cloud. Additionally, we design human-interpretablemetrics that better capture realworld aspects by accounting for ego-motion and providing breakdowns per object type. We hope that this dataset may provide new opportunities for developing real world scene flow systems.
Year
DOI
Venue
2022
10.1109/LRA.2021.3139542
IEEE ROBOTICS AND AUTOMATION LETTERS
Keywords
DocType
Volume
Deep learning for visual perception, data sets for robot learning
Journal
7
Issue
ISSN
Citations 
2
2377-3766
0
PageRank 
References 
Authors
0.34
0
5
Name
Order
Citations
PageRank
Philipp Jund100.34
Chris Sweeney21017.42
Nichola Abdo300.34
Zhifeng Chen42747106.75
Jonathon Shlens53851153.79