Title
FAST-Dy namic-Vision: Detection and Tracking Dynamic Objects with Event and Depth Sensing
Abstract
The development of aerial autonomy has enabled aerial robots to fly agilely in complex environments. However, dodging fast-moving objects in flight remains a challenge, limiting the further application of unmanned aerial vehicles (UAVs). The bottleneck of solving this problem is the accurate perception of rapid dynamic objects. Recently, event cameras have shown great potential in solving this problem. This paper presents a complete perception system including ego-motion compensation, object detection, and trajectory prediction for fast-moving dynamic objects with low latency and high precision. Firstly, we propose an accurate ego-motion compensation algorithm by considering both rotational and translational motion for more robust object detection. Then, for dynamic object detection, an event camera-based efficient regression algorithm is designed. Finally, we propose an optimization-based approach that asynchronously fuses event and depth cameras for trajectory prediction. Extensive real-world experiments and benchmarks are performed to validate our framework. Moreover, our code will be released to benefit related researches.
Year
DOI
Venue
2021
10.1109/IROS51168.2021.9636448
2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS)
DocType
ISSN
Citations 
Conference
2153-0858
1
PageRank 
References 
Authors
0.35
0
8
Name
Order
Citations
PageRank
Baotao He110.35
Haojia Li210.35
Siyuan Wu3144.99
Dong Wang410.35
Zhiwei Zhang510.35
Qianli Dong610.35
Chao Xu713633.20
Fei Gao8811.31