Name
Title | ||
|---|---|---|
Asynchronous Spatio-Temporal Memory Network for Continuous Event-Based Object Detection |
Abstract | ||
|---|---|---|
Event cameras, offering extremely high temporal resolution and high dynamic range, have brought a new perspective to addressing common object detection challenges (e.g., motion blur and low light). However, how to learn a better spatio-temporal representation and exploit rich temporal cues from asynchronous events for object detection still remains an open issue. To address this problem, we propose a novel asynchronous spatio-temporal memory network (ASTMNet) that directly consumes asynchronous events instead of event images prior to processing, which can well detect objects in a continuous manner. Technically, ASTMNet learns an asynchronous attention embedding from the continuous event stream by adopting an adaptive temporal sampling strategy and a temporal attention convolutional module. Besides, a spatio-temporal memory module is designed to exploit rich temporal cues via a lightweight yet efficient inter-weaved recurrent-convolutional architecture. Empirically, it shows that our approach outperforms the state-of-the-art methods using the feed-forward frame-based detectors on three datasets by a large margin (i.e., 7.6% in the KITTI Simulated Dataset, 10.8% in the Gen1 Automotive Dataset, and 10.5% in the 1Mpx Detection Dataset). The results demonstrate that event cameras can perform robust object detection even in cases where conventional cameras fail, e.g., fast motion and challenging light conditions. |
Year | DOI | Venue |
|---|---|---|
2022 | 10.1109/TIP.2022.3162962 | IEEE TRANSACTIONS ON IMAGE PROCESSING |
Keywords | DocType | Volume |
Object detection, Cameras, Detectors, Task analysis, Streaming media, Recurrent neural networks, Meters, Object detection, event cameras, event-based vision, deep neural networks, neuromorphic engineering | Journal | 31 |
Issue | ISSN | Citations |
1 | 1057-7149 | 0 |
PageRank | References | Authors |
0.34 | 31 | 6 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Jianing Li | 1 | 21 | 5.35 |
| Jia Li | 2 | 524 | 42.09 |
| Lin Zhu | 3 | 5 | 12.19 |
| Xijie Xiang | 4 | 0 | 0.34 |
| Tiejun Huang | 5 | 1281 | 120.48 |
| Yonghong Tian | 6 | 1057 | 102.81 |