Paper Info
Title
Temporal Shift and Spatial Attention-Based Two-Stream Network for Traffic Risk Assessment
Abstract
On-board vision based traffic risk assessment is a challenging task for intelligent driving systems, which has some special challenges including spatial-temporal feature extraction, different judgements of risks, real-time requirement, lacking data, etc. To overcome these difficulties, we propose a novel Temporal Shift and Spatial Attention based Two-stream Network (TSSAT-Net) for on-board vision based traffic risk assessment. Firstly, we build new judgement measures that integrate actual driving experience and scenario complexity, and release an on-board vision based traffic risk assessment dataset. Secondly, a novel weighted Temporal Shift Module (weighted-TSM) based two-stream network is proposed; unlike previous methods that rely on complex and time-consuming 3D CNN or LSTM calculation, the proposed two-stream network can effectively extract spatial-temporal features using a weighted temporal shift mechanism with just 2D CNN calculation requirement. Thirdly, a spatial and channel attention mechanism is proposed to make the TSSAT-Net more focus on the features closely related to traffic risks, avoiding redundant information in complex traffic scenarios. Experiments based on the released comprehensive dataset show that our method achieves the state-of-the-art classification accuracy in real-time.
Year
DOI
Venue
2022
10.1109/TITS.2021.3115123
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS
Keywords
DocType
Volume
Videos, Risk management, Feature extraction, Complexity theory, Accidents, Cameras, Vehicles, Traffic risk assessment, two-stream network, weighted temporal shift module, spatial and channel attention mechanism
Journal
23
Issue
ISSN
Citations 
8
1524-9050
0
PageRank 
References 
Authors
0.34
0
5
Name
Order
Citations
PageRank
Chunsheng Liu1479.92
Zijian Li200.34
Faliang Chang3111.60
Shuang Li400.34
Jincan Xie500.34