Title
Efficient Activity Recognition Using Lightweight Cnn And Ds-Gru Network For Surveillance Applications
Abstract
Recognizing human activities has become a trend in smart surveillance that contains several challenges, such as performing effective analyses of huge video data streams, while maintaining low computational complexity, and performing this task in real-time. Current activity recognition techniques are using convolutional neural network (CNN) models with computationally complex classifiers, creating hurdles in obtaining quick responses for abnormal activities. To address these challenges in real-time surveillance, this paper proposes a lightweight deep learning-assisted framework for activity recognition. First, we detect a human in the surveillance stream using an effective CNN model, which is trained on two surveillance datasets. The detected individual is tracked throughout the video stream via an ultra-fast object tracker called the 'minimum output sum of squared error' (MOSSE). Next, for each tracked individual, pyramidal convolutional features are extracted from two consecutive frames using the efficient LiteFlowNet CNN. Finally, a novel deep skip connection gated recurrent unit (DS-GRU) is trained to learn the temporal changes in the sequence of frames for activity recognition. Experiments are conducted over five benchmark activity recognition datasets, and the results indicate the efficiency of the proposed technique for real-time surveillance applications compared to the state-of-the-art. (C) 2021 The Author(s). Published by Elsevier B.V.
Year
DOI
Venue
2021
10.1016/j.asoc.2021.107102
APPLIED SOFT COMPUTING
Keywords
DocType
Volume
Artificial intelligence, Machine learning, Pattern recognition, IoT, Activity recognition, Video big data analytics, Deep learning, GRU
Journal
103
ISSN
Citations 
PageRank 
1568-4946
0
0.34
References 
Authors
0
6
Name
Order
Citations
PageRank
Amin Ullah110911.60
Khan Muhammad200.34
Weiping Ding300.34
Vasile Palade400.34
Ijaz Ul Haq5252.60
Sung Wook Baik600.34