Title
Cloud-Assisted Multiview Video Summarization Using CNN and Bidirectional LSTM
Abstract
The massive amount of video data produced by surveillance networks in industries instigate various challenges in exploring these videos for many applications, such as video summarization (VS), analysis, indexing, and retrieval. The task of multiview video summarization (MVS) is very challenging due to the gigantic size of data, redundancy, overlapping in views, light variations, and interview correlations. To address these challenges, various low-level features and clustering-based soft computing techniques are proposed that cannot fully exploit MVS. In this article, we achieve MVS by integrating deep neural network based soft computing techniques in a two-tier framework. The first online tier performs target-appearance-based shots segmentation and stores them in a lookup table that is transmitted to cloud for further processing. The second tier extracts deep features from each frame of a sequence in the lookup table and pass them to deep bidirectional long short-term memory (DB-LSTM) to acquire probabilities of informativeness and generates a summary. Experimental evaluation on benchmark dataset and industrial surveillance data from YouTube confirms the better performance of our system compared to the state-of-the-art MVS methods.
Year
DOI
Venue
2020
10.1109/TII.2019.2929228
IEEE Transactions on Industrial Informatics
Keywords
DocType
Volume
Surveillance,Correlation,Feature extraction,Object detection,Cloud computing,Cameras,Informatics
Journal
16
Issue
ISSN
Citations 
1
1551-3203
6
PageRank 
References 
Authors
0.41
0
6
Name
Order
Citations
PageRank
Tanveer Hussain1667.99
Khan Muhammad298667.67
Amin Ullah310911.60
Ze-Hong Cao49615.40
Sung Wook Baik596057.77
Victor Hugo C. de Albuquerque691483.30