Title
Two Stage Shot Boundary Detection via Feature Fusion and Spatial-Temporal Convolutional Neural Networks.
Abstract
Shot boundary detection is essentially to detect the position of frames where the shot changes. It has been actively studied in video analysis and management for convenience, which becomes a key technique with the rapid proliferation of rich and diverse videos. With respect to the complex characteristics of different shots in varying length and content variation property, in this paper we present a two stage method for shot boundary detection (TSSBD) which distinguishes abrupt shot by fusing color histogram and deep features, and locate gradual shot changes with C3D-based deep analysis. Abrupt shot changes are detected firstly as it occurs between two frames, which divides the complete video into segments containing gradual transitions; Over these video segments, gradual shot change detection is implemented using 3D-convolutional neural network, which classifies clips into specific gradual shot change types; Finally, an effective merging strategy is proposed to locate positions of gradual shot transitions. The experimental analysis illustrates that the proposed progressive method is capable of detecting both abrupt shot transitions and gradual shot transitions accurately.
Year
DOI
Venue
2019
10.1109/ACCESS.2019.2922038
IEEE ACCESS
Keywords
Field
DocType
Shot boundary detection (SBD),feature fusion,spatial-temporal feature,deep learning
Feature fusion,Pattern recognition,Computer science,Convolutional neural network,Boundary detection,Artificial intelligence,Distributed computing
Journal
Volume
ISSN
Citations 
7
2169-3536
2
PageRank 
References 
Authors
0.37
0
5
Name
Order
Citations
PageRank
Lifang Wu18222.35
Shuai Zhang26323.35
Meng Jian3598.07
Zhe Lu420.37
Dong Wang521.38