Paper Info
Title
What Is Happening in the Video? - Annotate Video by Sentence.
Abstract
Due to the popularity of online video sharing websites such as YouTube, millions of users have treated online video as a source of information and entertainment. Therefore, video annotation has evoked great interest in the past few years. In this paper, we propose a four-step approach to automatically annotate video shots with sentences. The first step is video preprocessing, converting video shot into a sequence of frame images. The second step is to find related candidate elements of the sentence about the video contents. The main elements in the sentence are objects, events, scenes, and modifiers. These candidate elements are gained by searching for similar images with the video frames in our collected image data sets instead of video data sets. The third step is to select the best elements among these candidate ones by a weighted scoring algorithm. The final step is to construct a sentence with the help of a correlation graph algorithm to analyze the relationships among the best elements. The experimental results indicate that our method is effective to annotate videos with sentences. What is more, the weighted scoring algorithm and the correlation graph algorithm that we propose are efficient in developing the experimental performance.
Year
DOI
Venue
2016
10.1109/TCSVT.2015.2475815
IEEE Trans. Circuits Syst. Video Techn.
Keywords
Field
DocType
Correlation,Visualization,Semantics,Feature extraction,Silicon,Artificial intelligence,YouTube
Computer vision,Block-matching algorithm,Video post-processing,Information retrieval,Computer science,Motion compensation,Multiview Video Coding,Video tracking,Artificial intelligence,Smacker video,Video quality,Video compression picture types
Journal
Volume
Issue
ISSN
26
9
1051-8215
Citations 
PageRank 
References 
5
0.43
35
Authors
5
Name
Order
Citations
PageRank
Xueming Qian1105270.70
Xiaoxiao Liu250.43
Xiang Ma3231.44
Dan Lu4221.62
Chenyang Xu558523.07