Title
Automatic Video Annotation Through Search And Mining
Abstract
Conventional approaches to video annotation predominantly focus on supervised identification of a limited set of concepts, while unsupervised annotation with infinite vocabulary remains unexplored. This work aims to exploit the overlap in content of news video to automatically annotate by mining similar videos that reinforce, filter, and improve the original annotations. The algorithm employs a two-step process of search followed by mining. Given a query video consisting of visual content and speech-recognized transcripts, similar videos are first ranked in a multimodal search. Then, the transcripts associated with these similar videos are mined to extract keywords for the query. We conducted extensive experiments over the TRECVID 2005 corpus and showed the superiority of the proposed approach to using only the mining process on the original video for annotation. This work represents the first attempt at unsupervised automatic video annotation leveraging overlapping video content.
Year
DOI
Venue
2008
10.1109/ICME.2008.4607527
2008 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOLS 1-4
Keywords
Field
DocType
video annotation, video search, data mining
Annotation,Information retrieval,Pattern recognition,Ranking,TRECVID,Visualization,Computer science,Support vector machine,Exploit,Multimodal search,Artificial intelligence,Vocabulary
Conference
Citations 
PageRank 
References 
15
0.96
7
Authors
5
Name
Order
Citations
PageRank
Emily Moxley11568.95
Tao Mei24702288.54
Xian-Sheng Hua36566328.17
Wei-ying Ma4145871003.11
B. S. Manjunath57561783.37