Title
SAPTE: A multimedia information system to support the discourse analysis and information retrieval of television programs.
Abstract
This paper presents a novel multimedia information system, called SAPTE, for supporting the discourse analysis and information retrieval of television programs from their corresponding video recordings. Unlike most common systems, SAPTE uses both content independent and dependent metadata, which are determined by the application of discourse analysis techniques as well as image and audio analysis methods. The proposed system was developed in partnership with the free-to-air Brazilian TV channel Rede Minas in an attempt to provide TV researchers with computational tools to assist their studies about this media universe. The system is based on the Matterhorn framework for managing video libraries, combining: (1) discourse analysis techniques for describing and indexing the videos, by considering aspects, such as, definitions of the subject of analysis, the nature of the speaker and the corpus of data resulting from the discourse; (2) a state of the art decoder software for large vocabulary continuous speech recognition, called Julius; (3) image and frequency domain techniques to compute visual signatures for the video recordings, containing color, shape and texture information; and (4) hashing and k-d tree methods for data indexing. The capabilities of SAPTE were successfully validated, as demonstrated by our experimental results, indicating that SAPTE is a promising computational tool for TV researchers.
Year
DOI
Venue
2015
10.1007/s11042-014-2311-9
Multimedia Tools and Applications
Keywords
Field
DocType
Content-based video retrieval, Video indexing, Television, Discourse analysis
Computer science,Search engine indexing,Software,Discourse analysis,Artificial intelligence,Metadata,Computer vision,Information retrieval,Communication channel,Audio analyzer,Hash function,Vocabulary,Multimedia
Journal
Volume
Issue
ISSN
74
23
1573-7721
Citations 
PageRank 
References 
6
0.55
41
Authors
6