Title
Audio salient event detection and summarization using audio and text modalities
Abstract
This paper investigates the problem of audio event detection and summarization, building on previous work [1, 2] on the detection of perceptually important audio events based on saliency models. We lake a synergistic approach to audio summarization where saliency computation of audio streams is assisted by using the text modality as well. Auditory saliency is assessed by auditory and perceptual cues such as Teager energy, loudness and roughness; all known to correlate with attention and human hearing. Text analysis incorporates part-of-speech tagging and affective modeling. A computational method for the automatic correction of the boundaries of the selected audio events is applied creating summaries that consist not only of salient but also meaningful and semantically coherent events. A non-parametric classification technique is employed and results are reported on the MovSum movie database using objective evaluations against ground-truth designating the auditory and semantically salient events.
Year
Venue
Keywords
2015
European Signal Processing Conference
monomodal auditory saliency,affective text analysis,audio-text salient events,audio summarization
Field
DocType
ISSN
Loudness,Automatic summarization,Computer science,Salience (neuroscience),Audio mining,Feature extraction,Speech recognition,Perception,Semantics,Salient
Conference
2076-1465
Citations 
PageRank 
References 
1
0.35
21
Authors
4
Name
Order
Citations
PageRank
Athanasia Zlatintsi1464.49
Elias Iosif215516.65
Petros Maragos33733591.97
Alexandros Potamianos41443149.05