Name
Abstract | ||
|---|---|---|
Recognizing human actions in realistic scenes has emerged as a challenging topic due to various aspects such as dynamic backgrounds. In this paper, we present a novel approach to taking audio context into account for better action recognition performance, since audio can provide strong evidence to certain actions such as phone-ringing to answer-phone. At first, classifiers are established for visual and audio modalities, respectively. Specifically, bag of visual-words model is employed to represent human actions in visual modality, a number of audio features are extracted for audio modality, and Support Vector Machine (SVM) is employed as the classification technique. Then, a decision fusion scheme is utilized to fuse classification results from two modalities. Since audio context is not always helpful, two simple yet effective decision rules are developed for selective fusion. Experimental results on the Hollywood Human Actions (HOHA) dataset demonstrate that the proposed approach can achieve better recognition performance than that of integrating scene context. Therefor, our work provides strong confidence to further explore how audio context influences realistic human action recognition. |
Year | DOI | Venue |
|---|---|---|
2010 | 10.1109/DICTA.2010.57 | DICTA |
Keywords | Field | DocType |
signal representation,visual modality,realistic human action recognition,human action representation,better recognition performance,decision rules,classification technique,bag of visual-words model,human action recognition,better action recognition performance,audio modality,audio feature extraction,audio feature,feature extraction,support vector machine,audio context,hollywood human actions dataset,decision theory,signal classification,decision fusion scheme,audio signal processing,certain action,human action,support vector machines,scene context,decision rule,visualization,bag of visual words,histograms,motion pictures | Modalities,Histogram,Computer science,Decision theory,Artificial intelligence,Audio signal processing,Decision rule,Computer vision,Pattern recognition,Visualization,Support vector machine,Feature extraction,Speech recognition | Conference |
ISBN | Citations | PageRank |
978-0-7695-4271-3 | 8 | 0.54 |
References | Authors | |
21 | 4 | |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Qiuxia Wu | 1 | 103 | 9.25 |
| Zhiyong Wang | 2 | 550 | 51.76 |
| Feiqi Deng | 3 | 468 | 71.73 |
| David Dagan Feng | 4 | 3329 | 413.76 |