Name
Title | ||
|---|---|---|
An audio-visual human attention analysis approach to abrupt change detection in videos. |
Abstract | ||
|---|---|---|
Abrupt changes in videos, such as sudden running, usually indicate abnormal events and play a significant role in attracting human attention. We propose an approach to detect abrupt changes in videos based on Bayesian surprise theory, which considers both visual and audio modalities. Specifically, after generating surprise curves from the audio and visual modalities, we obtain a synchronized sequence based on the time-synchrony between audio-visual series in videos. The approach is fully automated and does not require any prior information. Experimental results from tests on human behavior and natural scene video datasets demonstrate that the proposed method is able to detect abrupt changes like sudden running or the collapse of an object. The proposed approach is further evaluated on the entire dataset we collected. HighlightsAudio and visual surprise curves are created using Bayesian surprise.The synchronized sequence reflecting unusual event is obtained based on the time-synchrony.The abrupt changes in videos are detected by utilizing both audio and visual modalities.The approach does not require any prior information and has been applied to human behavior and scene videos. |
Year | DOI | Venue |
|---|---|---|
2015 | 10.1016/j.sigpro.2014.08.006 | Signal Processing |
Keywords | Field | DocType |
Bayesian surprise,Abrupt changes detection,Unsupervised,Audio-visual,Time-synchrony | Modalities,Computer vision,Change detection,Artificial intelligence,Surprise,Mathematics,Bayesian probability | Journal |
Volume | Issue | ISSN |
110 | C | 0165-1684 |
Citations | PageRank | References |
1 | 0.35 | 30 |
Authors | ||
5 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Yanxiang Chen | 1 | 40 | 5.66 |
| Minglong Song | 2 | 20 | 1.63 |
| Lixia Xue | 3 | 1 | 0.69 |
| Xiaoxue Chen | 4 | 10 | 2.88 |
| Meng Wang | 5 | 3094 | 167.38 |