Name
Abstract | ||
|---|---|---|
This paper describes the acquisition and content of a new multi-modal database. Some tools for making use of the data streams are also presented. The Computational Audio-Visual Analysis (CAVA) database is a unique collection of three synchronised data streams obtained from a binaural microphone pair, a stereoscopic camera pair and a head tracking device. All recordings are made from the perspective of a person; i.e. what would a human with natural head movements see and hear in a given environment. The database is intended to facilitate research into humans' ability to optimise their multi-modal sensory input and fills a gap by providing data that enables human centred audio-visual scene analysis. It also enables 3D localisation using either audio, visual, or audio-visual cues. A total of 50 sessions, with varying degrees of visual and auditory complexity, were recorded. These range from seeing and hearing a single speaker moving in and out of field of view, to moving around a 'cocktail party' style situation, mingling and joining different small groups of people chatting. |
Year | DOI | Venue |
|---|---|---|
2008 | 10.1145/1452392.1452414 | ICMI |
Keywords | Field | DocType |
new multi-modal database,binaural datasets,audio-visual cue,cava corpus,human centred audio-visual scene,natural head movement,synchronised data stream,head tracking device,multi-modal sensory input,synchronised stereoscopic,data stream,binaural microphone pair,stereoscopic camera pair,binaural hearing,stereo vision,field of view,database | Computer vision,Stereo camera,Data stream mining,Stereopsis,Computer science,Stereoscopy,Speech recognition,Sound localization,Artificial intelligence,Sensory system,Binaural recording,Microphone | Conference |
Citations | PageRank | References |
7 | 0.64 | 8 |
Authors | ||
12 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Elise Arnaud | 1 | 126 | 10.05 |
| Heidi Christensen | 2 | 176 | 19.51 |
| Yan-Chen Lu | 3 | 40 | 4.70 |
| Jon Barker | 4 | 676 | 64.08 |
| Vasil Khalidov | 5 | 74 | 7.35 |
| Miles Hansard | 6 | 46 | 4.34 |
| Bertrand Holveck | 7 | 7 | 0.64 |
| Hervé Mathieu | 8 | 34 | 6.53 |
| Ramya Narasimha | 9 | 7 | 0.97 |
| Elise Taillant | 10 | 21 | 2.42 |
| Florence Forbes | 11 | 115 | 9.87 |
| Radu Horaud | 12 | 2776 | 261.99 |