Title | ||
---|---|---|
A sparsity-based approach to 3D binaural sound synthesis using time-frequency array processing |
Abstract | ||
---|---|---|
Localization of sounds in physical space plays a very important role in multiple audio-related disciplines, such as music, telecommunications, and audiovisual productions. Binaural recording is the most commonly used method to provide an immersive sound experience by means of headphone reproduction. However, it requires a very specific recording setup using high-fidelity microphones mounted in a dummy head. In this paper, we present a novel processing framework for binaural sound recording and reproduction that avoids the use of dummy heads, which is specially suitable for immersive teleconferencing applications. The method is based on a time-frequency analysis of the spatial properties of the sound picked up by a simple tetrahedral microphone array, assuming source sparseness. The experiments carried out using simulations and a real-time prototype confirm the validity of the proposed approach. |
Year | DOI | Venue |
---|---|---|
2010 | 10.1155/2010/415840 | EURASIP J. Adv. Sig. Proc. |
Keywords | Field | DocType |
binaural sound synthesis,binaural sound recording,high-fidelity microphone,immersive teleconferencing application,audiovisual production,time-frequency array processing,binaural recording,sparsity-based approach,important role,dummy head,immersive sound experience,headphone reproduction,specific recording setup,time frequency | Dummy head recording,Computer vision,Array processing,Teleconference,Computer science,Speech recognition,Microphone array,Time–frequency analysis,Artificial intelligence,Binaural recording,Physical space | Journal |
Volume | Issue | ISSN |
2010, | 1 | 1687-6180 |
Citations | PageRank | References |
11 | 0.84 | 10 |
Authors | ||
3 |
Name | Order | Citations | PageRank |
---|---|---|---|
Maximo Cobos | 1 | 162 | 20.52 |
Jose J. Lopez | 2 | 32 | 4.51 |
Sascha Spors | 3 | 108 | 19.70 |