Title
A sparsity-based approach to 3D binaural sound synthesis using time-frequency array processing
Abstract
Localization of sounds in physical space plays a very important role in multiple audio-related disciplines, such as music, telecommunications, and audiovisual productions. Binaural recording is the most commonly used method to provide an immersive sound experience by means of headphone reproduction. However, it requires a very specific recording setup using high-fidelity microphones mounted in a dummy head. In this paper, we present a novel processing framework for binaural sound recording and reproduction that avoids the use of dummy heads, which is specially suitable for immersive teleconferencing applications. The method is based on a time-frequency analysis of the spatial properties of the sound picked up by a simple tetrahedral microphone array, assuming source sparseness. The experiments carried out using simulations and a real-time prototype confirm the validity of the proposed approach.
Year
DOI
Venue
2010
10.1155/2010/415840
EURASIP J. Adv. Sig. Proc.
Keywords
Field
DocType
binaural sound synthesis,binaural sound recording,high-fidelity microphone,immersive teleconferencing application,audiovisual production,time-frequency array processing,binaural recording,sparsity-based approach,important role,dummy head,immersive sound experience,headphone reproduction,specific recording setup,time frequency
Dummy head recording,Computer vision,Array processing,Teleconference,Computer science,Speech recognition,Microphone array,Time–frequency analysis,Artificial intelligence,Binaural recording,Physical space
Journal
Volume
Issue
ISSN
2010,
1
1687-6180
Citations 
PageRank 
References 
11
0.84
10
Authors
3
Name
Order
Citations
PageRank
Maximo Cobos116220.52
Jose J. Lopez2324.51
Sascha Spors310819.70