Paper Info
Title
The realtime method based on audio scenegraph for 3d sound rendering
Abstract
Recent studies have shown that the combination of auditory and visual cues enhances the sense of immersion in virtual reality or interactive entertainment applications. However, realtime 3D audiovisual rendering requires high computational cost. In this paper, to reduce realtime computation, we suggest a novel framework of optimized 3D sound rendering, where we define Audio Scenegraph that contains reduced 3D scene information and the necessary parameters for computing early reflections of sound. During pre-computation phase using our framework, graphic reduction and sound source reduction are accomplished according to the environment containing complex 3D scene, sound sources, and a listener. That is, complex 3D scene is reduced to a set of significant facets for sound rendering, and the resulting scene is represented as Audio Scenegraph we defined. And then, the graph is transmitted to the sound engine which clusters a number of sound sources for reducing realtime calculation of sound propagation. For sound source reduction, it is required to estimate early reflection time to test perceptual culling and to cluster sounds which are reachable to facets of each sub space according to the estimation results. During realtime phase according to the position, direction and index of the space of a listener, sounds inside sub space are played by image method and sounds outside sub space are also played by assigning clustered sounds to buffers. Even if the number of sounds is increased, realtime calculation is very stable because most calculations about sounds can be performed offline. It took very consistent time for 3D sound rendering regardless of complexity of 3D scene including hundreds of sound sources by this method. As a future study, it is required to estimate the perceptual acceptance of grouping algorithm by user test.
Year
DOI
Venue
2005
10.1007/11581772_63
pacific rim conference on multimedia
Keywords
Field
DocType
sound engine,Audio Scenegraph,sound source reduction,realtime calculation,sound source,realtime method,sound rendering,audio scenegraph,sub space,sound propagation,realtime computation,cluster sound
Graphics,Sensory cue,Computer vision,Scene graph,Virtual reality,Computer graphics (images),Computer science,Artificial intelligence,Immersion (virtual reality),Rendering (computer graphics),Perception,Computation
Conference
Volume
ISSN
ISBN
3767
0302-9743
3-540-30027-9
Citations 
PageRank 
References 
0
0.34
7
Authors
3
Name
Order
Citations
PageRank
Jeong-Seon Yi100.34
Suk-Jeong Seong200.34
Yang-Hee Nam38314.75