Paper Info
Title
Hand Postures for Sonification Control
Abstract
Sonification is a rather new technique in human-computer interaction which addresses auditory perception. In contrast to speech interfaces, sonification uses non-verbal sounds to present information. The most common sonification technique is parameter mapping where for each data point a sonic event is generated whose acoustic attributes are determined from data values by a mapping function. For acoustic data exploration, this mapping must be adjusted or manipulated by the user. We propose the use of hand postures as a particularly natural and intuitive means of parameter manipulation for this data exploration task. As a demonstration prototype we developed a hand posture recognition system for gestural controlling of sound. The presented implementation applies artificial neural networks for the identification of continuous hand postures from camera images and uses a real-time sound synthesis engine. In this paper, we present our system and first applications of the gestural control of sounds. Techniques to apply gestures to control sonification are proposed and sound examples are given.
Year
DOI
Venue
2001
10.1007/3-540-47873-6_32
Gesture Workshop
Keywords
Field
DocType
parameter mapping,non-verbal sound,acoustic data exploration,sonification control,hand postures,hand posture,continuous hand posture,data exploration task,data value,common sonification technique,hand posture recognition system,mapping function,real time,human computer interaction,artificial neural network
Data exploration,Computer science,Gesture,Sonic interaction design,Speech recognition,Sonification,Artificial neural network,Perception,Speech interface,Posture recognition
Conference
ISBN
Citations 
PageRank 
3-540-43678-2
2
1.35
References 
Authors
4
3
Name
Order
Citations
PageRank
Thomas Hermann1269.30
Claudia Nölker28110.63
Helge Ritter32020415.97