Title
Methods for effective sonification of clarinetists’ ancillary gestures
Abstract
We present the implementation of two different sonifications methods of ancillary gestures from clarinetists. The sonifications are data driven from the clarinetist’s posture which is captured with a VICON motion tracking system. The first sonification method is based on the velocities of the tracking markers, the second method involves a principal component analysis as a data preprocessing step. Further we develop a simple complementary visual display with a similar information content to match the sonification. The effect of the two sonifications with respect to the movement perception is studied in an experiment where test subjects annotate the clarinetists performance represented by various combinations of the resulting uni- and multimodal displays.
Year
DOI
Venue
2009
10.1007/978-3-642-12553-9_15
Gesture Workshop
Keywords
Field
DocType
principal component analysis,sonification method,multimodal display,movement perception,clarinetists performance,vicon motion tracking system,ancillary gesture,tracking marker,different sonifications method,effective sonification,resulting uni,information content,data preprocessing,motion tracking
Computer vision,Data-driven,Computer graphics (images),Gesture,Computer science,Data pre-processing,Movement perception,Sonification,Artificial intelligence,Match moving,Principal component analysis
Conference
Volume
ISSN
ISBN
5934
0302-9743
3-642-12552-2
Citations 
PageRank 
References 
1
0.45
5
Authors
4
Name
Order
Citations
PageRank
Florian Grond183.42
Thomas Hermann2248.52
V. Verfaille3336.04
Marcelo M. Wanderley439564.32