Abstract | ||
---|---|---|
We present the implementation of two different sonifications methods of ancillary gestures from clarinetists. The sonifications are data driven from the clarinetist’s posture which is captured with a VICON motion tracking system. The first sonification method is based on the velocities of the tracking markers, the second method involves a principal component analysis as a data preprocessing step. Further we develop a simple complementary visual display with a similar information content to match the sonification. The effect of the two sonifications with respect to the movement perception is studied in an experiment where test subjects annotate the clarinetists performance represented by various combinations of the resulting uni- and multimodal displays. |
Year | DOI | Venue |
---|---|---|
2009 | 10.1007/978-3-642-12553-9_15 | Gesture Workshop |
Keywords | Field | DocType |
principal component analysis,sonification method,multimodal display,movement perception,clarinetists performance,vicon motion tracking system,ancillary gesture,tracking marker,different sonifications method,effective sonification,resulting uni,information content,data preprocessing,motion tracking | Computer vision,Data-driven,Computer graphics (images),Gesture,Computer science,Data pre-processing,Movement perception,Sonification,Artificial intelligence,Match moving,Principal component analysis | Conference |
Volume | ISSN | ISBN |
5934 | 0302-9743 | 3-642-12552-2 |
Citations | PageRank | References |
1 | 0.45 | 5 |
Authors | ||
4 |
Name | Order | Citations | PageRank |
---|---|---|---|
Florian Grond | 1 | 8 | 3.42 |
Thomas Hermann | 2 | 24 | 8.52 |
V. Verfaille | 3 | 33 | 6.04 |
Marcelo M. Wanderley | 4 | 395 | 64.32 |