Title
An Environment For Gestural Interaction With 3d Virtual Musical Instruments As An Educational Tool
Abstract
This paper presents a finalized version of an environment intended for performance and gestural interaction with three-dimensional virtual musical instruments, developed as a part of a larger educational platform, the iMuSciCA workbench. The environment can employ either a Leap Motion or a Kinect sensor, and enables interaction with a variety of virtual musical instruments, namely virtual interpretations of a bichord, a xylophone, a drumming set, a guitar and an upright bass, by means of performing and recognizing hand gestures similar to the ones needed to play their physical counterparts. In order to showcase the usability of the platform in an educational context and measure its effectiveness, we designed a scenario, where the user tries to keep a steady rhythm while drumming. A usability study of the above scenario, involving 22 users, demonstrates that the audiovisual feedback can actually provide assistance to the user.
Year
DOI
Venue
2019
10.23919/EUSIPCO.2019.8902604
2019 27TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO)
Keywords
Field
DocType
virtual musical instruments, gesture recognition, gestural interaction, educational tool, HCI
Workbench,Leap motion,Musical,Gesture,Computer science,Usability,Gesture recognition,Guitar,Human–computer interaction
Conference
ISSN
Citations 
PageRank 
2076-1465
0
0.34
References 
Authors
0
6