Paper Info
Title
A Virtual Musical Instrument for 3D Performance with Short Gestures: Exploring Mapping Strategies with Virtual Reality.
Abstract
We present a new digital virtual instrument designed, built and played using 3D interactive technologies, with interest in reducing both learning time and difficulty in playing musical phrases and chords across the musical scale. Design concepts stress on a smart note mapping, rely on bi-manual interaction, and intend an optimized gestural performance on a virtual keyboard to shorten playing trajectories. The proposed keyboard is built stacking note keys in multiple lines, and the note mapping allows performing typical musical intervals and patterns with short gestures. This implementation employed an Oculus Rift head-mounted display and a Razer Hydra for gesture input. The combination of 3D visualization, natural interaction and the proposed mapping is meant to contribute to ease musical performance by allowing fast execution of specific note sequences. The instrument concept encapsulates complexity by creating a fluid way for musicians to perform gesture patterns that would otherwise require non-trivial motor skills.
Year
Venue
Field
2016
CMMR
Virtual reality,Musical,Visualization,Computer science,Gesture,Musical instrument,Virtual keyboard,Chord (music),Interval (music),Multimedia
DocType
Citations 
PageRank 
Conference
0
0.34
References 
Authors
0
4
Name
Order
Citations
PageRank
André Montes Rodrigues100.68
Marcelo Knörich Zuffo26423.16
Olavo Belloc3214.67
Regis Faria4102.06