Paper Info
Title
A Web-Based Real-Time Kinect Application For Gestural Interaction With Virtual Musical Instruments
Abstract
We present a web-based real-time application that enables gestural interaction with virtual instruments for musical expression. Skeletons of the users are tracked by a Kinect sensor, while the performance of the virtual instruments is accomplished using gestures inspired from their corresponding physical counterparts. The application supports the virtual performance of an air guitar and an upright bass, as well as a more abstract conductor-like performance with two instruments, while collaborative playing of two or more players is also allowed. The multimodal virtual interface of our application, which includes 3D avatars, allows users, even if not musically educated, to engage in innovative interactive musical activities, while its web-based architecture improves its accessibility and performance. The application was qualitatively evaluated by 13 users, in terms of its usability and enjoyability, among others, accomplishing high ratings and positive feedback.
Year
DOI
Venue
2018
10.1145/3243274.3243297
2018 CONFERENCE ON INTERACTION WITH SOUND (AUDIO MOSTLY): SOUND IN IMMERSION AND EMOTION (AM'18)
Keywords
Field
DocType
gestural interaction, virtual musical instruments, web technologies, real-time applications, avateering
Educational technology,Speech synthesis,Greeklish,Computer science,Gesture,Usability,Human–computer interaction,Information extraction,Musical expression,Web application
Conference
Citations 
PageRank 
References 
0
0.34
6
Authors
9
Name
Order
Citations
PageRank
Athanasia Zlatintsi1464.49
Panagiotis Paraskevas Filntisis243.92
Christos Garoufis312.39
Antigoni Tsiami4134.02
Kosmas Kritsis500.68
Maximos A. Kaliakatsos-Papakostas66713.26
Aggelos Gkiokas7354.64
Vassilios Katsouros87310.63
Petros Maragos93733591.97