Title
iSymphony: an adaptive interactive orchestral conducting system for digital audio and video streams
Abstract
We present iSymphony, an interactive orchestral conducting system for digital audio and video that adaptively adjusts to the user's conducting style. Using a digital baton, users may control the tempo, volume, and instrument emphasis of a digital audio and video recording of an orchestra. The system adaptively recognizes three gesture profiles: the four-beat neutral-legato pattern, an up-down pattern, and random gestures. The system uses an audio time-stretching algorithm we developed that allows the playback speed of a digital audio recording to be arbitrarily adjusted without changing its pitch. iSymphony is an example of how computers can enable more people to experience an interaction style normally limited to a few people (conductors), and is installed as part of the It's Artastic! exhibit at the Betty Brinn Children's Museum in Milwaukee, USA.
Year
DOI
Venue
2006
10.1145/1125451.1125507
CHI Extended Abstracts
Keywords
Field
DocType
digital audio recording,four-beat neutral-legato pattern,digital audio,video recording,interaction style,system adaptively,video stream,present isymphony,digital baton,up-down pattern,audio time-stretching algorithm,gestures,gesture recognition,conducting
Video recording,Computer graphics (images),Gesture,Computer science,Digital audio,Multimedia
Conference
ISBN
Citations 
PageRank 
1-59593-298-4
17
1.75
References 
Authors
5
7
Name
Order
Citations
PageRank
Eric Lee110312.41
Henning Kiel2272.74
Saskia Dedenbach3171.75
Ingo Grüll4272.74
Thorsten Karrer538626.19
Marius Wolf6333.49
Jan Borchers71659154.20