Title
Braahms: a novel adaptive musical interface based on users' cognitive state.
Abstract
We present a novel brain-computer interface (BCI) integrated with a musical instrument that adapts implicitly (with no extra effort from user) to users' changing cognitive state during musical improvisation. Most previous musical BCI systems use either a mapping of brainwaves to create audio signals or use explicit brain signals to control some aspect of the music. Such systems do not take advantage of higher level semantically meaningful brain data which could be used in adaptive systems or without detracting from the attention of the user. We present a new type of real-time BCI that assists users in musical improvisation by adapting to users' measured cognitive workload implicitly. Our system advances the state of the art in this area in three ways: 1) We demonstrate that cognitive workload can be classified in real-time while users play the piano using functional near-infrared spectroscopy. 2) We build a real-time, implicit system using this brain signal that musically adapts to what users are playing. 3) We demonstrate that users prefer this novel musical instrument over other conditions and report that they feel more creative.
Year
Venue
Field
2015
NIME
Audio signal,Computer science,Musical,Adaptive system,Brain–computer interface,Musical improvisation,Musical instrument,Human–computer interaction,Piano,Cognition,Multimedia
DocType
Citations 
PageRank 
Conference
3
0.47
References 
Authors
12
8
Name
Order
Citations
PageRank
Beste F Yuksel1928.16
Daniel Afergan21297.98
Evan M. Peck315012.97
Garth Griffin430.47
Lane Harrison524320.22
Nick W. B. Chen630.47
Remco Chang798364.96
Robert J. K. Jacob82862341.84