Plymouth brain-computer music interfacing project: from EEG audio mixers to composition informed by cognitive neuroscience

This paper reports the current level of development achieved by our research into brain-computer music interfacing (BCMI), which is aimed at special needs and Music Therapy, in addition to the entertainment industry. It surveys the technology developed to date at ICCMR and glances at work-in- progress designs informed by cognitive experiments. Research into BCMI involves three major challenging problems: (1) the extraction of meaningful control information from signals emanating from the brain, (2) the design of generative music techniques that respond to such information and (3) the definition of ways in which such technology can effectively improve the lives of people with special needs and address therapeutic needs. This paper focuses on the first two challenges, particularly the music technology side of BCMI research. In overall, this paper focuses on the creative computer music component of our research rather than on the minutiae of its underlying scientific protocols and experimental methods.

[1]  Saeid Sanei,et al.  EEG signal processing , 2000, Clinical Neurophysiology.

[2]  Terrence J. Sejnowski,et al.  Toward Brain-Computer Interfacing (Neural Information Processing) , 2007 .

[3]  Thilo Hinterberger,et al.  Parametric orchestral sonification of EEG in real time , 2005, IEEE MultiMedia.

[4]  A Thron,et al.  Playing piano in the mind--an fMRI study on music imagery and performance in pianists. , 2004, Brain research. Cognitive brain research.

[5]  Ken Sharman,et al.  On Harnessing the Electroencephalogram for the Musical Braincap , 2003, Computer Music Journal.

[6]  Wolfgang Grodd,et al.  Principles of a brain-computer interface (BCI) based on real-time functional magnetic resonance imaging (fMRI) , 2004, IEEE Transactions on Biomedical Engineering.

[7]  David Rosenboom,et al.  The Performing Brain , 1990 .

[8]  A. Braun,et al.  Neural Substrates of Spontaneous Musical Performance: An fMRI Study of Jazz Improvisation , 2008, PloS one.

[9]  Brendan Z. Allison,et al.  Brain-Computer Interfaces , 2010 .

[10]  D. Deutsch,et al.  The Psychology of Music , 1983 .

[11]  Alexander A. Duncan.  EEG pattern classification for the brain-computer musical interface , 2001 .

[12]  Charles W. Anderson,et al.  Classification of EEG Signals from Four Subjects During Five Mental Tasks , 2007 .

[13]  John Shawe-Taylor,et al.  GLM and SVM analyses of neural response to tonal and atonal stimuli: new techniques and a comparison , 2009, Connect. Sci..

[14]  Eduardo Miranda,et al.  Mix-It-Yourself with a Brain-Computer Music Interface , 2008 .

[15]  C Tempelmann,et al.  Electrodynamic headphones and woofers for application in magnetic resonance imaging scanners. , 1998, Medical physics.

[16]  Gert Pfurtscheller,et al.  Prompt recognition of brain states by their EEG signals , 1997 .

[17]  David Rosenboom,et al.  Biofeedback and the Arts: Results of Early Experiments , 1989 .

[18]  K. Misulis.  Essentials of clinical neurophysiology , 1992 .

[19]  Marc Leman,et al.  The Cortical Topography of Tonal Structures Underlying Western Music , 2002, Science.

[20]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[21]  R. Shepard.  11 – Structural Representations of Musical Pitch , 1982 .

[22]  Eduardo Miranda,et al.  Composing Music with Computers , 2001 .

[23]  B. Hjorth.  EEG analysis based on time domain properties. , 1970, Electroencephalography and clinical neurophysiology.

[24]  Karl J. Friston,et al.  Multisubject fMRI Studies and Conjunction Analyses , 1999, NeuroImage.

[25]  Theodore W. Berger,et al.  Brain-Computer Interfaces: An international assessment of research and development trends , 2008 .

[26]  S. Roberts,et al.  On generating EEG for controlling musical systems , 2004 .

[27]  Eduardo Reck Miranda,et al.  Constraint-Based Composition in Realtime , 2008, ICMC.

[28]  Eduardo Miranda,et al.  Brain-computer music interface for composition and performance , 2006 .

[29]  H Petsche,et al.  EEG aspects of mentally playing an instrument. , 1996, Brain research. Cognitive brain research.

[30]  E. Adrian,et al.  THE BERGER RHYTHM: POTENTIAL CHANGES FROM THE OCCIPITAL LOBES IN MAN , 1934 .