Minding the (Transatlantic) Gap: An Internet-Enabled Acoustic Brain-Computer Music Interface

use of non-invasive electroencephalography (EEG) in the experimental arts is not a novel concept. Since 1965, EEG has been used in a large number of, sometimes highly sophisticated, systems for musical and artistic expression. However, since the advent of the synthesizer, most such systems have utilized digital and/or synthesized media in sonifying the EEG signals. There have been relatively few attempts to create interfaces for musical expression that allow one to mechanically manipulate acoustic instruments by modulating one's mental state. Secondly, few such systems afford a distributed performance medium, with data transfer and audience participation occurring over the Internet. The use of acoustic instruments and Internet-enabled communication expands the realm of possibilities for musical expression in Brain-Computer Music Interfaces (BCMI), while also introducing additional challenges. In this paper we report and examine a first demonstration (Music for Online Performer) of a novel system for Internet-enabled manipulation of robotic acoustic instruments, with feedback, using a non-invasive EEG-based BCI and low-cost, commercially available robotics hardware.

[1]  Eduardo Reck Miranda,et al.  Interfacing the Brain Directly with Musical Systems: On Developing Systems for Making Music with Brain Signals , 2005, Leonardo.

[2]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[3]  Tzyy-Ping Jung,et al.  Independent Component Analysis of Electroencephalographic Data , 1995, NIPS.

[4]  Arnaud Delorme,et al.  EEGLAB, SIFT, NFT, BCILAB, and ERICA: New Tools for Advanced EEG Processing , 2011, Comput. Intell. Neurosci..

[5]  S. Makeig,et al.  EEGLAB , MPT , NetSIFT , NFT , BCILAB , and ERICA : New tools for advanced EEG / MEG processing , 2010 .

[6]  Marcelo M. Wanderley,et al.  New Digital Musical Instruments: Control And Interaction Beyond the Keyboard (Computer Music and Digital Audio Series) , 2006 .

[7]  Thilo Hinterberger,et al.  Parametric orchestral sonification of EEG in real time , 2005, IEEE MultiMedia.

[8]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[9]  Alexander Refsum Jensenius,et al.  Proceedings of the International Conference on New Interfaces for Musical Expression , 2011 .

[10]  De-zhong Yao,et al.  Scale-Free Music of the Brain , 2009, PLoS ONE.

[11]  Mick Grierson Composing with Brainwaves: Minimal Trial P300 Recognition as an Indication of subjective Preference for the control of a Musical Instrument , 2008, ICMC.

[12]  G. Pfurtscheller Functional Topography During Sensorimotor Activation Studied with Event‐Related Desynchronization Mapping , 1989, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[13]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[14]  Steve Mann,et al.  Deconcert: bathing in the light, sound, and Waters of the Musical Brainbaths , 2007, ICMC.

[15]  A. Compston The Berger rhythm: potential changes from the occipital lobes in man. , 2010, Brain : a journal of neurology.

[16]  Gordy Carlson Digital musical instruments , 1997 .