More Than One—Artistic Explorations with Multi-agent BCIs

In this chapter, the historical context and relevant scientific, artistic, and cultural milieus from which the idea of brain-computer interfaces involving multiple participants emerged is discussed. Additional contextualization includes descriptions of the intellectual climate from which ideas about brain biofeedback led to pioneering applications in music and its allied arts. The chapter then proceeds with more in-depth explanations of what are termed contingent and non-contingent feedback schemes, along with descriptions of early artistic applications and how those might be differentiated. Effects ensuing from the qualitative nature of the feedback signals in brainwave music are also briefly discussed. Following this, substantial space is devoted to describing selected examples of relatively recent musical and artistic pieces that employ multi-agent BCI. These are described with more extensive technical details that illustrate how the ideas, some of which could only have been imagined in earlier times, are now made possible by advances in available technology and new methods for analyzing brain signals from both individuals and groups. These include: implementing biofeedback schemes in which feedback signals depend upon contingent conditions in electroencephalographic features measured among multiple participants, multivariate principal oscillation pattern detection, “hyper-brain” scanning, employing wearable technology, and other related methods. Complex brain-computer music systems are also described in detail. Key artistic concepts explored include the idea of active imaginative listening as performance and cooperative multi-agent artistic productions with BCIs. Some concluding commentary and ideas for future research are also offered.

[1]  Tzyy-Ping Jung,et al.  Biosensor Technologies for Augmented Brain–Computer Interfaces in the Next Decades , 2012, Proceedings of the IEEE.

[2]  David Rosenboom,et al.  Active imaginative listening—a neuromusical critique , 2014, Front. Neurosci..

[3]  David Rosenboom,et al.  B. C.-A. D. and Two Lines: Two Ways of Making Music While Exploring Instability--In Tribute to Salvatore Martirano , 1996 .

[4]  J J Vidal,et al.  Toward direct brain-computer communication. , 1973, Annual review of biophysics and bioengineering.

[5]  Gregory A. Worrell,et al.  Multivariate principal oscillation pattern analysis of ICA sources during seizure , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[6]  H. Longuet-Higgins,et al.  The Non-local Storage and Associative Retrieval of Spatio-Temporal Patterns , 1969 .

[7]  David Rosenboom Complex adaptive systems in music , 1992 .

[8]  Insook Choi,et al.  Interactive Sonification Exploring Emergent Behavior Applying Models for Biological Information and Listening , 2018, Front. Neurosci..

[9]  Werner Lutzenberger,et al.  PERCEPTION OF MUSIC AND DIMENSIONAL COMPLEXITY OF BRAIN ACTIVITY , 1996 .

[10]  Yu-Te Wang,et al.  Pervasive brain monitoring and data sharing based on multi-tier distributed computing and linked data technology , 2014, Front. Hum. Neurosci..

[11]  Sara Ilstedt Hjelm,et al.  Brainball - using brain activity for cool competition , 2000 .

[12]  John K. Zao,et al.  Augmented Brain Computer Interaction Based on Fog Computing and Linked Data , 2014, 2014 International Conference on Intelligent Environments.

[13]  DAVID ROSENBOOM Propositional Music from Extended Musical Interface with the Human Nervous System , 2003, Annals of the New York Academy of Sciences.

[14]  Anthony Randal McIntosh,et al.  ‘My Virtual Dream’: Collective Neurofeedback in an Immersive Art Environment , 2015, PloS one.

[15]  Jim Holt,et al.  When Einstein Walked with Gödel: Excursions to the Edge of Thought , 2018 .