A BCI-based application in music: Conscious playing of single notes by brainwaves

The relationship between the brain and music represents a fundamental field for investigation in HCI (human-computer interaction), for example, in games, virtual reality, and digital entertainment, due to the impact of music on human experience, emotions, and cognitive processes. For a low cost and the possibility of real-time analysis, the brain computer Interface (BCI) offers the potential for using music in HCI-related applications, as in games and entertainment. In many studies related to music and the brain, BCI devices have been used both for psychological aims and for neuro-feedback-based therapy. In our work we focus on the possibility of enabling users to consciously play a specific musical note through low-cost BCI devices by reading subjects' brainwaves under a combined paradigm of audio, gesture, and visual stimuli. The results encourage further developments and future research.

[1]  M. Minsky.  Music, Mind, and Meaning , 1981 .

[2]  M Schürmann,et al.  Gamma responses in the EEG: elementary signals with multiple functional correlates , 1997, Neuroreport.

[3]  Yoshitaka Fuwamoto,et al.  Analysis of music–brain interaction with simultaneous measurement of regional cerebral blood flow and electroencephalogram beta rhythm in human subjects , 1999, Neuroscience Letters.

[4]  D. Hodges,et al.  Implication of Music and Brain Research , 2000 .

[5]  H. Petsche,et al.  Interdependencies in the spontaneous EEG while listening to music. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[6]  Á. Pascual-Leone,et al.  The Brain That Plays Music and Is Changed by It , 2001, Annals of the New York Academy of Sciences.

[7]  Gert Pfurtscheller,et al.  Motor imagery and direct brain-computer communication , 2001, Proc. IEEE.

[8]  Touradj Ebrahimi,et al.  Brain-computer interface in multimedia communication , 2003, IEEE Signal Process. Mag..

[9]  I. Peretz,et al.  Brain organization for music processing. , 2005, Annual review of psychology.

[10]  Bernardo Nardi,et al.  Elaborazione corticale di un brano musicale in musicisti e non musicisti indagata mediante elettroencefalografia computerizzata (EEG-C) , 2005 .

[11]  K.-R. Muller,et al.  The Berlin brain-computer interface: EEG-based communication without subject training , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  Gert Pfurtscheller,et al.  Navigating Virtual Reality by Thought: What Is It Like? , 2007, PRESENCE: Teleoperators and Virtual Environments.

[13]  R. Zatorre,et al.  When the brain plays music: auditory–motor interactions in music perception and production , 2007, Nature Reviews Neuroscience.

[14]  Axel Mulder.  Virtual Musical Instruments: Accessing the Sound Synthesis Universe as a Performer , 2007 .

[15]  Jonathan R Wolpaw,et al.  Brain–computer interface systems: progress and prospects , 2007, Expert review of medical devices.

[16]  Desney S. Tan,et al.  Brain-Computer Interfacing for Intelligent Systems , 2008, IEEE Intelligent Systems.

[17]  De-zhong Yao,et al.  Scale-Free Music of the Brain , 2009, PLoS ONE.

[18]  E. Brown,et al.  Psychophysiological signals associated with affective states , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[19]  Raffaella Folgieri,et al.  Virtual reality as a communication process , 2011, Virtual Reality.

[20]  Raffaella Folgieri,et al.  Analysis of brain activity and response during monoscopic and stereoscopic visualization , 2012, Electronic Imaging.

[21]  Raffaella Folgieri,et al.  EEG-Based BCI Data Analysis on Visual-Perceptual Priming in the Context of a Museum of Fine Arts , 2012, DMS.