Affective Stimuli for an Auditory P300 Brain-Computer Interface

Gaze-independent brain computer interfaces (BCIs) are a potential communication tool for persons with paralysis. This study applies affective auditory stimuli to investigate their effects using a P300 BCI. Fifteen able-bodied participants operated the P300 BCI, with positive and negative affective sounds (PA: a meowing cat sound, NA: a screaming cat sound). Permuted stimuli of the positive and negative affective sounds (permuted-PA, permuted-NA) were also used for comparison. Electroencephalography data was collected, and offline classification accuracies were compared. We used a visual analog scale (VAS) to measure positive and negative affective feelings in the participants. The mean classification accuracies were 84.7% for PA and 67.3% for permuted-PA, while the VAS scores were 58.5 for PA and −12.1 for permuted-PA. The positive affective stimulus showed significantly higher accuracy and VAS scores than the negative affective stimulus. In contrast, mean classification accuracies were 77.3% for NA and 76.0% for permuted-NA, while the VAS scores were −50.0 for NA and −39.2 for permuted NA, which are not significantly different. We determined that a positive affective stimulus with accompanying positive affective feelings significantly improved BCI accuracy. Additionally, an ALS patient achieved 90% online classification accuracy. These results suggest that affective stimuli may be useful for preparing a practical auditory BCI system for patients with disabilities.

[1]  M. Bradley,et al.  Brain potentials in affective picture processing: covariation with autonomic arousal and affective report , 2000, Biological Psychology.

[2]  N. Birbaumer,et al.  An auditory oddball (P300) spelling system for brain-computer interfaces. , 2009, Psychophysiology.

[3]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[4]  J. Wolpaw,et al.  A P300-based brain–computer interface for people with amyotrophic lateral sclerosis , 2008, Clinical Neurophysiology.

[5]  J. Polich,et al.  Cognitive and biological determinants of P300: an integrative review , 1995, Biological Psychology.

[6]  Jan B. F. van Erp,et al.  A Tactile P300 Brain-Computer Interface , 2010, Front. Neurosci..

[7]  Shoji Makino,et al.  Classification improvement of P300 response based auditory spatial speller brain-computer interface paradigm , 2013, 2013 IEEE International Conference of IEEE Region 10 (TENCON 2013).

[8]  F. Piccione,et al.  P300-based brain computer interface: Reliability and performance in healthy and paralysed participants , 2006, Clinical Neurophysiology.

[9]  Robert F. Tate,et al.  Correlation Between a Discrete and a Continuous Variable. Point-Biserial Correlation , 1954 .

[10]  E. Donchin,et al.  A P300-based brain–computer interface: Initial tests by ALS patients , 2006, Clinical Neurophysiology.

[11]  M. Bradley,et al.  Affective reactions to acoustic stimuli. , 2000, Psychophysiology.

[12]  Kouji Takano,et al.  A Non-Adhesive Solid-Gel Electrode for a Non-Invasive Brain–Machine Interface , 2012, Front. Neur..

[13]  B. Blankertz,et al.  A New Auditory Multi-Class Brain-Computer Interface Paradigm: Spatial Hearing as an Informative Cue , 2010, PloS one.

[14]  Niels Birbaumer,et al.  Insula and inferior frontal triangularis activations distinguish between conditioned brain responses using emotional sounds for basic BCI communication , 2014, Front. Behav. Neurosci..

[15]  Stefan Haufe,et al.  Single-trial analysis and classification of ERP components — A tutorial , 2011, NeuroImage.

[16]  Liqing Zhang,et al.  A Novel Oddball Paradigm for Affective BCIs Using Emotional Faces as Stimuli , 2011, ICONIP.

[17]  Michael Tangermann,et al.  Listen, You are Writing! Speeding up Online Spelling with a Dynamic Auditory BCI , 2011, Front. Neurosci..

[18]  A. Kübler,et al.  A Brain–Computer Interface Controlled Auditory Event‐Related Potential (P300) Spelling System for Locked‐In Patients , 2009, Annals of the New York Academy of Sciences.

[19]  Sebastian Halder,et al.  An Evaluation of Training with an Auditory P300 Brain-Computer Interface for the Japanese Hiragana Syllabary , 2016, Front. Neurosci..

[20]  R. C. Oldfield.  The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[21]  Christa Neuper,et al.  Rehabilitation with Brain-Computer Interface Systems , 2008, Computer.

[22]  N. Birbaumer,et al.  An auditory oddball brain–computer interface for binary choices , 2010, Clinical Neurophysiology.

[23]  Clemens Brunner,et al.  Mu rhythm (de)synchronization and EEG single-trial classification of different motor imagery tasks , 2006, NeuroImage.

[24]  Ivo Käthner,et al.  An auditory multiclass brain-computer interface with natural stimuli: Usability evaluation with healthy participants and a motor impaired end user , 2015, Front. Hum. Neurosci..

[25]  Hongtu Zhu,et al.  An affective circumplex model of neural systems subserving valence, arousal, and cognitive overlay during the appraisal of emotional faces , 2008, Neuropsychologia.

[26]  Kouji Takano,et al.  A region-based two-step P300-based brain–computer interface for patients with amyotrophic lateral sclerosis , 2014, Clinical Neurophysiology.

[27]  J. Polich,et al.  P3a and P3b from typical auditory and visual stimuli , 1999, Clinical Neurophysiology.

[28]  E. W. Sellers,et al.  Toward enhanced P300 speller performance , 2008, Journal of Neuroscience Methods.

[29]  Y. Nakajima,et al.  Visual stimuli for the P300 brain–computer interface: A comparison of white/gray and green/blue flicker matrices , 2009, Clinical Neurophysiology.

[30]  A. Kübler,et al.  Training leads to increased auditory brain–computer interface performance of end-users with motor impairments , 2016, Clinical Neurophysiology.

[31]  B. Schölkopf,et al.  An online brain-computer interface based on shifting attention to concurrent streams of auditory stimuli. , 2012, Journal of neural engineering.

[32]  Steven Laureys,et al.  Probing command following in patients with disorders of consciousness using a brain–computer interface , 2013, Clinical Neurophysiology.

[33]  J. Wolpaw,et al.  A novel P300-based brain–computer interface stimulus presentation paradigm: Moving beyond rows and columns , 2010, Clinical Neurophysiology.

[34]  J. Cedarbaum,et al.  The ALSFRS-R: a revised ALS functional rating scale that incorporates assessments of respiratory function , 1999, Journal of the Neurological Sciences.

[35]  Benjamin Blankertz,et al.  A Novel 9-Class Auditory ERP Paradigm Driving a Predictive Text Entry System , 2011, Front. Neurosci..

[36]  J. Polich.  Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[37]  M Salvaris,et al.  Visual modifications on the P300 speller BCI paradigm , 2009, Journal of neural engineering.

[38]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[39]  Stefan Koelsch,et al.  The Role of Harmonic Expectancy Violations in Musical Emotions: Evidence from Subjective, Physiological, and Neural Responses , 2006, Journal of Cognitive Neuroscience.

[40]  C. Neuper,et al.  Toward a high-throughput auditory P300-based brain–computer interface , 2009, Clinical Neurophysiology.

[41]  Michael Tangermann,et al.  Natural stimuli improve auditory BCIs with respect to ergonomics and performance. , 2012, Journal of neural engineering.

[42]  S. Delplanque,et al.  Modulation of cognitive processing by emotional valence studied through event-related potentials in humans , 2004, Neuroscience Letters.

[43]  G Müller-Putz,et al.  An independent SSVEP-based brain–computer interface in locked-in syndrome , 2014, Journal of neural engineering.