Effects of training and motivation on auditory P300 brain–computer interface performance

OBJECTIVES Brain-computer interface (BCI) technology aims at helping end-users with severe motor paralysis to communicate with their environment without using the natural output pathways of the brain. For end-users in complete paralysis, loss of gaze control may necessitate non-visual BCI systems. The present study investigated the effect of training on performance with an auditory P300 multi-class speller paradigm. For half of the participants, spatial cues were added to the auditory stimuli to see whether performance can be further optimized. The influence of motivation, mood and workload on performance and P300 component was also examined. METHODS In five sessions, 16 healthy participants were instructed to spell several words by attending to animal sounds representing the rows and columns of a 5 × 5 letter matrix. RESULTS 81% of the participants achieved an average online accuracy of ⩾ 70%. From the first to the fifth session information transfer rates increased from 3.72 bits/min to 5.63 bits/min. Motivation significantly influenced P300 amplitude and online ITR. No significant facilitative effect of spatial cues on performance was observed. CONCLUSIONS Training improves performance in an auditory BCI paradigm. Motivation influences performance and P300 amplitude. SIGNIFICANCE The described auditory BCI system may help end-users to communicate independently of gaze control with their environment.

[1]  Michael Tangermann,et al.  Brain-computer interface controlled gaming: Evaluation of usability by severely motor restricted end-users , 2013, Artif. Intell. Medicine.

[2]  Christiane,et al.  World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. , 2004, Journal international de bioethique = International journal of bioethics.

[3]  V Sahgal,et al.  Mortality and complications of the locked-in syndrome. , 1987, Archives of physical medicine and rehabilitation.

[4]  H. Flor,et al.  A spelling device for the paralysed , 1999, Nature.

[5]  N. Birbaumer,et al.  The Influence of Psychological State and Motivation on Brain–Computer Interface Performance in Patients with Amyotrophic Lateral Sclerosis – a Longitudinal Study , 2010, Front. Neuropharma..

[6]  B. Blankertz,et al.  (C)overt attention and visual speller design in an ERP-based brain-computer interface , 2010, Behavioral and Brain Functions.

[7]  J. Wolpaw,et al.  Brain-computer communication: unlocking the locked in. , 2001, Psychological bulletin.

[8]  Benjamin Blankertz,et al.  Two-dimensional auditory p300 speller with predictive text system , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[9]  D. McFarland,et al.  An auditory brain–computer interface (BCI) , 2008, Journal of Neuroscience Methods.

[10]  N. Birbaumer.  Breaking the silence: brain-computer interfaces (BCI) for communication and motor control. , 2006, Psychophysiology.

[11]  Jan B. F. van Erp,et al.  A Tactile P300 Brain-Computer Interface , 2010, Front. Neurosci..

[12]  Eduardo Serrano,et al.  Characterization of a clinical olfactory test with an artificial nose , 2011, Front. Neuroeng..

[13]  E Donchin,et al.  The mental prosthesis: assessing the speed of a P300-based brain-computer interface. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[14]  B. Blankertz,et al.  Initial results of a high-speed spatial auditory BCI , 2009 .

[15]  L. Pessoa,et al.  Combined Effects of Attention and Motivation on Visual Task Performance: Transient and Sustained Motivational Effects , 2008, Front. Hum. Neurosci..

[16]  M. Hautzinger,et al.  Allgemeine Depressions Skala , 1993 .

[17]  A. Kübler,et al.  Motivation modulates the P300 amplitude during brain–computer interface use , 2010, Clinical Neurophysiology.

[18]  Michael Tangermann,et al.  Natural stimuli improve auditory BCIs with respect to ergonomics and performance. , 2012, Journal of neural engineering.

[19]  N. Birbaumer,et al.  An auditory oddball brain–computer interface for binary choices , 2010, Clinical Neurophysiology.

[20]  F Cincotti,et al.  Workload measurement in a communication application operated through a P300-based brain–computer interface , 2011, Journal of neural engineering.

[21]  E. A. Zillmer,et al.  Construct validity for the d2 test of attention , 1999 .

[22]  Tobias Kaufmann,et al.  Comparison of tactile, auditory, and visual modality for brain-computer interface use: a case study with a patient in the locked-in state , 2013, Front. Neurosci..

[23]  Ivo Käthner,et al.  An auditory multiclass brain-computer interface with natural stimuli: Usability evaluation with healthy participants and a motor impaired end user , 2015, Front. Hum. Neurosci..

[24]  Christoph Braun,et al.  A portable auditory P300 brain–computer interface with directional cues , 2013, Clinical Neurophysiology.

[25]  T. Demiralp,et al.  Cognitive impairment in amyotrophic lateral sclerosis: evidence from neuropsychological investigation and event-related potentials. , 2002, Brain research. Cognitive brain research.

[26]  Tobias Kaufmann,et al.  Beyond maximum speed—a novel two-stimulus paradigm for brain–computer interfaces based on event-related potentials (P300-BCI) , 2014, Journal of neural engineering.

[27]  Brendan Z. Allison,et al.  P300 brain computer interface: current challenges and emerging trends , 2012, Front. Neuroeng..

[28]  A. Kübler,et al.  A Brain–Computer Interface Controlled Auditory Event‐Related Potential (P300) Spelling System for Locked‐In Patients , 2009, Annals of the New York Academy of Sciences.

[29]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[30]  Dean J Krusienski,et al.  A comparison of classification techniques for the P300 Speller , 2006, Journal of neural engineering.

[31]  Michael Tangermann,et al.  Listen, You are Writing! Speeding up Online Spelling with a Dynamic Auditory BCI , 2011, Front. Neurosci..

[32]  A Kübler,et al.  Life can be worth living in locked-in syndrome. , 2009, Progress in brain research.

[33]  Regina Vollmeyer,et al.  FAM: Ein Fragebogen zur Erfassung aktuller Motivation in Lern- und Leistungssituationen , 2001 .

[34]  N. Birbaumer,et al.  An auditory oddball (P300) spelling system for brain-computer interfaces. , 2009, Psychophysiology.

[35]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[36]  J. Wolpaw,et al.  A P300-based brain–computer interface for people with amyotrophic lateral sclerosis , 2008, Clinical Neurophysiology.

[37]  R. Brickenkamp,et al.  D2 Test of Attention , 1998 .

[38]  Niels Birbaumer,et al.  Listen to the frog! An auditory P300 brain-computer interface with directional cues and natural sounds , 2013 .

[39]  H. Lüders,et al.  American Electroencephalographic Society Guidelines for Standard Electrode Position Nomenclature , 1991, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[40]  Lucas Spierer,et al.  Learning-Induced Plasticity in Auditory Spatial Representations Revealed by Electrical Neuroimaging , 2007, The Journal of Neuroscience.

[41]  E. Donchin,et al.  A P300-based brain–computer interface: Initial tests by ALS patients , 2006, Clinical Neurophysiology.

[42]  HolzElisa Mira,et al.  Brain-computer interface controlled gaming , 2013 .

[43]  C. Neuper,et al.  Toward a high-throughput auditory P300-based brain–computer interface , 2009, Clinical Neurophysiology.

[44]  Christa Neuper,et al.  Motivation affects Performance in a P300 Brain Computer Interface , 2011 .

[45]  Wolzt,et al.  World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. , 2003, The Journal of the American College of Dentists.

[46]  H. Flor,et al.  The thought translation device (TTD) for completely paralyzed patients. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[47]  J. Wolpaw,et al.  Does the ‘P300’ speller depend on eye gaze? , 2010, Journal of neural engineering.

[48]  N. Birbaumer,et al.  Brain-computer communication: self-regulation of slow cortical potentials for verbal communication. , 2001, Archives of physical medicine and rehabilitation.

[49]  Richard F. Gunst,et al.  Applied Regression Analysis , 1999, Technometrics.

[50]  N. Birbaumer,et al.  Brain–computer interfaces and communication in paralysis: Extinction of goal directed thinking in completely paralysed patients? , 2008, Clinical Neurophysiology.

[51]  D. Linden.  The P300: Where in the Brain Is It Produced and What Does It Tell Us? , 2005, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[52]  Cornelia Herbert,et al.  Brain Painting: Usability testing according to the user-centered design in end users with severe motor paralysis , 2013, Artif. Intell. Medicine.

[53]  Rita Z. Goldstein,et al.  The effect of graded monetary reward on cognitive event-related potentials and behavior in young healthy adults. , 2006, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[54]  B. Blankertz,et al.  A New Auditory Multi-Class Brain-Computer Interface Paradigm: Spatial Hearing as an Informative Cue , 2010, PloS one.

[55]  A. Engel,et al.  An independent brain–computer interface using covert non-spatial visual selective attention , 2010, Journal of neural engineering.

[56]  A. Lenhardt,et al.  An Adaptive P300-Based Online Brain–Computer Interface , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[57]  Gerald J. Hahn,et al.  Applied Regression Analysis (2nd Ed.) , 2012 .

[58]  B. Schölkopf,et al.  An online brain-computer interface based on shifting attention to concurrent streams of auditory stimuli. , 2012, Journal of neural engineering.

[59]  E Donchin,et al.  Averaged evoked potentials and intramodality selective attention. , 1967, Electroencephalography and clinical neurophysiology.

[60]  Bernhard Schölkopf,et al.  An Auditory Paradigm for Brain-Computer Interfaces , 2004, NIPS.

[61]  Benjamin Blankertz,et al.  A Novel 9-Class Auditory ERP Paradigm Driving a Predictive Text Entry System , 2011, Front. Neurosci..

[62]  J. Polich.  Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[63]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[64]  J. Pierce.  An introduction to information theory: symbols, signals & noise , 1980 .

[65]  J. Polich,et al.  Cognitive and biological determinants of P300: an integrative review , 1995, Biological Psychology.

[66]  F. Cincotti,et al.  Eye-gaze independent EEG-based brain–computer interfaces for communication , 2012, Journal of neural engineering.

[67]  E. John,et al.  Evoked-Potential Correlates of Stimulus Uncertainty , 1965, Science.

[68]  Donatella Mattia,et al.  A Brain-Computer Interface as Input Channel for a Standard Assistive Technology Software , 2011, Clinical EEG and neuroscience.

[69]  J. Polich,et al.  Task difficulty, probability, and inter-stimulus interval as determinants of P300 from auditory stimuli. , 1987, Electroencephalography and clinical neurophysiology.

[70]  A. Kübler,et al.  Face stimuli effectively prevent brain–computer interface inefficiency in patients with neurodegenerative disease , 2013, Clinical Neurophysiology.

[71]  A. Kok.  On the utility of P3 amplitude as a measure of processing capacity. , 2001, Psychophysiology.

[72]  Febo Cincotti,et al.  Vibrotactile Feedback for Brain-Computer Interface Operation , 2007, Comput. Intell. Neurosci..