Comparison of eye tracking, electrooculography and an auditory brain-computer interface for binary communication: a case study with a participant in the locked-in state

BackgroundIn this study, we evaluated electrooculography (EOG), an eye tracker and an auditory brain-computer interface (BCI) as access methods to augmentative and alternative communication (AAC). The participant of the study has been in the locked-in state (LIS) for 6 years due to amyotrophic lateral sclerosis. He was able to communicate with slow residual eye movements, but had no means of partner independent communication. We discuss the usability of all tested access methods and the prospects of using BCIs as an assistive technology.MethodsWithin four days, we tested whether EOG, eye tracking and a BCI would allow the participant in LIS to make simple selections. We optimized the parameters in an iterative procedure for all systems.ResultsThe participant was able to gain control over all three systems. Nonetheless, due to the level of proficiency previously achieved with his low-tech AAC method, he did not consider using any of the tested systems as an additional communication channel. However, he would consider using the BCI once control over his eye muscles would no longer be possible. He rated the ease of use of the BCI as the highest among the tested systems, because no precise eye movements were required; but also as the most tiring, due to the high level of attention needed to operate the BCI.ConclusionsIn this case study, the partner based communication was possible due to the good care provided and the proficiency achieved by the interlocutors. To ease the transition from a low-tech AAC method to a BCI once control over all muscles is lost, it must be simple to operate. For persons, who rely on AAC and are affected by a progressive neuromuscular disease, we argue that a complementary approach, combining BCIs and standard assistive technology, can prove valuable to achieve partner independent communication and ease the transition to a purely BCI based approach. Finally, we provide further evidence for the importance of a user-centered approach in the design of new assistive devices.

[1]  B. Schölkopf,et al.  An online brain-computer interface based on shifting attention to concurrent streams of auditory stimuli. , 2012, Journal of neural engineering.

[2]  N. Birbaumer Breaking the silence: brain-computer interfaces (BCI) for communication and motor control. , 2006, Psychophysiology.

[3]  F Cincotti,et al.  Workload measurement in a communication application operated through a P300-based brain–computer interface , 2011, Journal of neural engineering.

[4]  Bernhard Schölkopf,et al.  An Auditory Paradigm for Brain-Computer Interfaces , 2004, NIPS.

[5]  Konstantinos Priftis,et al.  Effectiveness of the P3-speller in brain–computer interfaces for amyotrophic lateral sclerosis patients: a systematic review and meta-analysis , 2014, Front. Neuroeng..

[6]  Antonio Nardone,et al.  Eye tracking communication devices in amyotrophic lateral sclerosis: Impact on disability and quality of life , 2013, Amyotrophic lateral sclerosis & frontotemporal degeneration.

[7]  Michael Tangermann,et al.  Listen, You are Writing! Speeding up Online Spelling with a Dynamic Auditory BCI , 2011, Front. Neurosci..

[8]  N. Birbaumer,et al.  An auditory oddball (P300) spelling system for brain-computer interfaces. , 2009, Psychophysiology.

[9]  Recommendations for use of uniform nomenclature pertinent to patients with severe alterations in consciousness. American Congress of Rehabilitation Medicine. , 1995, Archives of physical medicine and rehabilitation.

[10]  J. Wolpaw,et al.  A P300-based brain–computer interface for people with amyotrophic lateral sclerosis , 2008, Clinical Neurophysiology.

[11]  C. A. Ruf,et al.  Brain–computer interface and semantic classical conditioning of communication in paralysis , 2013, Biological Psychology.

[12]  E. Donchin,et al.  A P300-based brain–computer interface: Initial tests by ALS patients , 2006, Clinical Neurophysiology.

[13]  Jonathan R. Wolpaw,et al.  Brain–Computer InterfacesPrinciples and Practice , 2012 .

[14]  B. Schoelkopf,et al.  Transition from the locked in to the completely locked-in state: A physiological analysis , 2011, Clinical Neurophysiology.

[15]  Dean J Krusienski,et al.  A comparison of classification techniques for the P300 Speller , 2006, Journal of neural engineering.

[16]  J. W. Minett,et al.  Optimizing the P300-based brain–computer interface: current status, limitations and future directions , 2011, Journal of neural engineering.

[17]  Tobias Kaufmann,et al.  Long-term independent brain-computer interface home use improves quality of life of a patient in the locked-in state: a case study. , 2015, Archives of physical medicine and rehabilitation.

[18]  Constantine Stephanidis,et al.  Universal Access in Human-Computer Interaction. Intelligent and Ubiquitous Interaction Environments, 5th International Conference, UAHCI 2009, Held as Part of HCI International 2009, San Diego, CA, USA, July 19-24, 2009. Proceedings, Part II , 2009, HCI.

[19]  J. Lou,et al.  Purposes of AAC device use for persons with ALS as reported by caregivers , 2006, Augmentative and alternative communication.

[20]  S. Honda,et al.  Electro-oculography mouse for amyotrophic lateral sclerosis patients , 1996, Proceedings of 18th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[21]  David R. Beukelman,et al.  Eye-gaze access to AAC technology for people with amyotrophic lateral sclerosis , 2010 .

[22]  Gernot R. Müller-Putz,et al.  The auditory P300-based single-switch brain-computer interface: Paradigm transition from healthy subjects to minimally conscious patients , 2013, Artif. Intell. Medicine.

[23]  J. Wolpaw,et al.  Brain-computer communication: unlocking the locked in. , 2001, Psychological bulletin.

[24]  F. Cincotti,et al.  Eye-gaze independent EEG-based brain–computer interfaces for communication , 2012, Journal of neural engineering.

[25]  Gernot R. Müller-Putz,et al.  Brain-controlled applications using dynamic P300 speller matrices , 2015, Artif. Intell. Medicine.

[26]  N. Birbaumer,et al.  An auditory oddball brain–computer interface for binary choices , 2010, Clinical Neurophysiology.

[27]  A. Kübler,et al.  Training leads to increased auditory brain–computer interface performance of end-users with motor impairments , 2016, Clinical Neurophysiology.

[28]  Tobias Kaufmann,et al.  Comparison of tactile, auditory, and visual modality for brain-computer interface use: a case study with a patient in the locked-in state , 2013, Front. Neurosci..

[29]  Masashi Kiguchi,et al.  A Communication Means for Totally Locked-in ALS Patients Based on Changes in Cerebral Blood Volume Measured with Near-Infrared Light , 2007, IEICE Trans. Inf. Syst..

[30]  Fulvio Corno,et al.  Understanding users and their needs , 2009, Universal Access in the Information Society.

[31]  Chon-Haw Tsai,et al.  An Eye-Tracking Assistive Device Improves the Quality of Life for ALS Patients and Reduces the Caregivers’ Burden , 2014, Journal of motor behavior.

[32]  A. Kübler,et al.  Effects of training and motivation on auditory P300 brain–computer interface performance , 2016, Clinical Neurophysiology.

[33]  N. Birbaumer,et al.  Brain–computer interfaces and communication in paralysis: Extinction of goal directed thinking in completely paralysed patients? , 2008, Clinical Neurophysiology.

[34]  Chun-Liang Hsu,et al.  EOG-based Human-Computer Interface system development , 2010, Expert Syst. Appl..

[35]  C. Neuper,et al.  Combining Brain–Computer Interfaces and Assistive Technologies: State-of-the-Art and Challenges , 2010, Front. Neurosci..

[36]  Christoph Braun,et al.  A portable auditory P300 brain–computer interface with directional cues , 2013, Clinical Neurophysiology.

[37]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[38]  J. Wolpaw,et al.  Brain-Computer Interfaces: Principles and Practice , 2012 .

[39]  R. Spataro,et al.  The eye‐tracking computer device for communication in amyotrophic lateral sclerosis , 2014, Acta neurologica Scandinavica.

[40]  E. Sellers,et al.  How many people are able to control a P300-based brain–computer interface (BCI)? , 2009, Neuroscience Letters.

[41]  Sunil Vadera,et al.  A privacy-preserving blockchain-based tracing model for virus-infected people in cloud , 2022, Expert systems with applications.

[42]  Thorsten O. Zander,et al.  BC(eye): Combining Eye-Gaze Input with Brain-Computer Interaction , 2009, HCI.

[43]  Donatella Mattia,et al.  A Brain-Computer Interface as Input Channel for a Standard Assistive Technology Software , 2011, Clinical EEG and neuroscience.

[44]  Laura Farinetti,et al.  Eye Tracking Impact on Quality-of-Life of ALS Patients , 2008, ICCHP.

[45]  J. Wolpaw,et al.  A practical, intuitive brain–computer interface for communicating ‘yes’ or ‘no’ by listening , 2014, Journal of neural engineering.

[46]  F. Gerstenbrand,et al.  Varieties of the locked-in syndrome , 1979, Journal of Neurology.

[47]  H. Lüders,et al.  American Electroencephalographic Society Guidelines for Standard Electrode Position Nomenclature , 1991, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[48]  A. Koeppen Plum and Posner's Diagnosis of Stupor and Coma, Fourth edition, J.B. Posner, C.F. Saper, N.D. Schiff, F Plum. Oxford University Press, Oxford and New York (2007), ISBN 978-0-19-532131-1, 401 pages, US$ 79.50 , 2008 .

[49]  Susan Fager,et al.  AAC for adults with acquired neurological conditions: A review , 2007, Augmentative and alternative communication.

[50]  Kallirroi Georgila,et al.  Speech Input from Older Users in Smart Environments: Challenges and Perspectives , 2009, HCI.

[51]  Stefano Federici,et al.  Usability and Workload of Access Technology for People With Severe Motor Impairment , 2015, Neurorehabilitation and neural repair.

[52]  Jonathan R Wolpaw,et al.  A brain-computer interface for long-term independent home use , 2010, Amyotrophic lateral sclerosis : official publication of the World Federation of Neurology Research Group on Motor Neuron Diseases.

[53]  Ivo Käthner,et al.  An auditory multiclass brain-computer interface with natural stimuli: Usability evaluation with healthy participants and a motor impaired end user , 2015, Front. Hum. Neurosci..

[54]  S. Debener,et al.  Towards a truly mobile auditory brain-computer interface: exploring the P300 to take away. , 2014, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[55]  A. Kübler,et al.  The User-Centered Design as Novel Perspective for Evaluating the Usability of BCI-Controlled Applications , 2014, PloS one.

[56]  Benjamin Blankertz,et al.  A Novel 9-Class Auditory ERP Paradigm Driving a Predictive Text Entry System , 2011, Front. Neurosci..

[57]  Ivo Käthner,et al.  Rapid P300 brain-computer interface communication with a head-mounted display , 2015, Front. Neurosci..

[58]  J. Polich Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[59]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[60]  B. Blankertz,et al.  A New Auditory Multi-Class Brain-Computer Interface Paradigm: Spatial Hearing as an Informative Cue , 2010, PloS one.

[61]  J. Wolpaw,et al.  A novel P300-based brain–computer interface stimulus presentation paradigm: Moving beyond rows and columns , 2010, Clinical Neurophysiology.

[62]  A. Kübler,et al.  Motivation modulates the P300 amplitude during brain–computer interface use , 2010, Clinical Neurophysiology.