An emergency call system for patients in locked-in state using an SSVEP-based brain switch.

Patients in a locked-in state (LIS) due to severe neurological disorders such as amyotrophic lateral sclerosis (ALS) require seamless emergency care by their caregivers or guardians. However, it is a difficult job for the guardians to continuously monitor the patients' state, especially when direct communication is not possible. In the present study, we developed an emergency call system for such patients using a steady-state visual evoked potential (SSVEP)-based brain switch. Although there have been previous studies to implement SSVEP-based brain switch system, they have not been applied to patients in LIS, and thus their clinical value has not been validated. In this study, we verified whether the SSVEP-based brain switch system can be practically used as an emergency call system for patients in LIS. The brain switch used for our system adopted a chromatic visual stimulus, which proved to be visually less stimulating than conventional checkerboard-type stimuli but could generate SSVEP responses strong enough to be used for brain-computer interface (BCI) applications. To verify the feasibility of our emergency call system, 14 healthy participants and 3 patients with severe ALS took part in online experiments. All three ALS patients successfully called their guardians to their bedsides in about 6.56 seconds. Furthermore, additional experiments with one of these patients demonstrated that our emergency call system maintains fairly good performance even up to 4 weeks after the first experiment without renewing initial calibration data. Our results suggest that our SSVEP-based emergency call system might be successfully used in practical scenarios.

[1]  Christian Laugier,et al.  Controlling a Wheelchair Indoors Using Thought , 2007, IEEE Intelligent Systems.

[2]  A. Cichocki,et al.  Steady-state visually evoked potentials: Focus on essential paradigms and future perspectives , 2010, Progress in Neurobiology.

[3]  D. Cleveland,et al.  ALS: A Disease of Motor Neurons and Their Nonneuronal Neighbors , 2006, Neuron.

[4]  S. Coyle,et al.  Brain–computer interfaces: a review , 2003 .

[5]  Carlos Hitoshi Morimoto,et al.  Eye gaze tracking techniques for interactive applications , 2005, Comput. Vis. Image Underst..

[6]  Benjamin Blankertz,et al.  Towards a Cure for BCI Illiteracy , 2009, Brain Topography.

[7]  Jie Li,et al.  Asynchronous Brain–Computer Interface Based on Steady-State Visual-Evoked Potential , 2013, Cognitive Computation.

[8]  G. Pfurtscheller,et al.  Brain-computer interfaces for control of neuroprostheses: from synchronous to asynchronous mode of operation. , 2006, Biomedizinische Technik. Biomedical engineering.

[9]  Tom Chau,et al.  Towards a hemodynamic BCI using transcranial Doppler without user-specific training data. , 2013, Journal of neural engineering.

[10]  Han-Jeong Hwang,et al.  Neurofeedback-based motor imagery training for brain–computer interface (BCI) , 2009, Journal of Neuroscience Methods.

[11]  Xingyu Wang,et al.  Sparse Bayesian multiway canonical correlation analysis for EEG pattern recognition , 2017, Neurocomputing.

[12]  Gary E. Birch,et al.  Brain-computer interface design for asynchronous control applications: improvements to the LF-ASD asynchronous brain switch , 2004, IEEE Transactions on Biomedical Engineering.

[13]  Gerwin Schalk,et al.  A brain–computer interface using electrocorticographic signals in humans , 2004, Journal of neural engineering.

[14]  Xingyu Wang,et al.  Sparse Bayesian Classification of EEG for Brain–Computer Interface , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[15]  Shirley M Coyle,et al.  Brain–computer interface using a simplified functional near-infrared spectroscopy system , 2007, Journal of neural engineering.

[16]  M. V. Gerven,et al.  Attention modulations of posterior alpha as a control signal for two-dimensional brain–computer interfaces , 2009, Journal of Neuroscience Methods.

[17]  Gernot R. Müller-Putz,et al.  Control of an Electrical Prosthesis With an SSVEP-Based BCI , 2008, IEEE Transactions on Biomedical Engineering.

[18]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[19]  Tao Liu,et al.  N200-speller using motion-onset visual response , 2009, Clinical Neurophysiology.

[20]  Stefano Federici,et al.  Usability and Workload of Access Technology for People With Severe Motor Impairment , 2015, Neurorehabilitation and neural repair.

[21]  Henk J Stam,et al.  Validation of an activity monitor for children who are partly or completely wheelchair-dependent , 2015, Journal of NeuroEngineering and Rehabilitation.

[22]  G. Pfurtscheller,et al.  An SSVEP BCI to Control a Hand Orthosis for Persons With Tetraplegia , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[23]  Ivo Käthner,et al.  Comparison of eye tracking, electrooculography and an auditory brain-computer interface for binary communication: a case study with a participant in the locked-in state , 2015, Journal of NeuroEngineering and Rehabilitation.

[24]  Jie Li,et al.  A hybrid brain computer interface system based on the neurophysiological protocol and brain-actuated switch for wheelchair control , 2014, Journal of Neuroscience Methods.

[25]  Tom Chau,et al.  A Brain-Computer Interface Based on Bilateral Transcranial Doppler Ultrasound , 2011, PloS one.

[26]  M. Nuttin,et al.  A brain-actuated wheelchair: Asynchronous and non-invasive Brain–computer interfaces for continuous control of robots , 2008, Clinical Neurophysiology.

[27]  Chang-Hwan Im,et al.  Development of an SSVEP-based BCI spelling system adopting a QWERTY-style LED keyboard , 2012, Journal of Neuroscience Methods.

[28]  Gernot R. Müller-Putz,et al.  Brain-computer interfaces for control of neuroprostheses: from synchronous to asynchronous mode of operation / Brain-Computer Interfaces zur Steuerung von Neuroprothesen: von der synchronen zur asynchronen Funktionsweise , 2006 .

[29]  Vera Kaiser,et al.  Fast set-up asynchronous brain-switch based on detection of foot motor imagery in 1-channel EEG , 2010, Medical & Biological Engineering & Computing.

[30]  Xingyu Wang,et al.  Discriminative Feature Extraction via Multivariate Linear Regression for SSVEP-Based BCI , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[31]  Christa Neuper,et al.  An asynchronously controlled EEG-based virtual keyboard: improvement of the spelling rate , 2004, IEEE Transactions on Biomedical Engineering.

[32]  Dennis J. McFarland,et al.  Brain-Computer Interface Operation of Robotic and Prosthetic Devices , 2008, Computer.

[33]  Feng Li,et al.  Discrimination Between Control and Idle States in Asynchronous SSVEP-Based Brain Switches: A Pseudo-Key-Based Approach , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[34]  Xingyu Wang,et al.  Frequency Recognition in SSVEP-Based BCI using Multiset Canonical Correlation Analysis , 2013, Int. J. Neural Syst..

[35]  F. Gerstenbrand,et al.  Varieties of the locked-in syndrome , 1979, Journal of Neurology.

[36]  Klaus-Robert Müller,et al.  Enhanced Performance by a Hybrid Nirs–eeg Brain Computer Interface , 2022 .

[37]  Kang Ryoung Park,et al.  Fuzzy System-Based Target Selection for a NIR Camera-Based Gaze Tracker , 2017, Sensors.

[38]  Andreas Keil,et al.  Steady-state visual evoked potentials as a research tool in social affective neuroscience. , 2016, Psychophysiology.

[39]  Wolfgang Rosenstiel,et al.  An MEG-based brain–computer interface (BCI) , 2007, NeuroImage.

[40]  Hubert Cecotti,et al.  A Multimodal Gaze-Controlled Virtual Keyboard , 2016, IEEE Transactions on Human-Machine Systems.

[41]  Minho Kim,et al.  Quantitative Evaluation of a Low-Cost Noninvasive Hybrid Interface Based on EEG and Eye Movement , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[42]  E. Sellers,et al.  How many people are able to control a P300-based brain–computer interface (BCI)? , 2009, Neuroscience Letters.

[43]  Gernot R. Müller-Putz,et al.  Self-Paced (Asynchronous) BCI Control of a Wheelchair in Virtual Environments: A Case Study with a Tetraplegic , 2007, Comput. Intell. Neurosci..

[44]  Cuntai Guan,et al.  Temporal classification of multichannel near-infrared spectroscopy signals of motor imagery for developing a brain–computer interface , 2007, NeuroImage.

[45]  Wolfgang Grodd,et al.  Principles of a brain-computer interface (BCI) based on real-time functional magnetic resonance imaging (fMRI) , 2004, IEEE Transactions on Biomedical Engineering.

[46]  N. Ramsey,et al.  Towards human BCI applications based on cognitive brain systems: an investigation of neural signals recorded from the dorsolateral prefrontal cortex , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[47]  Yeung Sam Hung,et al.  A Chromatic Transient Visual Evoked Potential Based Encoding/Decoding Approach for Brain–Computer Interface , 2011, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[48]  M Fatourechi,et al.  A self-paced brain–computer interface system with a low false positive rate , 2008, Journal of neural engineering.

[49]  Andrzej Cichocki,et al.  L1-Regularized Multiway Canonical Correlation Analysis for SSVEP-Based BCI , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[50]  Chang-Hwan Im,et al.  Clinical feasibility of brain-computer interface based on steady-state visual evoked potential in patients with locked-in syndrome: Case studies. , 2017, Psychophysiology.

[51]  Gary E. Birch,et al.  A brain-controlled switch for asynchronous control applications , 2000, IEEE Trans. Biomed. Eng..

[52]  J. Wolpaw,et al.  Decoding two-dimensional movement trajectories using electrocorticographic signals in humans , 2007, Journal of neural engineering.

[53]  J. Mourino,et al.  Asynchronous BCI and local neural classifiers: an overview of the adaptive brain interface project , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.