Development of a Brain–Computer Interface Toggle Switch with Low False-Positive Rate Using Respiration-Modulated Photoplethysmography

Asynchronous brain–computer interfaces (BCIs) based on electroencephalography (EEG) generally suffer from poor performance in terms of classification accuracy and false-positive rate (FPR). Thus, BCI toggle switches based on electrooculogram (EOG) signals were developed to toggle on/off synchronous BCI systems. The conventional BCI toggle switches exhibit fast responses with high accuracy; however, they have a high FPR or cannot be applied to patients with oculomotor impairments. To circumvent these issues, we developed a novel BCI toggle switch that users can employ to toggle on or off synchronous BCIs by holding their breath for a few seconds. Two states—normal breath and breath holding—were classified using a linear discriminant analysis with features extracted from the respiration-modulated photoplethysmography (PPG) signals. A real-time BCI toggle switch was implemented with calibration data trained with only 1-min PPG data. We evaluated the performance of our PPG switch by combining it with a steady-state visual evoked potential-based BCI system that was designed to control four external devices, with regard to the true-positive rate and FPR. The parameters of the PPG switch were optimized through an offline experiment with five subjects, and the performance of the switch system was evaluated in an online experiment with seven subjects. All the participants successfully turned on the BCI by holding their breath for approximately 10 s (100% accuracy), and the switch system exhibited a very low FPR of 0.02 false operations per minute, which is the lowest FPR reported thus far. All participants could successfully control external devices in the synchronous BCI mode. Our results demonstrated that the proposed PPG-based BCI toggle switch can be used to implement practical BCIs.

[1]  Xiaorong Gao,et al.  An online multi-channel SSVEP-based brain–computer interface using a canonical correlation analysis method , 2009, Journal of neural engineering.

[2]  Zoran Nenadic,et al.  Electroencephalography-based endogenous brain–computer interface for online communication with a completely locked-in patient , 2019, Journal of NeuroEngineering and Rehabilitation.

[3]  Yuanqing Li,et al.  An asynchronous wheelchair control by hybrid EEG–EOG brain–computer interface , 2014, Cognitive Neurodynamics.

[4]  Yuanqing Li,et al.  A Hybrid BCI System Combining P300 and SSVEP and Its Application to Wheelchair Control , 2013, IEEE Transactions on Biomedical Engineering.

[5]  Gary E. Birch,et al.  Brain-computer interface design for asynchronous control applications: improvements to the LF-ASD asynchronous brain switch , 2004, IEEE Transactions on Biomedical Engineering.

[6]  A. Kübler,et al.  A Brain–Computer Interface Controlled Auditory Event‐Related Potential (P300) Spelling System for Locked‐In Patients , 2009, Annals of the New York Academy of Sciences.

[7]  Wilburta Q. Lindh Delmar's Comprehensive Medical Assisting: Administrative and Clinical Competencies , 1997 .

[8]  Chang-Hwan Im,et al.  Classification of selective attention to auditory stimuli: Toward vision-free brain–computer interfacing , 2011, Journal of Neuroscience Methods.

[9]  K. Barrett,et al.  Ganong's Review of Medical Physiology , 2010 .

[10]  E. Sellers,et al.  How many people are able to control a P300-based brain–computer interface (BCI)? , 2009, Neuroscience Letters.

[11]  Vladimir A. Maksimenko,et al.  A MEG Study of Different Motor Imagery Modes in Untrained Subjects for BCI Applications , 2019, ICINCO.

[12]  G. Pfurtscheller,et al.  An SSVEP BCI to Control a Hand Orthosis for Persons With Tetraplegia , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  N. Birbaumer,et al.  Brain-computer communication: self-regulation of slow cortical potentials for verbal communication. , 2001, Archives of physical medicine and rehabilitation.

[14]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[15]  L. Nilsson,et al.  Combined photoplethysmographic monitoring of respiration rate and pulse: a comparison between different measurement sites in spontaneously breathing subjects , 2007, Acta anaesthesiologica Scandinavica.

[16]  Chang-Hwan Im,et al.  An emergency call system for patients in locked-in state using an SSVEP-based brain switch. , 2017, Psychophysiology.

[17]  Yuanqing Li,et al.  A P300-Based Threshold-Free Brain Switch and Its Application in Wheelchair Control , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  Keum-Shik Hong,et al.  fNIRS-based brain-computer interfaces: a review , 2015, Front. Hum. Neurosci..

[19]  Rainer Goebel,et al.  Optimizing fMRI experimental design for MVPA-based BCI control: Combining the strengths of block and event-related designs , 2019, NeuroImage.

[20]  Vera Kaiser,et al.  Fast set-up asynchronous brain-switch based on detection of foot motor imagery in 1-channel EEG , 2010, Medical & Biological Engineering & Computing.

[21]  Clemens Brunner,et al.  Better than random? A closer look on BCI results , 2008 .

[22]  Stefan Haufe,et al.  Optimizing event-related potential based brain-computer interfaces: a systematic evaluation of dynamic stopping methods. , 2013, Journal of neural engineering.

[23]  Byoung-Kyong Min,et al.  Neuroimaging-based approaches in the brain-computer interface. , 2010, Trends in biotechnology.

[24]  Chuang Lin,et al.  Endogenous sensory discrimination and selection by a fast brain switch for a high transfer rate brain-computer interface , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[25]  Wolfgang Rosenstiel,et al.  An MEG-based brain–computer interface (BCI) , 2007, NeuroImage.

[26]  Wolfgang Grodd,et al.  Principles of a brain-computer interface (BCI) based on real-time functional magnetic resonance imaging (fMRI) , 2004, IEEE Transactions on Biomedical Engineering.

[27]  Chang-Hwan Im,et al.  Clinical feasibility of brain-computer interface based on steady-state visual evoked potential in patients with locked-in syndrome: Case studies. , 2017, Psychophysiology.

[28]  J. Wolpaw,et al.  Towards an independent brain–computer interface using steady state visual evoked potentials , 2008, Clinical Neurophysiology.

[29]  J. Wolpaw,et al.  A P300 event-related potential brain–computer interface (BCI): The effects of matrix size and inter stimulus interval on performance , 2006, Biological Psychology.

[30]  B. Schölkopf,et al.  An online brain-computer interface based on shifting attention to concurrent streams of auditory stimuli. , 2012, Journal of neural engineering.

[31]  Xiaorong Gao,et al.  Frequency and Phase Mixed Coding in SSVEP-Based Brain--Computer Interface , 2011, IEEE Transactions on Biomedical Engineering.

[32]  Feng Li,et al.  Discrimination Between Control and Idle States in Asynchronous SSVEP-Based Brain Switches: A Pseudo-Key-Based Approach , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[33]  Yuanqing Li,et al.  A EOG-based switch and its application for "start/stop" control of a wheelchair , 2018, Neurocomputing.

[34]  Rui Zhang,et al.  Control of a nursing bed based on a hybrid brain-computer interface , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[35]  G. Pfurtscheller,et al.  Continuous EEG classification during motor imagery-simulation of an asynchronous BCI , 2004, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[36]  Chang-Hwan Im,et al.  Development of an SSVEP-based BCI spelling system adopting a QWERTY-style LED keyboard , 2012, Journal of Neuroscience Methods.

[37]  Chang-Hwan Im,et al.  A new dual-frequency stimulation method to increase the number of visual stimuli for multi-class SSVEP-based brain–computer interface (BCI) , 2013, Brain Research.

[38]  Young-Jin Jung,et al.  A multi-day and multi-band dataset for a steady-state visual-evoked potential–based brain-computer interface , 2019, GigaScience.

[39]  Djillali Annane,et al.  Mechanical ventilation for amyotrophic lateral sclerosis/motor neuron disease. , 2009, The Cochrane database of systematic reviews.

[40]  Chang-Hwan Im,et al.  Fast and Robust Real-Time Estimation of Respiratory Rate from Photoplethysmography , 2016, Sensors.

[41]  Luzheng Bi,et al.  A Novel Event-Related Potential-Based Brain–Computer Interface for Continuously Controlling Dynamic Systems , 2019, IEEE Access.

[42]  Alexander J Casson,et al.  Wearable EEG and beyond , 2019, Biomedical Engineering Letters.

[43]  F Babiloni,et al.  P300-based brain–computer interface for environmental control: an asynchronous approach , 2011, Journal of neural engineering.

[44]  D J McFarland,et al.  An EEG-based brain-computer interface for cursor control. , 1991, Electroencephalography and clinical neurophysiology.

[45]  Javier Gomez-Pilar,et al.  An Asynchronous P300-Based Brain-Computer Interface Web Browser for Severely Disabled People , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[46]  Tao Liu,et al.  N200-speller using motion-onset visual response , 2009, Clinical Neurophysiology.

[47]  Gert Pfurtscheller,et al.  Motor imagery and direct brain-computer communication , 2001, Proc. IEEE.

[48]  J. Cedarbaum,et al.  The ALSFRS-R: a revised ALS functional rating scale that incorporates assessments of respiratory function , 1999, Journal of the Neurological Sciences.

[49]  Cuntai Guan,et al.  Asynchronous P300-Based Brain--Computer Interfaces: A Computational Approach With Statistical Models , 2008, IEEE Transactions on Biomedical Engineering.

[50]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[51]  Klaus-Robert Müller,et al.  A large scale screening study with a SMR-based BCI: Categorization of BCI users and differences in their SMR activity , 2019, PloS one.

[52]  N. Ramsey,et al.  Towards human BCI applications based on cognitive brain systems: an investigation of neural signals recorded from the dorsolateral prefrontal cortex , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[53]  Chang-Hwan Im,et al.  Classification of binary intentions for individuals with impaired oculomotor function: 'eyes-closed' SSVEP-based brain-computer interface (BCI). , 2013, Journal of neural engineering.