A BCI-Based Environmental Control System for Patients With Severe Spinal Cord Injuries

Objective: This study proposes an event-related potential (ERP) brain-computer interface (BCI)-based environmental control system that integrates household electrical appliances, a nursing bed, and an intelligent wheelchair to provide daily assistance to paralyzed patients with severe spinal cord injuries (SCIs). Methods: An asynchronous mode is used to switch the environmental control system on or off or to select a device (e.g., a TV) for achieving self-paced control. In the asynchronous mode, we introduce several pseudo-keys and a verification mechanism to effectively reduce the false operation rate. By contrast, when the user selects a function of the device (e.g., a TV channel), a synchronous mode is used to improve the accuracy and speed of BCI detection. Two experiments involving six SCI patients were conducted separately in a nursing bed and a wheelchair, and the patients were instructed to control the nursing bed, the wheelchair, and household electrical appliances (an electric light, an air conditioner, and a TV). Results: The average false rate of BCI commands in the control state was 10.4%, whereas the average false operation ratio was 4.9% (a false BCI command might not necessarily results in a false operation according to our system design). During the idle state, there was an average of 0.97 false positives/min, which did not result in any false operations. Conclusion: All SCI patients could use the proposed ERP BCI-based environmental control system satisfactorily. Significance: The proposed ERP-based environmental control system could be used to assist patients with severe SCIs in their daily lives.

[1]  Yuanqing Li,et al.  Control of a Wheelchair in an Indoor Environment Based on a Brain–Computer Interface and Automated Navigation , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[2]  E Donchin,et al.  Brain-computer interface technology: a review of the first international meeting. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[3]  Febo Cincotti,et al.  Asynchronous P300-Based Brain-Computer Interface to Control a Virtual Environment: Initial Tests on End Users , 2011, Clinical EEG and neuroscience.

[4]  Febo Cincotti,et al.  Asynchronous gaze-independent event-related potential-based brain-computer interface , 2013, Artif. Intell. Medicine.

[5]  Yuanqing Li,et al.  A Hybrid Brain Computer Interface to Control the Direction and Speed of a Simulated or Real Wheelchair , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[6]  Feng Li,et al.  Discrimination Between Control and Idle States in Asynchronous SSVEP-Based Brain Switches: A Pseudo-Key-Based Approach , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  Yili Liu,et al.  EEG-Based Brain-Controlled Mobile Robots: A Survey , 2013, IEEE Transactions on Human-Machine Systems.

[8]  Tobias Kaufmann,et al.  Comparison of tactile, auditory, and visual modality for brain-computer interface use: a case study with a patient in the locked-in state , 2013, Front. Neurosci..

[9]  Cuntai Guan,et al.  Asynchronous P300-Based Brain--Computer Interfaces: A Computational Approach With Statistical Models , 2008, IEEE Transactions on Biomedical Engineering.

[10]  Yuanqing Li,et al.  Surfing the internet with a BCI mouse , 2012, Journal of neural engineering.

[11]  Po-Lei Lee,et al.  Development of a Low-Cost FPGA-Based SSVEP BCI Multimedia Control System , 2010, IEEE Transactions on Biomedical Circuits and Systems.

[12]  Po-Lei Lee,et al.  Total Design of an FPGA-Based Brain–Computer Interface Control Hospital Bed Nursing System , 2013, IEEE Transactions on Industrial Electronics.

[13]  F Cincotti,et al.  Workload measurement in a communication application operated through a P300-based brain–computer interface , 2011, Journal of neural engineering.

[14]  P. Harris.  The International Standards Booklet for Neurological and Functional Classification of Spinal Cord Injury , 1994, Paraplegia.

[15]  Tomasz M. Rutkowski,et al.  Tactile and bone-conduction auditory brain computer interface for vision and hearing impaired users , 2014, Journal of Neuroscience Methods.

[16]  W. Miller,et al.  Fatigue and spinal cord injury: a qualitative analysis , 2009, Spinal Cord.

[17]  Alain Rakotomamonjy,et al.  BCI Competition III: Dataset II- Ensemble of SVMs for BCI P300 Speller , 2008, IEEE Transactions on Biomedical Engineering.

[18]  Brice Rebsamen,et al.  A brain controlled wheelchair to navigate in familiar environments. , 2010, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[19]  José del R. Millán,et al.  Brain-Controlled Wheelchairs: A Robotic Architecture , 2013, IEEE Robotics & Automation Magazine.

[20]  Stefan Haufe,et al.  Optimizing event-related potential based brain-computer interfaces: a systematic evaluation of dynamic stopping methods. , 2013, Journal of neural engineering.

[21]  A. Lenhardt,et al.  An Adaptive P300-Based Online Brain–Computer Interface , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  L. Cohen,et al.  Brain–computer interface in paralysis , 2008, Current opinion in neurology.

[23]  Bin He,et al.  Noninvasive Brain-Computer Interfaces Based on Sensorimotor Rhythms , 2015, Proceedings of the IEEE.

[24]  Yuanqing Li,et al.  A Hybrid BCI System Combining P300 and SSVEP and Its Application to Wheelchair Control , 2013, IEEE Transactions on Biomedical Engineering.

[25]  José del R. Millán,et al.  Towards Independence: A BCI Telepresence Robot for People With Severe Motor Disabilities , 2015, Proceedings of the IEEE.

[26]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[27]  Touradj Ebrahimi,et al.  An efficient P300-based brain–computer interface for disabled subjects , 2008, Journal of Neuroscience Methods.

[28]  Chin-Teng Lin,et al.  Brain Computer Interface-Based Smart Living Environmental Auto-Adjustment Control System in UPnP Home Networking , 2014, IEEE Systems Journal.

[29]  Cuntai Guan,et al.  High performance P300 speller for brain-computer interface , 2004, IEEE International Workshop on Biomedical Circuits and Systems, 2004..

[30]  Motoaki Kawanabe,et al.  A waypoint-based framework in brain-controlled smart home environments: Brain interfaces, domotics, and robotics integration , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  E. Sellers,et al.  How many people are able to control a P300-based brain–computer interface (BCI)? , 2009, Neuroscience Letters.

[32]  Iñaki Iturrate,et al.  A Noninvasive Brain-Actuated Wheelchair Based on a P300 Neurophysiological Protocol and Automated Navigation , 2009, IEEE Transactions on Robotics.

[33]  Jonathan R. Wolpaw,et al.  Brain-computer interfaces (BCIs) for communication and control , 2007, Assets '07.

[34]  Yuanqing Li,et al.  An EEG-Based BCI System for 2-D Cursor Control by Combining Mu/Beta Rhythm and P300 Potential , 2010, IEEE Transactions on Biomedical Engineering.

[35]  Klaus-Robert Müller,et al.  Motor Imagery for Severely Motor-Impaired Patients: Evidence for Brain-Computer Interfacing as Superior Control Solution , 2014, PloS one.

[36]  B. Blankertz,et al.  (C)overt attention and visual speller design in an ERP-based brain-computer interface , 2010, Behavioral and Brain Functions.

[37]  J. Polich,et al.  On P300 measurement stability: habituation, intra-trial block variation, and ultradian rhythms , 1999, Biological Psychology.

[38]  Xingyu Wang,et al.  An ERP-Based BCI using an oddball Paradigm with Different Faces and Reduced errors in Critical Functions , 2014, Int. J. Neural Syst..

[39]  J. Wolpaw,et al.  Does the ‘P300’ speller depend on eye gaze? , 2010, Journal of neural engineering.

[40]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[41]  Wei Wu,et al.  Multimodal BCIs: Target Detection, Multidimensional Control, and Awareness Evaluation in Patients With Disorder of Consciousness , 2016, Proceedings of the IEEE.

[42]  F Babiloni,et al.  P300-based brain–computer interface for environmental control: an asynchronous approach , 2011, Journal of neural engineering.

[43]  Rebeca Corralejo,et al.  A P300-based brain–computer interface aimed at operating electronic devices at home for severely disabled people , 2014, Medical & Biological Engineering & Computing.

[44]  Eloisa Vargiu,et al.  Brain–Computer Interfaces on Track to Home: Results of the Evaluation at Disabled End-Users’ Homes and Lessons Learnt , 2015, Front. ICT.