Brain–Computer Interface—FES Integration: Towards a Hands‐free Neuroprosthesis Command System

This paper presents a critical review of brain–computer interfaces (BCIs) and their potential for neuroprosthetic applications. Summaries are provided for the command interface requirements of hand grasp, multijoint, and lower extremity neuroprostheses, and the characteristics of various BCIs are discussed in relation to these requirements. The review highlights the current limitations of BCIs and areas of research that need to be addressed to enhance BCI—FES integration.

[1]  Erich E. Sutter,et al.  The brain response interface: communication through visually-induced electrical brain responses , 1992 .

[2]  R Kobetic,et al.  Effects of stimulated hip extension moment and position on upper-limb support forces during FNS-induced standing--a technical note. , 2001, Journal of rehabilitation research and development.

[3]  M J Mulcahey,et al.  Development of an upper extremity FES system for individuals with C4 tetraplegia. , 1996, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[4]  Yvonne Tran,et al.  The mind switch environmental control system: Remote hands free control for the severely disabled , 2002 .

[5]  L. Vigon,et al.  Quantitative evaluation of techniques for ocular artefact filtering of EEG waveforms , 2000 .

[6]  E Donchin,et al.  Brain-computer interface technology: a review of the first international meeting. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[7]  D J McFarland,et al.  Brain-computer interface research at the Wadsworth Center. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[8]  G. Pfurtscheller,et al.  Event-related synchronization (ERS) in the alpha band--an electrophysiological correlate of cortical idling: a review. , 1996, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[9]  G. R. Muller,et al.  Brain oscillations control hand orthosis in a tetraplegic , 2000, Neuroscience Letters.

[10]  A. Searle,et al.  EEG-based system for rapid on-off switching without prior learning , 1997, Medical and Biological Engineering and Computing.

[11]  G. Holmes.  Event-Related Desynchronization. Handbook of Electroencephalography and Clinical Neurophysiology, Revised Series, Volume 6 Edited by G. Pfurtscheller and F.H. Lopes da Silva. Elsevier Science B.V., Amsterdam, 1999, 406 pp., $236.00 , 2002, Epilepsy Research.

[12]  R Y Flynn,et al.  The use of bilateral stimulated hand grasp in the bimanual activities of persons with tetraplegia. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[13]  J. Karnes,et al.  Continuous therapeutic ultrasound accelerates repair of contraction-induced skeletal muscle damage in rats. , 2002, Archives of physical medicine and rehabilitation.

[14]  H. Flor,et al.  A spelling device for the paralysed , 1999, Nature.

[15]  N. Hoshimiya,et al.  A multichannel FES system for the restoration of motor functions in high spinal cord injury patients: a respiration-controlled system for multijoint upper extremity , 1989, IEEE Transactions on Biomedical Engineering.

[16]  Maude H. Malick.  Upper limb orthotics , 1992 .

[17]  M. Scherer,et al.  Neuroprosthesis consumers' forum: consumer priorities for research directions. , 2001, Journal of rehabilitation research and development.

[18]  Ashley Craig,et al.  Living with spinal cord injury: longitudinal factors, interventions and outcomes , 1998 .

[19]  Jerald D. Kralik,et al.  Real-time prediction of hand trajectory by ensembles of cortical neurons in primates , 2000, Nature.

[20]  R. Barry,et al.  Removal of ocular artifact from the EEG: a review , 2000, Neurophysiologie Clinique/Clinical Neurophysiology.

[21]  G. Pfurtscheller,et al.  Foot and hand area mu rhythms. , 1997, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[22]  P H Peckham,et al.  Reduction of Costs of Disability Using Neuroprostheses , 2000, Assistive technology : the official journal of RESNA.

[23]  E. Donchin,et al.  EEG-based communication: prospects and problems. , 1996, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[24]  N. Hoshimiya,et al.  An approach to a muscle model with a stimulus frequency-force relationship for FES applications. , 1999, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[25]  P. Peckham,et al.  Evaluation of shoulder movement as a command control source , 1990, IEEE Transactions on Biomedical Engineering.

[26]  R. L. Calhoun,et al.  EEG-Based Control: Neurologic Mechanisms of Steady-State Self-Regulation. , 1997 .

[27]  R. Triolo,et al.  Preliminary performance of a surgically implanted neuroprosthesis for standing and transfers--where do we stand? , 2001, Journal of rehabilitation research and development.

[28]  A. Kralj,et al.  Functional Electrical Stimulation: Standing and Walking after Spinal Cord Injury , 1989 .

[29]  E. A. Stolz,et al.  Multivariate Autoregressive Models for Classification of Spontaneous Electroencephalogram During Mental Tasks1 , 1998 .

[30]  R. H. Nathan,et al.  An FNS-based system for generating upper limb function in the C4 quadriplegic , 1989, Medical and Biological Engineering and Computing.

[31]  H. Flor,et al.  The thought translation device (TTD) for completely paralyzed patients. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[32]  P H Peckham,et al.  Applications of cortical signals to neuroprosthetic control: a critical review. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[33]  A. Craig,et al.  The effectiveness of a hands-free environmental control system for the profoundly disabled. , 2002, Archives of physical medicine and rehabilitation.

[34]  E. B. Marsolais,et al.  Control of functional neuromuscular stimulation systems for standing and locomotion in paraplegics , 1988, Proc. IEEE.

[35]  A Kostov,et al.  Parallel man-machine training in development of EEG-based cursor control. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[36]  M. Popovic,et al.  Clinical evaluation of the bionic glove. , 1999, Archives of physical medicine and rehabilitation.

[37]  J R Wolpaw,et al.  EEG-based communication and control: short-term role of feedback. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[38]  P R Kennedy,et al.  Direct control of a computer from the human central nervous system. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[39]  C A Grimbergen,et al.  High-quality recording of bioelectric events , 1991, Medical and Biological Engineering and Computing.

[40]  J. Wolpaw,et al.  Multichannel EEG-based brain-computer communication. , 1994, Electroencephalography and clinical neurophysiology.

[41]  E. Marsolais,et al.  Implanted functional electrical stimulation system for mobility in paraplegia: a follow-up case report. , 1999, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[42]  M R Popovic,et al.  Surface-stimulation technology for grasping and walking neuroprosthesis. , 2001, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[43]  G. Pfurtscheller,et al.  ERD and ERS in voluntary movement of different limbs , 1999 .

[44]  J. Middleton,et al.  Levels of brain wave activity (8–13 Hz) in persons with spinal cord injury , 2004, Spinal Cord.

[45]  P H Peckham,et al.  EEG-based control of a hand grasp neuroprosthesis. , 1999, Neuroreport.

[46]  Christa Neuper,et al.  Motor imagery and ERD , 1999 .

[47]  P. Kennedy,et al.  Restoration of neural output from a paralyzed patient by a direct brain connection , 1998, Neuroreport.

[48]  M. Ichie,et al.  Current Status and Future Prospects for Upper and Lower Extremity Motor System Neuroprostheses , 2001, Neuromodulation : journal of the International Neuromodulation Society.

[49]  Gary E. Birch,et al.  A brain-controlled switch for asynchronous control applications , 2000, IEEE Trans. Biomed. Eng..

[50]  Gert Pfurtscheller,et al.  Motor imagery and direct brain-computer communication , 2001, Proc. IEEE.

[51]  M van de Velde,et al.  Detection of muscle artefact in the normal human awake EEG. , 1998, Electroencephalography and clinical neurophysiology.

[52]  P. H. Peckham,et al.  An Implanted Upper-Extremity Neuroprosthesis. Follow-up of Five Patients* , 1997, The Journal of bone and joint surgery. American volume.

[53]  R. Nathan,et al.  The influence of stimulation pulse frequency on the generation of joint moments in the upper limb , 1990, IEEE Transactions on Biomedical Engineering.

[54]  A. Barriskill,et al.  Development of functional electrical stimulators utilizing cochlear implant technology. , 2001, Medical engineering & physics.

[55]  G Pfurtscheller,et al.  Current trends in Graz Brain-Computer Interface (BCI) research. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[56]  R. Nathan,et al.  Upper limb functions regained in quadriplegia: a hybrid computerized neuromuscular stimulation system. , 1990, Archives of physical medicine and rehabilitation.

[57]  L Kirkup,et al.  Three methods compared for detecting the onset of alpha wave synchronization following eye closure , 1998, Physiological measurement.

[58]  P H Peckham,et al.  Functional neuromuscular stimulation for combined control of elbow extension and hand grasp in C5 and C6 quadriplegics. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[59]  R. Brissot,et al.  Restoration of gait by functional electrical stimulation for spinal cord injured patients , 1995, Paraplegia.

[60]  Kath M. Bogie,et al.  Lower extremity applications of functional neuromuscular stimulation after spinal cord injury , 1999 .

[61]  A. Craig,et al.  Alpha wave reactivity following eye closure: a potential method of remote hands free control for the disabled , 1999 .

[62]  Nick Donaldson,et al.  Neuroprostheses for leg function after spinal-cord injury , 1997, The Lancet.

[63]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[64]  Lüder Deecke,et al.  Cerebral potentials preceding voluntary toe, knee and hip movements and their vectors in human precentral gyrus , 1986, Brain Research.

[65]  M J Stokes,et al.  EEG-based communication: a pattern recognition approach. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[66]  S P Levine,et al.  A direct brain interface based on event-related potentials. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[67]  L. Kirkup,et al.  Control of a hand grasp neuroprosthesis using an electroencephalogram-triggered switch: Demonstration of improvements in performance using wavepacket analysis , 2002, Medical and Biological Engineering and Computing.

[68]  T R Scott,et al.  Command and Control Interfaces for Advanced Neuroprosthetic Applications , 2001, Neuromodulation : journal of the International Neuromodulation Society.

[69]  Xiaorong Gao,et al.  Design and implementation of a brain-computer interface with high transfer rates , 2002, IEEE Transactions on Biomedical Engineering.

[70]  F Babiloni,et al.  Linear classification of low-resolution EEG patterns produced by imagined hand movements. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[71]  S. Meagher.  Instant neural control of a movement signal , 2002 .

[72]  T Allison,et al.  Localization of functional regions of human mesial cortex by somatosensory evoked potential recording and by cortical stimulation. , 1996, Electroencephalography and clinical neurophysiology.

[73]  G Calhoun,et al.  Brain-computer interfaces based on the steady-state visual-evoked response. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[74]  C.W. Anderson,et al.  Multivariate autoregressive models for classification of spontaneous electroencephalographic signals during mental tasks , 1998, IEEE Transactions on Biomedical Engineering.