Combining Brain–Computer Interfaces and Assistive Technologies: State-of-the-Art and Challenges

In recent years, new research has brought the field of electroencephalogram (EEG)-based brain–computer interfacing (BCI) out of its infancy and into a phase of relative maturity through many demonstrated prototypes such as brain-controlled wheelchairs, keyboards, and computer games. With this proof-of-concept phase in the past, the time is now ripe to focus on the development of practical BCI technologies that can be brought out of the lab and into real-world applications. In particular, we focus on the prospect of improving the lives of countless disabled individuals through a combination of BCI technology with existing assistive technologies (AT). In pursuit of more practical BCIs for use outside of the lab, in this paper, we identify four application areas where disabled individuals could greatly benefit from advancements in BCI technology, namely, “Communication and Control”, “Motor Substitution”, “Entertainment”, and “Motor Recovery”. We review the current state of the art and possible future developments, while discussing the main research issues in these four areas. In particular, we expect the most progress in the development of technologies such as hybrid BCI architectures, user–machine adaptation algorithms, the exploitation of users’ mental states for BCI reliability and confidence measures, the incorporation of principles in human–computer interaction (HCI) to improve BCI usability, and the development of novel BCI technology including better EEG devices.

[1]  Sascha Mahlke,et al.  Understanding users' experience of interaction , 2005 .

[2]  Gert Pfurtscheller,et al.  Self-paced exploration of the Austrian National Library through thought , 2007 .

[3]  C. Richards,et al.  Brain activity during visual versus kinesthetic imagery: An fMRI study , 2009, Human brain mapping.

[4]  N S Ward,et al.  Functional imaging in stroke. , 2002, Hospital medicine.

[5]  Subashan Perera,et al.  Persisting Consequences of Stroke Measured by the Stroke Impact Scale , 2002, Stroke.

[6]  Y Handa,et al.  Restoration of shoulder movement in quadriplegic and hemiplegic patients by functional electrical stimulation using percutaneous multiple electrodes. , 1999, The Tohoku journal of experimental medicine.

[7]  D. Landers,et al.  The effects of mental practice on motor skill learning and performance: A meta-analysis. , 1983 .

[8]  Klaus-Robert Müller,et al.  The non-invasive Berlin Brain–Computer Interface: Fast acquisition of effective performance in untrained subjects , 2007, NeuroImage.

[9]  Helge J. Ritter,et al.  2009 Special Issue: The MindGame: A P300-based brain-computer interface game , 2009 .

[10]  Anton Nijholt,et al.  BrainGain: BCI for HCI and Games , 2008 .

[11]  L. Lenchik Functional imaging , 2007, Annals of Biomedical Engineering.

[12]  Leonard J. Trejo,et al.  EEG-based Estimation of Cognitive Fatigue , 2005 .

[13]  Christa Neuper,et al.  Walking by Thinking: The Brainwaves Are Crucial, Not the Muscles! , 2006, PRESENCE: Teleoperators and Virtual Environments.

[14]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[15]  J. Wolpaw,et al.  A P300-based brain–computer interface for people with amyotrophic lateral sclerosis , 2008, Clinical Neurophysiology.

[16]  J. Baron,et al.  Motor Imagery: A Backdoor to the Motor System After Stroke? , 2006, Stroke.

[17]  Klaus-Robert Müller,et al.  Covariate Shift Adaptation by Importance Weighted Cross Validation , 2007, J. Mach. Learn. Res..

[18]  Nicole Krämer,et al.  Time Domain Parameters as a feature for EEG-based Brain-Computer Interfaces , 2009, Neural Networks.

[19]  Desney S. Tan,et al.  Brain-computer interfaces for hci and games , 2008, CHI Extended Abstracts.

[20]  K. Jellinger Toward Brain-Computer Interfacing , 2009 .

[21]  Gernot R. Müller-Putz,et al.  "Virtual keyboard" controlled by spontaneous EEG activity , 2001, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[23]  Xiaorong Gao,et al.  A BCI-based environmental controller for the motion-disabled. , 2003, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[24]  Abigail Sellen,et al.  Understanding photowork , 2006, CHI.

[25]  Dario Farina,et al.  Single-trial discrimination of type and speed of wrist movements from EEG recordings , 2009, Clinical Neurophysiology.

[26]  H. Seelen,et al.  Mental practice-based rehabilitation training to improve arm function and daily activity performance in stroke patients: a randomized clinical trial , 2008, BMC neurology.

[27]  Alois Schlögl,et al.  The Electroencephalogram and the Adaptive Autoregressive Model: Theory and Applications , 2000 .

[28]  Benjamin Blankertz,et al.  Designing for uncertain, asymmetric control: Interaction design for brain-computer interfaces , 2009, Int. J. Hum. Comput. Stud..

[29]  Ethan R. Buch,et al.  Think to Move: a Neuromagnetic Brain-Computer Interface (BCI) System for Chronic Stroke , 2008, Stroke.

[30]  P. Crago,et al.  Restoration of elbow extension via functional electrical stimulation in individuals with tetraplegia. , 2003, Journal of rehabilitation research and development.

[31]  R. Simpson Smart wheelchairs: A literature review. , 2005, Journal of rehabilitation research and development.

[32]  José del R. Millán,et al.  Brain-actuated interaction , 2004, Artif. Intell..

[33]  Andreas Schulze-Bonhage,et al.  Prediction of arm movement trajectories from ECoG-recordings in humans , 2008, Journal of Neuroscience Methods.

[34]  Ricardo Chavarriaga,et al.  Fast Recognition of Anticipation-Related Potentials , 2009, IEEE Transactions on Biomedical Engineering.

[35]  J.D. Bayliss,et al.  Use of the evoked potential P3 component for control in a virtual apartment , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[36]  José del R. Millán,et al.  Context-Based Filtering for Assisted Brain-Actuated Wheelchair Driving , 2007, Comput. Intell. Neurosci..

[37]  J. del R. Millán,et al.  Multimodal Fusion of Muscle and Brain Signals for a Hybrid-BCI , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[38]  R. Dickstein,et al.  Motor Imagery in Physical Therapist Practice , 2007, Physical Therapy.

[39]  Christian Laugier,et al.  Controlling a Wheelchair Indoors Using Thought , 2007, IEEE Intelligent Systems.

[40]  H. Flor,et al.  A spelling device for the paralysed , 1999, Nature.

[41]  P. London Injury , 1969, Definitions.

[42]  G.C. Burdea,et al.  Virtual reality-enhanced stroke rehabilitation , 2001, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[43]  Christa Neuper,et al.  Motor imagery and EEG-based control of spelling devices and neuroprostheses. , 2006, Progress in brain research.

[44]  José del R. Millán,et al.  Adaptive brain interfaces , 2003, Commun. ACM.

[45]  Kari Dunning,et al.  Activity-Based Electrical Stimulation Training in a Stroke Patient With Minimal Movement in the Paretic Upper Extremity , 2009, Neurorehabilitation and neural repair.

[46]  J. Wolpaw,et al.  Clinical Applications of Brain-Computer Interfaces: Current State and Future Prospects , 2009, IEEE Reviews in Biomedical Engineering.

[47]  D. Skuse Recovery , 2010, International psychiatry : bulletin of the Board of International Affairs of the Royal College of Psychiatrists.

[48]  Holly A. Yanco,et al.  Wheelesley: A Robotic Wheelchair System: Indoor Navigation and User Interface , 1998, Assistive Technology and Artificial Intelligence.

[49]  Rajesh P. N. Rao,et al.  Towards adaptive classification for BCI , 2006, Journal of neural engineering.

[50]  G. Alon,et al.  Functional Electrical Stimulation Enhancement of Upper Extremity Functional Recovery During Stroke Rehabilitation: A Pilot Study , 2007, Neurorehabilitation and neural repair.

[51]  J. Keller,et al.  Surgical rehabilitation of the upper limb in tetraplegia , 1981 .

[52]  S P Levine,et al.  Automatic adaptation in the NavChair Assistive Wheelchair Navigation System. , 1999, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[53]  Luis Maldonado Ramos,et al.  Alcalá de Henares , 2005 .

[54]  V. Hömberg,et al.  Reorganization of motor output in the non-affected hemisphere after stroke. , 1997, Brain : a journal of neurology.

[55]  M. Ferrarin,et al.  A pilot study of myoelectrically controlled FES of upper extremity , 2001, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[56]  Klaus-Robert Müller,et al.  Playing Pinball with non-invasive BCI , 2008, NIPS.

[57]  J. Guardia,et al.  Feature Extraction for Multi-class BCI using Canonical Variates Analysis , 2007, 2007 IEEE International Symposium on Intelligent Signal Processing.

[58]  P. Sajda,et al.  Cortically coupled computer vision for rapid image search , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[59]  Miguel A. L. Nicolelis,et al.  Actions from thoughts , 2001, Nature.

[60]  Wolfgang Rosenstiel,et al.  Control of an Internet Browser Using the P300 Event- Related Potential , 2008 .

[61]  P. Silva,et al.  ENOBIO dry electrophysiology electrode; first human trial plus wireless electrode system , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[62]  Wolfgang Rosenstiel,et al.  An MEG-based brain–computer interface (BCI) , 2007, NeuroImage.

[63]  José del R. Millán,et al.  Adaptation in Brain-Computer Interfaces , 2007 .

[64]  Eduardo Miranda,et al.  Brain-computer music interface for composition and performance , 2006 .

[65]  Tzyy-Ping Jung,et al.  A brain-machine interface using dry-contact, low-noise EEG sensors , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[66]  B. Blankertz,et al.  Unsupervised adaptation of the LDA classifier for Brain-Computer interfaces , 2008 .

[67]  Wolfgang Grodd,et al.  Principles of a brain-computer interface (BCI) based on real-time functional magnetic resonance imaging (fMRI) , 2004, IEEE Transactions on Biomedical Engineering.

[68]  K. Müller,et al.  Finding stationary subspaces in multivariate time series. , 2009, Physical review letters.

[69]  J. Baron,et al.  Motor imagery after stroke: Relating outcome to motor network connectivity , 2009, Annals of neurology.

[70]  T. A. Carpenter,et al.  Motor Imagery After Subcortical Stroke: A Functional Magnetic Resonance Imaging Study , 2009, Stroke.

[71]  R. Nudo Mechanisms for recovery of motor function following cortical damage , 2006, Current Opinion in Neurobiology.

[72]  Allan Kuchinsky,et al.  Requirements for photoware , 2002, CSCW '02.

[73]  Scott Tashman,et al.  Development Of A Hybrid Gait Orthosis: A Case Report , 2003, The journal of spinal cord medicine.

[74]  John Williamson,et al.  Continuous uncertain interaction , 2006 .

[75]  S. Page,et al.  Mental Practice in Chronic Stroke: Results of a Randomized, Placebo-Controlled Trial , 2007, Stroke.

[76]  Francisco Velasco-Álvarez,et al.  A two-class brain computer interface to freely navigate through virtual worlds / Ein Zwei-Klassen-Brain-Computer-Interface zur freien Navigation durch virtuelle Welten , 2009, Biomedizinische Technik. Biomedical engineering.

[77]  Girijesh Prasad,et al.  Using motor imagery based brain-computer interface for post-stroke rehabilitation , 2009, 2009 4th International IEEE/EMBS Conference on Neural Engineering.

[78]  S P Levine,et al.  The NavChair Assistive Wheelchair Navigation System. , 1999, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[79]  K H Mauritz,et al.  Multimodal EEG analysis in man suggests impairment-specific changes in movement-related electric brain activity after stroke. , 2000, Brain : a journal of neurology.

[80]  G. Mulgan Communication and Control , 2020, Families in Motion: Dynamics in Diverse Contexts.

[81]  J. P. Miller,et al.  Effect of constraint-induced movement therapy on upper extremity function 3 to 9 months after stroke: the EXCITE randomized clinical trial. , 2006, JAMA.

[82]  Ernest A. Edmonds,et al.  A study in play, pleasure and interaction design , 2007, DPPI.

[83]  Helmut Hoyer The OMNI wheelchair , 1995 .

[84]  Brendan Z. Allison,et al.  The Hybrid BCI , 2010, Frontiers in Neuroscience.

[85]  K. Anderson Targeting recovery: priorities of the spinal cord-injured population. , 2004, Journal of neurotrauma.

[86]  E. Fetz,et al.  Direct control of paralyzed muscles by cortical neurons , 2008, Nature.

[87]  A. Kübler,et al.  Training locked-in patients: a challenge for the use of brain-computer interfaces , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[88]  S. Adamovich,et al.  Sensorimotor Training in a Virtual Reality Environment: Does It Improve Functional Recovery Poststroke? , 2006, Neurorehabilitation and neural repair.

[89]  Klaus-Robert Müller,et al.  The Berlin Brain-Computer Interface (BBCI) – towards a new communication channel for online control in gaming applications , 2007, Multimedia Tools and Applications.

[90]  M. Lotze,et al.  Motor imagery , 2006, Journal of Physiology-Paris.

[91]  D J McFarland,et al.  Brain-computer interface research at the Wadsworth Center. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[92]  E Donchin,et al.  The mental prosthesis: assessing the speed of a P300-based brain-computer interface. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[93]  Keng Peng Tee,et al.  Learning EEG-based spectral-spatial patterns for attention level measurement , 2009, 2009 IEEE International Symposium on Circuits and Systems.

[94]  Emilio Bizzi,et al.  Virtual-Environment-Based Telerehabilitation in Patients with Stroke , 2005, Presence: Teleoperators & Virtual Environments.

[95]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[96]  J. Wyndaele,et al.  Incidence, prevalence and epidemiology of spinal cord injury: what learns a worldwide literature survey? , 2006, Spinal Cord.

[97]  Theresa M. Vaughan,et al.  A Novel Dry Electrode for Brain-Computer Interface , 2009, HCI.

[98]  F Babiloni,et al.  Linear classification of low-resolution EEG patterns produced by imagined hand movements. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[99]  Jdel.R. Millan,et al.  On the need for on-line learning in brain-computer interfaces , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[100]  Cuntai Guan,et al.  Unsupervised Brain Computer Interface Based on Intersubject Information and Online Adaptation , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[101]  N. Hogan,et al.  Robotic devices as therapeutic and diagnostic tools for stroke recovery. , 2009, Archives of neurology.

[102]  Y. Hara,et al.  Neurorehabilitation with new functional electrical stimulation for hemiparetic upper extremity in stroke patients. , 2008, Journal of Nippon Medical School = Nippon Ika Daigaku zasshi.

[103]  F. Cincotti,et al.  The use of EEG modifications due to motor imagery for brain-computer interfaces , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[104]  Axel Lankenau,et al.  Architecture and applications of the Bremen Autonomous Wheelchair , 2000, Inf. Sci..

[105]  A Kübler,et al.  A P 300-based brain-computer interface for people with amyotrophic lateral sclerosis , 2010 .

[106]  G. Exner,et al.  Der Arbeitskreis „Querschnittlähmungen“ des Hauptverbandes der gewerblichen Berufsgenossenschaften in Deutschland , 2004, Trauma und Berufskrankheit.

[107]  Spyros G. Tzafestas,et al.  The autonomous mobile robot SENARIO: a sensor aided intelligent navigation system for powered wheelchairs , 1997, IEEE Robotics Autom. Mag..

[108]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[109]  Yoshihiro Muraoka,et al.  A home-based rehabilitation program for the hemiplegic upper extremity by power-assisted functional electrical stimulation , 2008, Disability and rehabilitation.

[110]  A Berthoz,et al.  The role of inhibition in the hierarchical gating of executed and imagined movements. , 1996, Brain research. Cognitive brain research.

[111]  Erich E. Sutter,et al.  The brain response interface: communication through visually-induced electrical brain responses , 1992 .

[112]  Anton Nijholt,et al.  BCI for Games: A 'State of the Art' Survey , 2008, ICEC.

[113]  G. Pfurtscheller,et al.  EEG-based discrimination between imagination of right and left hand movement. , 1997, Electroencephalography and clinical neurophysiology.

[114]  P. Duncan Synthesis of Intervention Trials To Improve Motor Recovery following Stroke. , 1997, Topics in stroke rehabilitation.

[115]  G. Pfurtscheller,et al.  Imagery of motor actions: differential effects of kinesthetic and visual-motor mode of imagery in single-trial EEG. , 2005, Brain research. Cognitive brain research.

[116]  Iñaki Iturrate,et al.  Synchronous EEG brain-actuated wheelchair with automated navigation , 2009, 2009 IEEE International Conference on Robotics and Automation.

[117]  Weng Chang Effect of Constraint Induced-Movement Therapy on upper extremities function of stroke and head-injured patients , 2003 .

[118]  M. Nuttin,et al.  A brain-actuated wheelchair: Asynchronous and non-invasive Brain–computer interfaces for continuous control of robots , 2008, Clinical Neurophysiology.

[119]  S.A. Wills,et al.  DASHER-an efficient writing system for brain-computer interfaces? , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[120]  G. Pfurtscheller,et al.  Brain–Computer Communication: Motivation, Aim, and Impact of Exploring a Virtual Apartment , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[121]  G. Pfurtscheller,et al.  EEG-based neuroprosthesis control: A step towards clinical practice , 2005, Neuroscience Letters.

[122]  P. Bach-y-Rita,et al.  Evaluation of stroke rehabilitation by randomized controlled studies: a review , 1992, Acta neurologica Scandinavica.

[123]  M. Sams,et al.  Classification of single MEG trials related to left and right index finger movements , 2006, Clinical Neurophysiology.

[124]  Horst Bischof,et al.  Toward Self-Paced Brain–Computer Communication: Navigation Through Virtual Worlds , 2008, IEEE Transactions on Biomedical Engineering.

[125]  Reinhold Scherer,et al.  A fully on-line adaptive BCI , 2006, IEEE Transactions on Biomedical Engineering.

[126]  Christa Neuper,et al.  Sensorimotor EEG patterns during motor imagery in hemiparetic stroke patients , 2007 .

[127]  Richard S. J. Frackowiak,et al.  The functional anatomy of motor recovery after stroke in humans: A study with positron emission tomography , 1991, Annals of neurology.

[128]  Steven C Cramer,et al.  Functional imaging in stroke recovery. , 2004, Stroke.

[129]  G. Pfurtscheller,et al.  Brain-computer interfaces for control of neuroprostheses: from synchronous to asynchronous mode of operation. , 2006, Biomedizinische Technik. Biomedical engineering.

[130]  P. Langhorne,et al.  Motor recovery after stroke: a systematic review , 2009, The Lancet Neurology.

[131]  Gernot R. Müller-Putz,et al.  Self-Paced (Asynchronous) BCI Control of a Wheelchair in Virtual Environments: A Case Study with a Tetraplegic , 2007, Comput. Intell. Neurosci..

[132]  M. Keith,et al.  Indications and future directions for upper limb neuroprostheses in tetraplegic patients: a review. , 2002, Hand clinics.

[133]  L. Cohen,et al.  Brain–computer interface in paralysis , 2008, Current opinion in neurology.

[134]  G. Pfurtscheller,et al.  ‘Thought’ – control of functional electrical stimulation to restore hand grasp in a patient with tetraplegia , 2003, Neuroscience Letters.

[135]  T. Murphy,et al.  Plasticity during stroke recovery: from synapse to behaviour , 2009, Nature Reviews Neuroscience.

[136]  J. Liepert,et al.  Treatment-induced cortical reorganization after stroke in humans. , 2000, Stroke.

[137]  C. Richards,et al.  Clinical Assessment of Motor Imagery After Stroke , 2008, Neurorehabilitation and neural repair.

[138]  Rajesh P. N. Rao,et al.  Control of a humanoid robot by a noninvasive brain–computer interface in humans , 2008, Journal of neural engineering.

[139]  Jean-Claude Baron,et al.  Motor Imagery to Enhance Recovery After Subcortical Stroke: Who Might Benefit, Daily Dose, and Potential Effects , 2008, Neurorehabilitation and neural repair.

[140]  Soo-Young Lee,et al.  Brain–computer interface using fMRI: spatial navigation by thoughts , 2004, Neuroreport.

[141]  Peter Robinson,et al.  Simulation to predict performance of assistive interfaces , 2007, Assets '07.

[142]  José del R. Millán,et al.  Simultaneous Real-Time Detection of Motor Imagery and Error-Related Potentials for Improved BCI Accuracy , 2008 .

[143]  Paul C. Schutte,et al.  The H-Metaphor as a Guideline for Vehicle Automation and Interaction , 2005 .

[144]  Melanie Kleynen,et al.  Using mental practice in stroke rehabilitation: a framework , 2008, Clinical rehabilitation.

[145]  D. McFarland,et al.  An auditory brain–computer interface (BCI) , 2008, Journal of Neuroscience Methods.

[146]  Michitaka Hirose,et al.  Brain-Computer Interfaces, Virtual Reality, and Videogames , 2008, Computer.

[147]  J. Wolpaw,et al.  A P300 event-related potential brain–computer interface (BCI): The effects of matrix size and inter stimulus interval on performance , 2006, Biological Psychology.

[148]  José del R. Millán,et al.  The role of shared-control in BCI-based telepresence , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[149]  Hideaki Touyama Photo Data Retrieval via P300 Evoked Potentials , 2008, IEICE Trans. Inf. Syst..

[150]  John R. Smith,et al.  Steady-State VEP-Based Brain-Computer Interface Control in an Immersive 3D Gaming Environment , 2005, EURASIP J. Adv. Signal Process..

[151]  G Pfurtscheller,et al.  Self-initiation of EEG-based brain-computer communication using the heart rate response. , 2007, Journal of neural engineering.

[152]  D. Wade,et al.  The effects of mental practice in stroke rehabilitation: a systematic review. , 2006, Archives of physical medicine and rehabilitation.

[153]  Bruce H Dobkin,et al.  Training and exercise to drive poststroke recovery , 2008, Nature Clinical Practice Neurology.

[154]  Paolo Fiorini,et al.  A robotics wheelchair for crowded public environment , 2001, IEEE Robotics Autom. Mag..

[155]  M. Jeannerod,et al.  Mentally simulated movements in virtual reality: does Fitt's law hold in motor imagery? , 1995, Behavioural Brain Research.

[156]  M Goldfarb,et al.  Design of a controlled-brake orthosis for FES-aided gait. , 1996, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[157]  Vijay Kumar,et al.  Incorporating user inputs in motion planning for a smart wheelchair , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[158]  Tamara Broderick,et al.  Fast and Flexible Selection with a Single Switch , 2009, PloS one.

[159]  Gert Pfurtscheller,et al.  Motor imagery and direct brain-computer communication , 2001, Proc. IEEE.

[160]  L. Der-Yeghiaian,et al.  Robot-based hand motor therapy after stroke. , 2007, Brain : a journal of neurology.

[161]  Cuntai Guan,et al.  Temporal classification of multichannel near-infrared spectroscopy signals of motor imagery for developing a brain–computer interface , 2007, NeuroImage.

[162]  Shirley M Coyle,et al.  Brain–computer interface using a simplified functional near-infrared spectroscopy system , 2007, Journal of neural engineering.

[163]  Kerry Rodden,et al.  How do people manage their digital photographs? , 2003, CHI '03.

[164]  J. Wolpaw,et al.  Patients with ALS can use sensorimotor rhythms to operate a brain-computer interface , 2005, Neurology.

[165]  Mark E. Dohring,et al.  Feasibility of a New Application of Noninvasive Brain Computer Interface (BCI): A Case Study of Training for Recovery of Volitional Motor Control After Stroke , 2009, Journal of neurologic physical therapy : JNPT.

[166]  E. Moberg,et al.  Surgical Rehabilitation of the Upper Limb in Tetraplegia , 1980, Paraplegia.

[167]  G. R. Muller,et al.  Brain oscillations control hand orthosis in a tetraplegic , 2000, Neuroscience Letters.

[168]  D. Koshland Frontiers in neuroscience. , 1988, Science.

[169]  Amr Kamel,et al.  Health Related Quality of Life in Stroke Survivors Measured by the Stroke Impact Scale , 2010 .

[170]  Christa Neuper,et al.  An asynchronously controlled EEG-based virtual keyboard: improvement of the spelling rate , 2004, IEEE Transactions on Biomedical Engineering.

[171]  G Pfurtscheller,et al.  Toward a hybrid brain–computer interface based on imagined movement and visual attention , 2010, Journal of neural engineering.

[172]  Robert Leeb,et al.  Towards natural non-invasive hand neuroprostheses for daily living , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[173]  Marcia J. Bates,et al.  The design of browsing and berrypicking techniques for the online search interface , 1989 .

[174]  B. Bussel,et al.  Longitudinal Study of Motor Recovery After Stroke: Recruitment and Focusing of Brain Activation , 2002, Stroke.

[175]  B. Dobkin Neurobiology of Rehabilitation , 2004, Annals of the New York Academy of Sciences.

[176]  G. Pfurtscheller,et al.  How many people are able to operate an EEG-based brain-computer interface (BCI)? , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[177]  P. Duncan,et al.  Measurement of Motor Recovery After Stroke: Outcome Assessment and Sample Size Requirements , 1992, Stroke.

[178]  Y. Agostini,et al.  The Vahm Robotized Wheelchair: System Architecture and Human-Machine Interaction , 1998, J. Intell. Robotic Syst..

[179]  Klaus-Robert Müller,et al.  Toward noninvasive brain-computer interfaces , 2006, IEEE Signal Process. Mag..

[180]  Karolien Poels,et al.  Measuring the experience of digital game enjoyment , 2008 .

[181]  V. A. Konyshev,et al.  A P300-based brain—computer interface , 2007, Meditsinskaia tekhnika.

[182]  A. Buttfield,et al.  Towards a robust BCI: error potentials and online learning , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[183]  Nicolas Marmaras,et al.  Proceedings of the 2005 annual conference on European association of cognitive ergonomics , 2005 .

[184]  M. Nuttin,et al.  Asynchronous non-invasive brain-actuated control of an intelligent wheelchair , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[185]  Robert C. Wagenaar,et al.  Therapy Impact on Functional Recovery in Stroke Rehabilitation , 1999 .

[186]  José del R. Millán,et al.  Improving Human Performance in a Real Operating Environment through Real-Time Mental Workload Detection , 2007 .

[187]  M. Levin,et al.  Systematic Review of the Evidence Does Provision of Extrinsic Feedback Result in Improved Motor Learning in the Upper Limb Poststroke ? , 2009 .

[188]  P. Tonin,et al.  P300-Based Brain–Computer Interface Communication: Evaluation and Follow-up in Amyotrophic Lateral Sclerosis , 2009, Front. Neuropro..

[189]  N. Tractinsky,et al.  What is beautiful is usable , 2000, Interact. Comput..

[190]  A. Karim,et al.  Neural Internet: Web Surfing with Brain Potentials for the Completely Paralyzed , 2006, Neurorehabilitation and neural repair.

[191]  J. Schaechter Motor rehabilitation and brain plasticity after hemiparetic stroke , 2004, Progress in Neurobiology.

[192]  José del R. Millán,et al.  Error-Related EEG Potentials Generated During Simulated Brain–Computer Interaction , 2008, IEEE Transactions on Biomedical Engineering.

[193]  J. Decety,et al.  Neural mechanisms subserving the perception of human actions , 1999, Trends in Cognitive Sciences.

[194]  José del R. Millán,et al.  Brain-Computer Interfaces , 2020, Handbook of Clinical Neurology.

[195]  G. Pfurtscheller,et al.  Enhancement of left-right sensorimotor EEG differences during feedback-regulated motor imagery. , 1999, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[196]  José del R. Millán,et al.  Towards Brain-Computer Interfacing , 2007 .

[197]  Cuntai Guan,et al.  A clinical study of motor imagery-based brain-computer interface for upper limb robotic rehabilitation , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[198]  Ingrid Wickelgren,et al.  Tapping the Mind , 2003, Science.

[199]  José del R. Millán,et al.  You Are Wrong! - Automatic Detection of Interaction Errors from Brain Waves , 2005, IJCAI.

[200]  L. Cohen,et al.  Mechanisms underlying recovery of motor function after stroke , 2005, Postgraduate Medical Journal.

[201]  Cuntai Guan,et al.  Time-Variant Spatial Filtering for Motor Imagery Classification , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[202]  Wolfgang Rosenstiel,et al.  Nessi: An EEG-Controlled Web Browser for Severely Paralyzed Patients , 2007, Comput. Intell. Neurosci..

[203]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[204]  Monica A. Perez,et al.  Neural interface technology for rehabilitation: exploiting and promoting neuroplasticity. , 2010, Physical medicine and rehabilitation clinics of North America.

[205]  J. Wolpaw,et al.  Brain–computer interfaces in neurological rehabilitation , 2008, The Lancet Neurology.

[206]  Maarten Joost IJzerman,et al.  The NESS handmaster orthosis: restoration of hand function in C5 and stroke patients by means of electrical stimulation , 1996 .

[207]  José del R. Millán,et al.  Noninvasive brain-actuated control of a mobile robot by human EEG , 2004, IEEE Transactions on Biomedical Engineering.

[208]  Jukka Heikkonen,et al.  A local neural classifier for the recognition of EEG patterns associated to mental tasks , 2002, IEEE Trans. Neural Networks.

[209]  Brendan Z. Allison,et al.  Improved signal processing approaches in an offline simulation of a hybrid brain–computer interface , 2010, Journal of Neuroscience Methods.

[210]  Gerwin Schalk,et al.  A brain–computer interface using electrocorticographic signals in humans , 2004, Journal of neural engineering.

[211]  V. Dietz,et al.  Transcutaneous functional electrical stimulation for grasping in subjects with cervical spinal cord injury , 2005, Spinal Cord.

[212]  Robert Leeb,et al.  On the road to a neuroprosthetic hand: A novel hand grasp orthosis based on functional electrical stimulation , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[213]  K.-R. Muller,et al.  Boosting bit rates and error detection for the classification of fast-paced motor commands based on single-trial EEG analysis , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[214]  Benjamin Blankertz,et al.  Towards a Cure for BCI Illiteracy , 2009, Brain Topography.

[215]  Jonathan R Wolpaw,et al.  Brain–computer interface systems: progress and prospects , 2007, Expert review of medical devices.

[216]  M. Jeannerod,et al.  Mental imaging of motor activity in humans , 1999, Current Opinion in Neurobiology.

[217]  Ingeborg Krägeloh-Mann,et al.  Coherent corticomuscular oscillations originate from primary motor cortex: Evidence from patients with early brain lesions , 2006, Human brain mapping.

[218]  J. Blumberg,et al.  Adaptive Classification for Brain Computer Interfaces , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[219]  K. Müller,et al.  Single Trial Classification of Motor Imagination Using 6 Dry EEG Electrodes , 2007, PloS one.