Current trends in hardware and software for brain–computer interfaces (BCIs)

A brain-computer interface (BCI) provides a non-muscular communication channel to people with and without disabilities. BCI devices consist of hardware and software. BCI hardware records signals from the brain, either invasively or non-invasively, using a series of device components. BCI software then translates these signals into device output commands and provides feedback. One may categorize different types of BCI applications into the following four categories: basic research, clinical/translational research, consumer products, and emerging applications. These four categories use BCI hardware and software, but have different sets of requirements. For example, while basic research needs to explore a wide range of system configurations, and thus requires a wide range of hardware and software capabilities, applications in the other three categories may be designed for relatively narrow purposes and thus may only need a very limited subset of capabilities. This paper summarizes technical aspects for each of these four categories of BCI applications. The results indicate that BCI technology is in transition from isolated demonstrations to systematic research and commercial development. This process requires several multidisciplinary efforts, including the development of better integrated and more robust BCI hardware and software, the definition of standardized interfaces, and the development of certification, dissemination and reimbursement procedures.

[1]  Gerwin Schalk,et al.  A Practical Guide to Brain–Computer Interfacing with BCI2000: General-Purpose Software for Brain-Computer Interface Research, Data Acquisition, Stimulus Presentation, and Brain Monitoring , 2010 .

[2]  D.J. McFarland,et al.  The wadsworth BCI research and development program: at home with BCI , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  Gerwin Schalk,et al.  Brain–Computer Interfaces , 2010 .

[4]  Thorsten O. Zander,et al.  Detecting affective covert user states with passive brain-computer interfaces , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[5]  Vincent J Monastra,et al.  Electroencephalographic Biofeedback in the Treatment of Attention-Deficit/Hyperactivity Disorder , 2005, Applied psychophysiology and biofeedback.

[6]  G. Pfurtscheller,et al.  Design of an EEG-based Brain-Computer Interface (BCI) from Standard Components running in Real-time under Windows - Entwurf eines EEG-basierten Brain-Computer Interfaces (BCI) mit Standardkomponenten, das unter Windows in Echtzeit arbeitet , 1999, Biomedizinische Technik. Biomedical engineering.

[7]  John D E Gabrieli,et al.  Control over brain activation and pain learned by using real-time functional MRI. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[8]  G. Pfurtscheller,et al.  Graz-BCI: state of the art and clinical applications , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[9]  André van Schaik,et al.  A new EEG recording system for passive dry electrodes , 2010, Clinical Neurophysiology.

[10]  Lucia Rita Quitadamo,et al.  A UML model for the description of different brain-computer interface systems , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[11]  Adam Wilson,et al.  A Procedure for Measuring Latencies in Brain–Computer Interfaces , 2010, IEEE Transactions on Biomedical Engineering.

[12]  Shirley M Coyle,et al.  Brain–computer interface using a simplified functional near-infrared spectroscopy system , 2007, Journal of neural engineering.

[13]  J. Wolpaw,et al.  Patients with ALS can use sensorimotor rhythms to operate a brain-computer interface , 2005, Neurology.

[14]  Mark E. Dohring,et al.  Feasibility of a New Application of Noninvasive Brain Computer Interface (BCI): A Case Study of Training for Recovery of Volitional Motor Control After Stroke , 2009, Journal of neurologic physical therapy : JNPT.

[15]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[16]  G Gregory Raab,et al.  From medical invention to clinical practice: the reimbursement challenge facing new device procedures and technology--part 2: coverage. , 2006, Journal of the American College of Radiology : JACR.

[17]  T. Egner,et al.  Foundation and Practice of Neurofeedback for the Treatment of Epilepsy , 2006, Applied psychophysiology and biofeedback.

[18]  James G. Yusko Medical Device Safety: The Regulation of Medical Devices for Public Health and Safety , 2002 .

[19]  E. Donchin,et al.  Brain-computer interface research at the university of south Florida cognitive psychophysiology laboratory: the P300 speller , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[20]  Päivi Majaranta,et al.  Twenty years of eye typing: systems and design issues , 2002, ETRA.

[21]  Jonathan R Wolpaw,et al.  A brain-computer interface for long-term independent home use , 2010, Amyotrophic lateral sclerosis : official publication of the World Federation of Neurology Research Group on Motor Neuron Diseases.

[22]  G. Oriolo,et al.  Non-invasive brain–computer interface system: Towards its application as assistive technology , 2008, Brain Research Bulletin.

[23]  Lucia Rita Quitadamo,et al.  Introducing NPXLab 2010: A tool for the analysis and optimization of P300 based brain-computer interfaces , 2009, 2009 2nd International Symposium on Applied Sciences in Biomedical and Communication Technologies.

[24]  Boris Reuderink,et al.  Games and Brain-Computer Interfaces: The State of the Art , 2008 .

[25]  U. Strehl,et al.  Neurofeedback and Epilepsy , 2011 .

[26]  Theodore W. Berger,et al.  Toward replacement parts for the brain : implantable biomimetic electronics as neural prostheses , 2005 .

[27]  F. Cincotti,et al.  BCI meeting 2005-workshop on technology: hardware and software , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[28]  G. Tassey Standardization in technology-based markets , 2000 .

[29]  Brian Y. Hwang,et al.  Brain-computer interfaces: military, neurosurgical, and ethical perspective. , 2010, Neurosurgical focus.

[30]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[31]  G. Higson Medical Device Safety , 2002 .

[32]  J. Wolpaw,et al.  Clinical Applications of Brain-Computer Interfaces: Current State and Future Prospects , 2009, IEEE Reviews in Biomedical Engineering.

[33]  K. Müller,et al.  Single Trial Classification of Motor Imagination Using 6 Dry EEG Electrodes , 2007, PloS one.

[34]  J. Kounios,et al.  EEG Neurofeedback: A Brief Overview and an Example of Peak Alpha Frequency Training for Cognitive Enhancement in the Elderly , 2007, The Clinical neuropsychologist.

[35]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[36]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[37]  D J McFarland,et al.  An EEG-based brain-computer interface for cursor control. , 1991, Electroencephalography and clinical neurophysiology.

[38]  G. Tassey The Economics of R&D Policy , 1997 .

[39]  H. Lüders,et al.  American Electroencephalographic Society Guidelines for Standard Electrode Position Nomenclature , 1991, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[40]  Gerwin Schalk,et al.  A brain–computer interface using electrocorticographic signals in humans , 2004, Journal of neural engineering.

[41]  E. Fetz Operant Conditioning of Cortical Unit Activity , 1969, Science.

[42]  H. Flor,et al.  A spelling device for the paralysed , 1999, Nature.

[43]  A. Walker Electroencephalography, Basic Principles, Clinical Applications and Related Fields , 1982 .

[44]  Guillaume Gibert,et al.  OpenViBE: An Open-Source Software Platform to Design, Test, and Use BrainComputer Interfaces in Real and Virtual Environments , 2010, PRESENCE: Teleoperators and Virtual Environments.

[45]  Cuntai Guan,et al.  Clinical study of neurorehabilitation in stroke using EEG-based motor imagery brain-computer interface with robotic feedback , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[46]  W. A. Sarnacki,et al.  Electroencephalographic (EEG) control of three-dimensional movement , 2010, Journal of neural engineering.

[47]  G.E. Birch,et al.  A general framework for brain-computer interface design , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[48]  Nathan E. Crone,et al.  Subdural electrodes , 2010, Clinical Neurophysiology.

[49]  J J Vidal,et al.  Toward direct brain-computer communication. , 1973, Annual review of biophysics and bioengineering.

[50]  H. Berger Über das Elektrenkephalogramm des Menschen , 1929, Archiv für Psychiatrie und Nervenkrankheiten.

[51]  Tzyy-Ping Jung,et al.  A brain-machine interface using dry-contact, low-noise EEG sensors , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[52]  Theodore W. Berger,et al.  International Assessment of Research and Development in Brain-Computer Interfaces. WTEC Panel Report , 2007 .

[53]  F Babiloni,et al.  Introducing BF++: AC++ framework for cognitive bio-feedback systems design. , 2003, Methods of information in medicine.

[54]  Rajesh P. N. Rao,et al.  Correction for Miller et al., Cortical activity during motor execution, motor imagery, and imagery-based online feedback , 2010, Proceedings of the National Academy of Sciences.

[55]  José del R. Millán,et al.  BCI2000: A General-Purpose Software Platform for BCI , 2007 .

[56]  R. Lesser,et al.  Functional mapping of human sensorimotor cortex with electrocorticographic spectral analysis. II. Event-related synchronization in the gamma band. , 1998, Brain : a journal of neurology.

[57]  Yijun Wang,et al.  VEP-based brain-computer interfaces: time, frequency, and code modulations [Research Frontier] , 2009, IEEE Computational Intelligence Magazine.

[58]  J.P. Donoghue,et al.  BCI meeting 2005-workshop on clinical issues and applications , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[59]  S. Fairclough BCI and Physiological Computing for Computer Games : Differences , Similarities & Intuitive Control , 2009 .

[60]  J. Wolpaw,et al.  Brain–computer interfaces in neurological rehabilitation , 2008, The Lancet Neurology.

[61]  Ethan R. Buch,et al.  Think to Move: a Neuromagnetic Brain-Computer Interface (BCI) System for Chronic Stroke , 2008, Stroke.

[62]  R. Matthews,et al.  A Wearable Physiological Sensor Suite for Unobtrusive Monitoring of Physiological and Cognitive State , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[63]  Andrew B. Schwartz,et al.  Brain-Controlled Interfaces: Movement Restoration with Neural Prosthetics , 2006, Neuron.

[64]  David A. Kobus,et al.  Overview of the DARPA Augmented Cognition Technical Integration Experiment , 2004, Int. J. Hum. Comput. Interact..

[65]  Klaus-Robert Müller,et al.  Machine learning for real-time single-trial EEG-analysis: From brain–computer interfacing to mental state monitoring , 2008, Journal of Neuroscience Methods.

[66]  Rajesh P. N. Rao,et al.  Beyond the Gamma Band: The Role of High-Frequency Features in Movement Classification , 2008, IEEE Transactions on Biomedical Engineering.

[67]  B. Graimann,et al.  Why Use A BCI If You Are Healthy ? , 2000 .

[68]  Gerwin Schalk,et al.  Brain–computer symbiosis , 2008, Journal of neural engineering.

[69]  Thorsten O. Zander,et al.  Combining Eye Gaze Input With a Brain–Computer Interface for Touchless Human–Computer Interaction , 2010, Int. J. Hum. Comput. Interact..

[70]  Xiaorong Gao,et al.  A BCI-based environmental controller for the motion-disabled , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[71]  Jeremy Hill,et al.  A note on ethical aspects of BCI , 2009, Neural Networks.

[72]  G. Pfurtscheller,et al.  Rapid prototyping of an EEG-based brain-computer interface (BCI) , 2001, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[73]  A. Pradeep The Buying Brain: Secrets for Selling to the Subconscious Mind , 2010 .

[74]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[75]  R A Normann,et al.  The Utah intracortical Electrode Array: a recording structure for potential brain-computer interfaces. , 1997, Electroencephalography and clinical neurophysiology.

[76]  E. Sellers,et al.  How many people are able to control a P300-based brain–computer interface (BCI)? , 2009, Neuroscience Letters.

[77]  J. Wolpaw,et al.  A P300-based brain–computer interface for people with amyotrophic lateral sclerosis , 2008, Clinical Neurophysiology.

[78]  Stefan Haufe,et al.  The Berlin Brain–Computer Interface: Non-Medical Uses of BCI Technology , 2010, Front. Neurosci..

[79]  C Pylatiuk,et al.  ["Bionic" arm prostheses. State of the art in research and development]. , 2006, Der Orthopade.

[80]  Brendan Z. Allison,et al.  The Hybrid BCI , 2010, Frontiers in Neuroscience.

[81]  G Pfurtscheller,et al.  Toward a hybrid brain–computer interface based on imagined movement and visual attention , 2010, Journal of neural engineering.

[82]  T. Heskes,et al.  Covert attention allows for continuous control of brain–computer interfaces , 2010, The European journal of neuroscience.

[83]  Gert Pfurtscheller,et al.  Brain-computer interface: a new communication device for handicapped persons , 1993 .

[84]  Ernst Fernando Lopes Da Silva Niedermeyer,et al.  Electroencephalography, basic principles, clinical applications, and related fields , 1982 .

[85]  Tobias Egner,et al.  Neurofeedback treatment of epilepsy: from basic rationale to practical application , 2006, Expert review of neurotherapeutics.

[86]  C. Neuper,et al.  Combining Brain–Computer Interfaces and Assistive Technologies: State-of-the-Art and Challenges , 2010, Front. Neurosci..

[87]  Theresa M. Vaughan,et al.  A Novel Dry Electrode for Brain-Computer Interface , 2009, HCI.

[88]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[89]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[90]  A. Georgopoulos,et al.  Synchronous neural interactions assessed by magnetoencephalography: a functional biomarker for brain disorders , 2007, Journal of neural engineering.