Brain Signals for Brain–Computer Interfaces

This chapter describes brain signals relevant for brain–computer interfaces (BCIs). Section 1 addresses the impetus for BCI research, reviews key BCI principles, and outlines a set of brain signals appropriate for BCI use. Section 2 describes specific brain signals used in BCIs, their neurophysiological origins, and their current applications. Finally, Sect. 3 discusses issues critical for maximizing the effectiveness of BCIs.

[1]  Dennis J. McFarland,et al.  Design and operation of an EEG-based brain-computer interface with digital signal processing technology , 1997 .

[2]  J. Polich,et al.  Neuropsychology and neuropharmacology of P3a and P3b. , 2006, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[3]  Edward M. Schmidt,et al.  Single neuron recording from motor cortex as a possible source of signals for control of external devices , 2006, Annals of Biomedical Engineering.

[4]  W. T. Thach.  Correlation of neural discharge with pattern and force of muscular activity, joint position, and direction of intended next movement in motor cortex and cerebellum. , 1978, Journal of neurophysiology.

[5]  J. Pineda,et al.  Learning to control brain rhythms: making a brain-computer interface possible , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[6]  R. Andersen,et al.  Selecting the signals for a brain–machine interface , 2004, Current Opinion in Neurobiology.

[7]  J. A. Wilson,et al.  Two-dimensional movement control using electrocorticographic signals in humans , 2008, Journal of neural engineering.

[8]  G. Pfurtscheller,et al.  Enhancement of left-right sensorimotor EEG differences during feedback-regulated motor imagery. , 1999, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[9]  E. M. Pinches,et al.  The role of synchrony and oscillations in the motor output , 1999, Experimental Brain Research.

[10]  J. R. Wolpaw,et al.  Brain–computer interfaces (BCIs): Detection instead of classification , 2008, Journal of Neuroscience Methods.

[11]  K. Böcker,et al.  Brain and behavior : Past, present, and future , 1997 .

[12]  Gernot R. Müller-Putz,et al.  Control of an Electrical Prosthesis With an SSVEP-Based BCI , 2008, IEEE Transactions on Biomedical Engineering.

[13]  J. Wolpaw,et al.  Decoding flexion of individual fingers using electrocorticographic signals in humans , 2009, Journal of neural engineering.

[14]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[15]  J. Donoghue,et al.  Neural discharge and local field potential oscillations in primate motor cortex during voluntary movements. , 1998, Journal of neurophysiology.

[16]  W. Walter,et al.  Contingent Negative Variation : An Electric Sign of Sensori-Motor Association and Expectancy in the Human Brain , 1964, Nature.

[17]  J. Wolpaw,et al.  Multichannel EEG-based brain-computer communication. , 1994, Electroencephalography and clinical neurophysiology.

[18]  G Pfurtscheller,et al.  Brain-computer communication based on the dynamics of brain oscillations. , 2003, Supplements to Clinical neurophysiology.

[19]  F. D. Silva.  Neural mechanisms underlying brain waves: from neural membranes to networks. , 1991 .

[20]  J. Wolpaw,et al.  Mu and Beta Rhythm Topographies During Motor Imagery and Actual Movements , 2004, Brain Topography.

[21]  E. Fetz,et al.  Coherent 25- to 35-Hz oscillations in the sensorimotor cortex of awake behaving monkeys. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[22]  R. Lesser,et al.  Functional mapping of human sensorimotor cortex with electrocorticographic spectral analysis. I. Alpha and beta event-related desynchronization. , 1998, Brain : a journal of neurology.

[23]  S. P. Levine,et al.  Spatiotemporal patterns of beta desynchronization and gamma synchronization in corticographic data during self-paced movement , 2003, Clinical Neurophysiology.

[24]  G Pfurtscheller,et al.  Current trends in Graz Brain-Computer Interface (BCI) research. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[25]  R. Schmidt,et al.  Knowledge of results and motor learning: a review and critical reappraisal. , 1984, Psychological bulletin.

[26]  R. Andersen,et al.  Neural prosthetic control signals from plan activity , 2003, Neuroreport.

[27]  B. Rockstroh.  Slow cortical potentials and behavior , 1989 .

[28]  Hiroshi Shibasaki,et al.  Distinct cortical areas for motor preparation and execution in human identified by Bereitschaftspotential recording and ECoG-EMG coherence analysis , 2003, Clinical Neurophysiology.

[29]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[30]  Desney S. Tan,et al.  Brain-Computer Interfacing for Intelligent Systems , 2008, IEEE Intelligent Systems.

[31]  Eran Stark,et al.  Distinct movement parameters are represented by different neurons in the motor cortex , 2007, The European journal of neuroscience.

[32]  Gerwin Schalk,et al.  A brain–computer interface using electrocorticographic signals in humans , 2004, Journal of neural engineering.

[33]  W. Pritchard.  Psychophysiology of P300. , 1981, Psychological bulletin.

[34]  P R Kennedy,et al.  Direct control of a computer from the human central nervous system. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[35]  W. A. Sarnacki,et al.  Electroencephalographic (EEG) control of three-dimensional movement , 2010, Journal of neural engineering.

[36]  Stephanie H. Felgoise,et al.  The ALSSQOL , 2006, Neurology.

[37]  N. Crone,et al.  High-frequency gamma oscillations and human brain mapping with electrocorticography. , 2006, Progress in brain research.

[38]  Bijan Pesaran,et al.  Temporal structure in neuronal activity during working memory in macaque parietal cortex , 2000, Nature Neuroscience.

[39]  E. Donchin,et al.  COGNITIVE PSYCHOPHYSIOLOGY: THE ENDOGENOUS COMPONENTS OF THE ERP , 1978 .

[40]  B. Rockstroh,et al.  Slow potentials of the cerebral cortex and behavior. , 1990, Physiological reviews.

[41]  F. Rösler,et al.  Event-related potentials during auditory and somatosensory discrimination in sighted and blind human subjects. , 1996, Brain research. Cognitive brain research.

[42]  William L. Wilkie,et al.  Presidential Address: 1980 , 1981 .

[43]  J. Polich.  Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[44]  W. Singer,et al.  The gamma cycle , 2007, Trends in Neurosciences.

[45]  J.R. Wolpaw,et al.  BCI meeting 2005-workshop on signals and recording methods , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[46]  Matthias M. Müller,et al.  Sustained division of spatial attention to multiple locations within one hemifield , 2007, Neuroscience Letters.

[47]  Jonathan R Wolpaw,et al.  A brain-computer interface for long-term independent home use , 2010, Amyotrophic lateral sclerosis : official publication of the World Federation of Neurology Research Group on Motor Neuron Diseases.

[48]  F. H. Lopes da Silva,et al.  Event-related potentials: methodology and quantification , 1998 .

[49]  C. Mehring,et al.  Comparing information about arm movement direction in single channels of local and epicortical field potentials from monkey and human motor cortex , 2004, Journal of Physiology-Paris.

[50]  T. Pedley,et al.  Beta and Mu Rhythms , 1990, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[51]  J. Donoghue,et al.  Primary Motor Cortex Tuning to Intended Movement Kinematics in Humans with Tetraplegia , 2008, The Journal of Neuroscience.

[52]  C. Koch,et al.  Imagery neurons in the human brain , 2000, Nature.

[53]  E. Donchin.  Presidential address, 1980. Surprise!...Surprise? , 1981, Psychophysiology.

[54]  E. Fetz.  Operant Conditioning of Cortical Unit Activity , 1969, Science.

[55]  Thilo Hinterberger,et al.  An Auditory Brain-Computer Interface Based on the Self-Regulation of Slow Cortical Potentials , 2005, Neurorehabilitation and neural repair.

[56]  H. Flor,et al.  A spelling device for the paralysed , 1999, Nature.

[57]  U. Mitzdorf.  Current source-density method and application in cat cerebral cortex: investigation of evoked potentials and EEG phenomena. , 1985, Physiological reviews.

[58]  J. Wolpaw,et al.  Towards an independent brain–computer interface using steady state visual evoked potentials , 2008, Clinical Neurophysiology.

[59]  J. Wolpaw,et al.  A P300 event-related potential brain–computer interface (BCI): The effects of matrix size and inter stimulus interval on performance , 2006, Biological Psychology.

[60]  U. Mitzdorf.  Properties of Cortical Generators of Event-Related Potentials , 1994, Pharmacopsychiatry.

[61]  Miguel A. L. Nicolelis,et al.  Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex , 1999, Nature Neuroscience.

[62]  B. Rockstroh,et al.  Biofeedback of slow cortical potentials. I. , 1980, Electroencephalography and clinical neurophysiology.

[63]  J. Wolpaw,et al.  Textbook of Neural Repair and Rehabilitation: Brain–computer interfaces for communication and control , 2006 .

[64]  J. Wolpaw,et al.  Answering questions with an electroencephalogram-based brain-computer interface. , 1998, Archives of physical medicine and rehabilitation.

[65]  J. Wolpaw,et al.  Decoding two-dimensional movement trajectories using electrocorticographic signals in humans , 2007, Journal of neural engineering.

[66]  A Kostov,et al.  Parallel man-machine training in development of EEG-based cursor control. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[67]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[68]  D J McFarland,et al.  Brain-computer interface research at the Wadsworth Center. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[69]  Rajesh P. N. Rao,et al.  Spectral Changes in Cortical Surface Potentials during Motor Movement , 2007, The Journal of Neuroscience.

[70]  Gert Pfurtscheller,et al.  Development, set-up and first results for a one-channel near-infrared spectroscopy system / Entwicklung, Aufbau und vorläufige Ergebnisse eines Einkanal- Nahinfrarot-Spektroskopie-Systems , 2008, Biomedizinische Technik. Biomedical engineering.

[71]  M. Ghilardi,et al.  P300-like potentials in the normal monkey using classical conditioning and an auditory 'oddball' paradigm. , 1986, Electroencephalography and clinical neurophysiology.

[72]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[73]  Daryl R. Kipke,et al.  Voltage pulses change neural interface properties and improve unit recordings with chronically implanted microelectrodes , 2006, IEEE Transactions on Biomedical Engineering.

[74]  P.R. Kennedy,et al.  Computer control using human intracortical local field potentials , 2004, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[75]  G. Oriolo,et al.  Non-invasive brain–computer interface system: Towards its application as assistive technology , 2008, Brain Research Bulletin.

[76]  N Birbaumer,et al.  Biofeedback of slow cortical potentials. II. Analysis of single event-related slow potentials by time series analysis. , 1980, Electroencephalography and clinical neurophysiology.

[77]  O. Donchin,et al.  Local field potentials related to bimanual movements in the primary and supplementary motor cortices , 2001, Experimental Brain Research.

[78]  R. Andersen,et al.  Cortical Local Field Potential Encodes Movement Intentions in the Posterior Parietal Cortex , 2005, Neuron.

[79]  Z. Simmons,et al.  Quality of life in ALS depends on factors other than strength and physical function , 2000, Neurology.

[80]  D. Regan.  Steady-state evoked potentials. , 1977, Journal of the Optical Society of America.

[81]  E. Fetz,et al.  Correlations between activity of motor cortex cells and arm muscles during operantly conditioned response patterns , 1975, Experimental Brain Research.

[82]  M. Hallett,et al.  A high performance sensorimotor beta rhythm-based brain–computer interface associated with human natural motor behavior , 2008, Journal of neural engineering.

[83]  E Donchin,et al.  The mental prosthesis: assessing the speed of a P300-based brain-computer interface. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[84]  N. Birbaumer,et al.  The thought-translation device (TTD): neurobehavioral mechanisms and clinical outcome , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[85]  H. Shibasaki,et al.  Movement-related change of electrocorticographic activity in human supplementary motor area proper. , 2000, Brain : a journal of neurology.

[86]  S. P. Levine,et al.  Identification of electrocorticogram patterns as the basis for a direct brain interface. , 1999, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[87]  E. John,et al.  Evoked-Potential Correlates of Stimulus Uncertainty , 1965, Science.

[88]  G. Pfurtscheller,et al.  Patterns of cortical activation during planning of voluntary movement. , 1989, Electroencephalography and clinical neurophysiology.

[89]  Gert Pfurtscheller,et al.  Brain-computer interface: a new communication device for handicapped persons , 1993 .

[90]  Ernst Fernando Lopes Da Silva Niedermeyer,et al.  Electroencephalography, basic principles, clinical applications, and related fields , 1982 .

[91]  Kim J. Burchiel,et al.  Factors influencing accuracy of operant control of pyramidal tract neurons in monkey , 1978, Brain Research.

[92]  Wolf Singer,et al.  Neuronal Synchrony: A Versatile Code for the Definition of Relations? , 1999, Neuron.

[93]  G Pfurtscheller,et al.  EEG-based communication: improved accuracy by response verification. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[94]  C. Mehring,et al.  Encoding of Movement Direction in Different Frequency Ranges of Motor Cortical Local Field Potentials , 2005, The Journal of Neuroscience.

[95]  G. R. Muller,et al.  Brain oscillations control hand orthosis in a tetraplegic , 2000, Neuroscience Letters.

[96]  Erich E. Sutter,et al.  The brain response interface: communication through visually-induced electrical brain responses , 1992 .

[97]  J.J. Vidal,et al.  Real-time detection of brain events in EEG , 1977, Proceedings of the IEEE.

[98]  M. Alexander,et al.  Principles of Neural Science , 1981 .

[99]  Gert Pfurtscheller,et al.  EEG event-related desynchronization (ERD) and synchronization (ERS) , 1997 .

[100]  D J McFarland,et al.  An EEG-based brain-computer interface for cursor control. , 1991, Electroencephalography and clinical neurophysiology.

[101]  György Buzsáki,et al.  Gamma oscillations dynamically couple hippocampal CA3 and CA1 regions during memory task performance , 2007, Proceedings of the National Academy of Sciences.

[102]  Nicholas G. Hatsopoulos,et al.  Brain-machine interface: Instant neural control of a movement signal , 2002, Nature.

[103]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[104]  D.A. Heldman,et al.  Local field potential spectral tuning in motor cortex during reaching , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[105]  J J Vidal,et al.  Toward direct brain-computer communication. , 1973, Annual review of biophysics and bioengineering.

[106]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[107]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[108]  D.J. McFarland,et al.  The Wadsworth Center brain-computer interface (BCI) research and development program , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[109]  H. Gastaut.  [Electrocorticographic study of the reactivity of rolandic rhythm]. , 1952, Revue neurologique.

[110]  R. Andersen,et al.  Memory related motor planning activity in posterior parietal cortex of macaque , 1988, Experimental Brain Research.

[111]  B. Giraudeau,et al.  Quality of life in ALS is maintained as physical function declines , 2001, Neurology.

[112]  G. Schalk,et al.  ELECTROCORTICOGRAPHIC FREQUENCY ALTERATION MAPPING: A CLINICAL TECHNIQUE FOR MAPPING THE MOTOR CORTEX , 2007, Neurosurgery.

[113]  G. Pfurtscheller,et al.  Motor imagery activates primary sensorimotor area in humans , 1997, Neuroscience Letters.

[114]  P. Kennedy.  The cone electrode: a long-term electrode that records from neurites grown onto its recording surface , 1989, Journal of Neuroscience Methods.

[115]  Klaus-Robert Müller,et al.  The non-invasive Berlin Brain–Computer Interface: Fast acquisition of effective performance in untrained subjects , 2007, NeuroImage.

[116]  Dean J Krusienski,et al.  Emulation of computer mouse control with a noninvasive brain–computer interface , 2008, Journal of neural engineering.

[117]  R. Lesser,et al.  Functional mapping of human sensorimotor cortex with electrocorticographic spectral analysis. II. Event-related synchronization in the gamma band. , 1998, Brain : a journal of neurology.