The Hybrid BCI

Nowadays, everybody knows what a hybrid car is. A hybrid car normally has two engines to enhance energy efficiency and reduce CO2 output. Similarly, a hybrid brain-computer interface (BCI) is composed of two BCIs, or at least one BCI and another system. A hybrid BCI, like any BCI, must fulfill the following four criteria: (i) the device must rely on signals recorded directly from the brain; (ii) there must be at least one recordable brain signal that the user can intentionally modulate to effect goal-directed behaviour; (iii) real time processing; and (iv) the user must obtain feedback. This paper introduces hybrid BCIs that have already been published or are in development. We also introduce concepts for future work. We describe BCIs that classify two EEG patterns: one is the event-related (de)synchronisation (ERD, ERS) of sensorimotor rhythms, and the other is the steady-state visual evoked potential (SSVEP). Hybrid BCIs can either process their inputs simultaneously, or operate two systems sequentially, where the first system can act as a “brain switch”. For example, we describe a hybrid BCI that simultaneously combines ERD and SSVEP BCIs. We also describe a sequential hybrid BCI, in which subjects could use a brain switch to control an SSVEP-based hand orthosis. Subjects who used this hybrid BCI exhibited about half the false positives encountered while using the SSVEP BCI alone. A brain switch can also rely on hemodynamic changes measured through near-infrared spectroscopy (NIRS). Hybrid BCIs can also use one brain signal and a different type of input. This additional input can be an electrophysiological signal such as the heart rate, or a signal from an external device such as an eye tracking system.

[1]  F. H. Lopes da Silva,et al.  Short‐lived brain state after cued motor imagery in naive subjects , 2008, The European journal of neuroscience.

[2]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[3]  A. Verberne,et al.  Cortical modulation of the cardiovascular system. , 1998, Progress in neurobiology.

[4]  A. Verberne,et al.  Cortical Modulation of theCardiovascular System , 1998, Progress in Neurobiology.

[5]  Reinhold Scherer,et al.  Steady-state visual evoked potential (SSVEP)-based communication: impact of harmonic frequency components , 2005, Journal of neural engineering.

[6]  Cornelis H. M. Brunia,et al.  Evoked cardiac responses during a fixed 4 sec foreperiod preceding four different responses , 1985 .

[7]  Xiaorong Gao,et al.  Design and implementation of a brain-computer interface with high transfer rates , 2002, IEEE Transactions on Biomedical Engineering.

[8]  Brendan Z. Allison,et al.  Improved signal processing approaches in an offline simulation of a hybrid brain–computer interface , 2010, Journal of Neuroscience Methods.

[9]  M. Jeannerod,et al.  Vegetative response during imagined movement is proportional to mental effort , 1991, Behavioural Brain Research.

[10]  Christa Neuper,et al.  14 Human Brain-Computer Interface , 2005 .

[11]  Desney S. Tan,et al.  Brain-Computer Interfacing for Intelligent Systems , 2008, IEEE Intelligent Systems.

[12]  C Neuper,et al.  Spatio-temporal differences in brain oxygenation between movement execution and imagery: a multichannel near-infrared spectroscopy study. , 2008, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[13]  S Murase,et al.  Arterial baroreflex inhibition by gastric distension in rats: mediation by splanchnic afferents. , 1991, The American journal of physiology.

[14]  G Pfurtscheller,et al.  Self-initiation of EEG-based brain-computer communication using the heart rate response. , 2007, Journal of neural engineering.

[15]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[16]  Gert Pfurtscheller,et al.  Development, set-up and first results for a one-channel near-infrared spectroscopy system / Entwicklung, Aufbau und vorläufige Ergebnisse eines Einkanal- Nahinfrarot-Spektroskopie-Systems , 2008, Biomedizinische Technik. Biomedical engineering.

[17]  G. Pfurtscheller,et al.  Cardiac response induced by voluntary self-paced finger movement. , 1998, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[18]  M. Diamond,et al.  Primary Motor and Sensory Cortex Activation during Motor Performance and Motor Imagery: A Functional Magnetic Resonance Imaging Study , 1996, The Journal of Neuroscience.

[19]  Thorsten O. Zander,et al.  BC(eye): Combining Eye-Gaze Input with Brain-Computer Interaction , 2009, HCI.

[20]  C. Brunia,et al.  Changes in heart rate and slow brain potentials related to motor preparation and stimulus anticipation in a time estimation task. , 1987, Psychophysiology.

[21]  Niels Birbaumer,et al.  Grand Challenges of Brain Computer Interfaces in the Years to Come , 2009, Front. Neurosci..

[22]  G. Pfurtscheller,et al.  Could the beta rebound in the EEG be suitable to realize a “brain switch”? , 2009, Clinical Neurophysiology.

[23]  Gary E. Birch,et al.  A brain-controlled switch for asynchronous control applications , 2000, IEEE Trans. Biomed. Eng..

[24]  E. Braunwald,et al.  Parasympathetic control of the heart. , 1973, Pharmacological reviews.

[25]  José del R. Millán,et al.  An Introduction to Brain-Computer Interfacing , 2007 .

[26]  G Pfurtscheller,et al.  Centrally controlled heart rate changes during mental practice in immersive virtual environment: a case study with a tetraplegic. , 2008, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[27]  Cuntai Guan,et al.  Temporal classification of multichannel near-infrared spectroscopy signals of motor imagery for developing a brain–computer interface , 2007, NeuroImage.

[28]  Shirley M Coyle,et al.  Brain–computer interface using a simplified functional near-infrared spectroscopy system , 2007, Journal of neural engineering.

[29]  J.R. Wolpaw,et al.  BCI meeting 2005-workshop on signals and recording methods , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[30]  Beatrice C. Lacey,et al.  Cognitive Modulation of Time‐Dependent Primary Bradycardia , 1980 .

[31]  Gert Pfurtscheller,et al.  Motor imagery and direct brain-computer communication , 2001, Proc. IEEE.

[32]  Jonathan R Wolpaw,et al.  Brain–computer interface systems: progress and prospects , 2007, Expert review of medical devices.

[33]  Christa Neuper,et al.  Self-paced control of an hand orthosis using SSVEP-based BCI. , 2009, HCI International 2009.

[34]  Francis K. H. Quek Eyes in the interface , 1995, Image Vis. Comput..

[35]  E. Naito,et al.  Internally Simulated Movement Sensations during Motor Imagery Activate Cortical Motor Areas and the Cerebellum , 2002, The Journal of Neuroscience.

[36]  G. Pfurtscheller,et al.  Self-Paced Operation of an SSVEP-Based Orthosis With and Without an Imagery-Based “Brain Switch:” A Feasibility Study Towards a Hybrid BCI , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[37]  Clemens Brunner,et al.  Analysis of sensorimotor rhythms for the implementation of a brain switch for healthy subjects , 2010, Biomed. Signal Process. Control..

[38]  M. Erb,et al.  Activation of Cortical and Cerebellar Motor Areas during Executed and Imagined Hand Movements: An fMRI Study , 1999, Journal of Cognitive Neuroscience.

[39]  Panagiotis Bamidis,et al.  Effects of imagery training on cognitive performance and use of physiological measures as an assessment tool of mental effort , 2007, Brain and Cognition.

[40]  D. Koshland Frontiers in neuroscience. , 1988, Science.

[41]  F. L. D. Silva,et al.  Beta rebound after different types of motor imagery in man , 2005, Neuroscience Letters.

[42]  G Pfurtscheller,et al.  Toward a hybrid brain–computer interface based on imagined movement and visual attention , 2010, Journal of neural engineering.

[43]  Thorsten O. Zander,et al.  Enhancing Human-Computer Interaction with Input from Active and Passive Brain-Computer Interfaces , 2010, Brain-Computer Interfaces.

[44]  G Pfurtscheller,et al.  Cardiac responses induced during thought-based control of a virtual environment. , 2006, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[45]  Christa Neuper,et al.  Does conscious intention to perform a motor act depend on slow cardiovascular rhythms? , 2010, Neuroscience Letters.

[46]  G. Pfurtscheller,et al.  Classification of movement-related EEG in a memorized delay task experiment , 2000, Clinical Neurophysiology.

[47]  Gert Pfurtscheller,et al.  Overt foot movement detection in one single Laplacian EEG derivation , 2008, Journal of Neuroscience Methods.

[48]  Gernot R. Müller-Putz,et al.  Comparison of DFT and lock-in amplifier features and search for optimal electrode positions in SSVEP-based BCI , 2008, Journal of Neuroscience Methods.

[49]  Christa Neuper,et al.  Rehabilitation with Brain-Computer Interface Systems , 2008, Computer.

[50]  H. Flor,et al.  A spelling device for the paralysed , 1999, Nature.

[51]  John J. Leggett,et al.  Interaction styles and input/output devices , 1993, Behav. Inf. Technol..

[52]  L. Cohen,et al.  Brain–computer interfaces: communication and restoration of movement in paralysis , 2007, The Journal of physiology.

[53]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[54]  Christa Neuper,et al.  Human Brain – Computer Interface , 2005 .

[55]  T. Maeshima,et al.  Autonomic response specificity during motor imagery. , 2000, Journal of physiological anthropology and applied human science.