A Review of Hybrid Brain-Computer Interface Systems

Increasing number of research activities and different types of studies in brain-computer interface (BCI) systems show potential in this young research area. Research teams have studied features of different data acquisition techniques, brain activity patterns, feature extraction techniques, methods of classifications, and many other aspects of a BCI system. However, conventional BCIs have not become totally applicable, due to the lack of high accuracy, reliability, low information transfer rate, and user acceptability. A new approach to create a more reliable BCI that takes advantage of each system is to combine two or more BCI systems with different brain activity patterns or different input signal sources. This type of BCI, called hybrid BCI, may reduce disadvantages of each conventional BCI system. In addition, hybrid BCIs may create more applications and possibly increase the accuracy and the information transfer rate. However, the type of BCIs and their combinations should be considered carefully. In this paper, after introducing several types of BCIs and their combinations, we review and discuss hybrid BCIs, different possibilities to combine them, and their advantages and disadvantages.

[1]  Brendan Z. Allison,et al.  The Hybrid BCI , 2010, Frontiers in Neuroscience.

[2]  Michael Erb,et al.  Physiological self-regulation of regional brain activity using real-time functional magnetic resonance imaging (fMRI): methodology and exemplary data , 2003, NeuroImage.

[3]  C. Braun,et al.  Hand Movement Direction Decoded from MEG and EEG , 2008, The Journal of Neuroscience.

[4]  Rabab K. Ward,et al.  The Design of a Point-and-Click System by Integrating a Self-Paced Brain–Computer Interface With an Eye-Tracker , 2011, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[5]  G. Pfurtscheller,et al.  Graz brain-computer interface II: towards communication between humans and computers based on online classification of three different EEG patterns , 1996, Medical and Biological Engineering and Computing.

[6]  Günter Edlinger,et al.  A Hybrid Brain-Computer Interface for Smart Home Control , 2011, HCI.

[7]  J J Vidal,et al.  Toward direct brain-computer communication. , 1973, Annual review of biophysics and bioengineering.

[8]  N. Birbaumer,et al.  The thought translation device: a neurophysiological approach to communication in total motor paralysis , 1999, Experimental Brain Research.

[9]  Brendan Z. Allison,et al.  BCIs That Use Steady-State Visual Evoked Potentials or Slow Cortical Potentials , 2012 .

[10]  N Birbaumer,et al.  The effects of self-regulation of slow cortical potentials on performance in a signal detection task. , 1979, The International journal of neuroscience.

[11]  H. Flor,et al.  A spelling device for the paralysed , 1999, Nature.

[12]  Ricardo Chavarriaga,et al.  A hybrid brain–computer interface based on the fusion of electroencephalographic and electromyographic activities , 2011, Journal of neural engineering.

[13]  C Neuper,et al.  A comparison of three brain–computer interfaces based on event-related desynchronization, steady state visual evoked potentials, or a hybrid approach using both signals , 2011, Journal of neural engineering.

[14]  G Pfurtscheller,et al.  Toward a hybrid brain–computer interface based on imagined movement and visual attention , 2010, Journal of neural engineering.

[15]  Shirley Coyle,et al.  On the suitability of near-infrared (NIR) systems for next-generation brain-computer interfaces. , 2004, Physiological measurement.

[16]  Touradj Ebrahimi,et al.  An efficient P300-based brain–computer interface for disabled subjects , 2008, Journal of Neuroscience Methods.

[17]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[18]  Brendan Z. Allison,et al.  Improved signal processing approaches in an offline simulation of a hybrid brain–computer interface , 2010, Journal of Neuroscience Methods.

[19]  Jonathan R Wolpaw,et al.  Brain–computer interface systems: progress and prospects , 2007, Expert review of medical devices.

[20]  Dean J Krusienski,et al.  A comparison of classification techniques for the P300 Speller , 2006, Journal of neural engineering.

[21]  Yi Li,et al.  A hybrid brain-computer interface control strategy in a virtual environment , 2011, Journal of Zhejiang University SCIENCE C.

[22]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[23]  Klaus-Robert Müller,et al.  Enhanced Performance by a Hybrid Nirs–eeg Brain Computer Interface , 2022 .

[24]  B. Allison,et al.  BCI Demographics: How Many (and What Kinds of) People Can Use an SSVEP BCI? , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[25]  Andrej M. Savić,et al.  Toward a Hybrid BCI for Grasp Rehabilitation , 2011 .

[26]  Yodchanan Wongsawat,et al.  Hybrid EEG-EOG brain-computer interface system for practical machine control , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[27]  Ying Sun,et al.  Asynchronous P300 BCI: SSVEP-based control state detection , 2010, 2010 18th European Signal Processing Conference.

[28]  Marcos Dipinto,et al.  Discriminant analysis , 2020, Predictive Analytics.

[29]  Yael Arbel,et al.  BCIs that use P300 Event Related Potentials , 2012 .

[30]  T. Muroga,et al.  Application to robot control using brain function measurement by near-infrared spectroscopy , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[31]  H. Ritter,et al.  Asynchronous, parallel on-line classification of P300 and ERD for an efficient hybrid BCI , 2011, 2011 5th International IEEE/EMBS Conference on Neural Engineering.

[32]  E. Donchin,et al.  Is the P300 component a manifestation of context updating? , 1988, Behavioral and Brain Sciences.

[33]  Brendan Z. Allison,et al.  P300 brain computer interface: current challenges and emerging trends , 2012, Front. Neuroeng..

[34]  Christian Laugier,et al.  Hybrid P300 and mu-beta brain computer interface to operate a brain controlled wheelchair , 2008 .

[35]  Yan Wang,et al.  Visual stimulus design for high-rate SSVEP BCI , 2010 .

[36]  José del R. Millán,et al.  An Introduction to Brain-Computer Interfacing , 2007 .

[37]  Rabab K Ward,et al.  Automatic artefact removal in a self-paced hybrid brain- computer interface system , 2012, Journal of NeuroEngineering and Rehabilitation.

[38]  Erich E. Sutter,et al.  The brain response interface: communication through visually-induced electrical brain responses , 1992 .

[39]  J.J. Vidal,et al.  Real-time detection of brain events in EEG , 1977, Proceedings of the IEEE.

[40]  G. Pfurtscheller,et al.  Self-Paced Operation of an SSVEP-Based Orthosis With and Without an Imagery-Based “Brain Switch:” A Feasibility Study Towards a Hybrid BCI , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[41]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.