A generic framework for adaptive EEG-based BCI training and operation

There are numerous possibilities and motivations for an adaptive BCI, which may not be easy to clarify and organize for a newcomer to the field. To our knowledge, there has not been any work done in classifying the literature on adaptive BCI in a comprehensive and structured way. We propose a conceptual framework, a taxonomy of adaptive BCI methods which encompasses most important approaches to fit them in such a way that a reader can clearly visualize which elements are being adapted and for what reason. In the interest of having a clear review of existing adaptive BCIs, this framework considers adaptation approaches for both the user and the machine, i.e., using instructional design observations as well as the usual machine learning techniques. This framework not only provides a coherent review of such extensive literature but also enables the reader to perceive gaps and flaws in the current BCI systems, which would hopefully bring novel solutions for an overall improvement.

[1]  Klaus-Robert Müller,et al.  Integrating dynamic stopping, transfer learning and language models in an adaptive zero-training ERP speller , 2014, Journal of neural engineering.

[2]  Brendan Z. Allison,et al.  Could Anyone Use a BCI? , 2010, Brain-Computer Interfaces.

[3]  Chi Thanh Vi,et al.  Continuous Tactile Feedback for Motor-Imagery Based Brain-Computer Interaction in a Multitasking Context , 2015, INTERACT.

[4]  F. Paas,et al.  Cognitive Architecture and Instructional Design , 1998 .

[5]  Dennis J. McFarland,et al.  Should the parameters of a BCI translation algorithm be continually adapted? , 2011, Journal of Neuroscience Methods.

[6]  A. Gaume,et al.  A psychoengineering paradigm for the neurocognitive mechanisms of biofeedback and neurofeedback , 2016, Neuroscience & Biobehavioral Reviews.

[7]  D. McFarland,et al.  An auditory brain–computer interface (BCI) , 2008, Journal of Neuroscience Methods.

[8]  Motoaki Kawanabe,et al.  Toward Unsupervised Adaptation of LDA for Brain–Computer Interfaces , 2011, IEEE Transactions on Biomedical Engineering.

[9]  C. Zich,et al.  FV 10. Motor imagery supported by neurofeedback: Age-related changes in EEG and fNIRS lateralization patterns , 2016, Clinical Neurophysiology.

[10]  Girijesh Prasad,et al.  A Covariate Shift Minimisation Method to Alleviate Non-stationarity Effects for an Adaptive Brain-Computer Interface , 2010, 2010 20th International Conference on Pattern Recognition.

[11]  Alois Schlogl,et al.  Comparison of adaptive features with linear discriminant classifier for Brain computer Interfaces , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[12]  Christa Neuper,et al.  Autocalibration and Recurrent Adaptation: Towards a Plug and Play Online ERD-BCI , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  Fabien Lotte,et al.  Towards a spatial ability training to improve Mental Imagery based Brain-Computer Interface (MI-BCI) performance: A Pilot study , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[14]  F Lotte,et al.  Advances in user-training for mental-imagery-based BCI control: Psychological and cognitive factors and their neural correlates. , 2016, Progress in brain research.

[15]  Rajesh P. N. Rao,et al.  Towards adaptive classification for BCI , 2006, Journal of neural engineering.

[16]  Linda Allal,et al.  Assessment "of"- or "in"- the Zone of Proximal Development. , 2000 .

[17]  Bertrand Olivier,et al.  Objective and subjective evaluation of online error correction during P300-based spelling , 2012 .

[18]  M. Csíkszentmihályi,et al.  The Concept of Flow , 2014 .

[19]  Febo Cincotti,et al.  Towards Noninvasive Hybrid Brain–Computer Interfaces: Framework, Practice, Clinical Application, and Beyond , 2015, Proceedings of the IEEE.

[20]  Clemens Brunner,et al.  Mu rhythm (de)synchronization and EEG single-trial classification of different motor imagery tasks , 2006, NeuroImage.

[21]  G Calhoun,et al.  Brain-computer interfaces based on the steady-state visual-evoked response. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[22]  José del R. Millán,et al.  Brain-Computer Interfaces , 2020, Handbook of Clinical Neurology.

[23]  Anatole Lécuyer,et al.  Combining BCI with Virtual Reality: Towards New Applications and Improved BCI , 2012 .

[24]  Danil V. Prokhorov,et al.  Adaptive classification , 2000, Proceedings of the IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium (Cat. No.00EX373).

[25]  Reinhold Scherer,et al.  Study of On-Line Adaptive Discriminant Analysis for EEG-Based Brain Computer Interfaces , 2007, IEEE Transactions on Biomedical Engineering.

[26]  Brendan Z. Allison,et al.  The Hybrid BCI , 2010, Frontiers in Neuroscience.

[27]  José Carlos Príncipe,et al.  Exploiting co-adaptation for the design of symbiotic neuroprosthetic assistants , 2009, Neural Networks.

[28]  Klaus-Robert Müller,et al.  Machine learning for real-time single-trial EEG-analysis: From brain–computer interfacing to mental state monitoring , 2008, Journal of Neuroscience Methods.

[29]  Aleksandra Vuckovic,et al.  Interaction of BCI with the underlying neurological conditions in patients: pros and cons , 2014, Front. Neuroeng..

[30]  C. Neuper,et al.  Learning to modulate one's own brain activity: the effect of spontaneous mental strategies , 2013, Front. Hum. Neurosci..

[31]  Klaus-Robert Müller,et al.  Adaptive Methods in BCI Research - An Introductory Tutorial , 2009 .

[32]  Stephen J. Roberts,et al.  Adaptive BCI based on variational Bayesian Kalman filtering: an empirical evaluation , 2004, IEEE Transactions on Biomedical Engineering.

[33]  K. Müller,et al.  Psychological predictors of SMR-BCI performance , 2012, Biological Psychology.

[34]  C. Neuper,et al.  Combining Brain–Computer Interfaces and Assistive Technologies: State-of-the-Art and Challenges , 2010, Front. Neurosci..

[35]  Fabien Lotte,et al.  Towards improved BCI based on human learning principles , 2015, The 3rd International Winter Conference on Brain-Computer Interface.

[36]  Sergi Bermúdez i Badia,et al.  NeuRow: An Immersive VR Environment for Motor-Imagery Training with the Use of Brain-Computer Interfaces and Vibrotactile Feedback , 2016, PhyCS.

[37]  Jose M. Carmena,et al.  Closed-Loop Decoder Adaptation Shapes Neural Plasticity for Skillful Neuroprosthetic Control , 2014, Neuron.

[38]  Klaus-Robert Müller,et al.  Co-adaptive calibration to improve BCI efficiency , 2011, Journal of neural engineering.

[39]  Michitaka Hirose,et al.  Brain-Computer Interfaces, Virtual Reality, and Videogames , 2008, Computer.

[40]  Kazuyuki Aihara,et al.  Adapting Spatial Filter Methods for Nonstationary BCIs , 2006 .

[41]  Adriane B. Randolph Not All Created Equal: Individual-Technology Fit of Brain-Computer Interfaces , 2012, 2012 45th Hawaii International Conference on System Sciences.

[42]  Krishna V. Shenoy,et al.  Combining Decoder Design and Neural Adaptation in Brain-Machine Interfaces , 2014, Neuron.

[43]  C. Neuper,et al.  Whatever Works: A Systematic User-Centered Training Protocol to Optimize Brain-Computer Interfacing Individually , 2013, PloS one.

[44]  Christian Mühl,et al.  Flaws in current human training protocols for spontaneous Brain-Computer Interfaces: lessons learned from instructional design , 2013, Front. Hum. Neurosci..

[45]  Zhilin Zhang,et al.  Evolving Signal Processing for Brain–Computer Interfaces , 2012, Proceedings of the IEEE.

[46]  E Donchin,et al.  The mental prosthesis: assessing the speed of a P300-based brain-computer interface. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[47]  Jérémie Mattout,et al.  Improving BCI performance through co-adaptation: applications to the P300-speller. , 2015, Annals of physical and rehabilitation medicine.

[48]  Cuntai Guan,et al.  Unsupervised Brain Computer Interface Based on Intersubject Information and Online Adaptation , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[49]  Henryk Palus,et al.  Feature selection for EEG-based discrimination between imagination of left and right hand movements , 2015 .

[50]  Xiaomu Song,et al.  Adaptive Common Spatial Pattern for single-trial EEG classification in multisubject BCI , 2013, 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER).

[51]  H. Flor,et al.  The thought translation device (TTD) for completely paralyzed patients. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[52]  Pierre-Yves Oudeyer,et al.  Multi-Armed Bandits for Intelligent Tutoring Systems , 2013, EDM.

[53]  Yuanqing Li,et al.  A self-training semi-supervised SVM algorithm and its application in an EEG-based brain computer interface speller system , 2008, Pattern Recognit. Lett..

[54]  W. A. Sarnacki,et al.  Electroencephalographic (EEG) control of three-dimensional movement , 2010, Journal of neural engineering.

[55]  Moritz Grosse-Wentrup,et al.  Critical issues in state-of-the-art brain–computer interface signal processing , 2011, Journal of neural engineering.

[56]  Sung Chan Jun,et al.  High Theta and Low Alpha Powers May Be Indicative of BCI-Illiteracy in Motor Imagery , 2013, PloS one.

[57]  Frank Kirchner,et al.  An Adaptive Spatial Filter for User-Independent Single Trial Detection of Event-Related Potentials , 2015, IEEE Transactions on Biomedical Engineering.

[58]  G. Pfurtscheller,et al.  Imagery of motor actions: differential effects of kinesthetic and visual-motor mode of imagery in single-trial EEG. , 2005, Brain research. Cognitive brain research.

[59]  Rosemary Luckin Designing children's software to ensure productive interactivity through collaboration in the zone of proximal development (ZPD) , 2001 .

[60]  Sing-Yau Goh,et al.  Effect of mindfulness meditation on brain–computer interface performance , 2014, Consciousness and Cognition.

[61]  Pierre-Yves Oudeyer,et al.  Intrinsic motivation, curiosity, and learning: Theory and applications in educational technologies. , 2016, Progress in brain research.

[62]  Jie Li,et al.  Incremental Common Spatial Pattern algorithm for BCI , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[63]  Klaus-Robert Müller,et al.  Ensembles of adaptive spatial filters increase BCI performance: an online evaluation , 2016, Journal of neural engineering.

[64]  Christa Neuper,et al.  Control beliefs can predict the ability to up-regulate sensorimotor rhythm during neurofeedback training , 2013, Front. Hum. Neurosci..