A review of fMRI as a tool for enhancing EEG-based brain-machine interfaces

Human-robot interaction has been going stronger and stronger, up to find a notorious level on brain-machines interfaces. This assistive technology offers a great hope for patients suffering severe neuromuscular disorders. Starting from the current limitations hindering its extensive application outside the research laboratories, this paper reviews findings and prospects on functional magnetic resonance imaging showing how fMRI can help to overcome those limitations, while playing a key role on improving the development of brain-machine interfaces based on electroencephalography. The different types of derived benefits for this interfaces, as well as the different kinds of impact on their components, are presented under a field classification that reveals the distinctive roles that fMRI can play on the present context. The review concludes that fMRI provides complementary knowledge of immediate application, and that a greater profit could be obtained from the own EEG signal by integrating both neuroimaging modalities.

[1]  Afraim Salek-Haddadi,et al.  Event-Related fMRI with Simultaneous and Continuous EEG: Description of the Method and Initial Case Report , 2001, NeuroImage.

[2]  D J McFarland,et al.  Brain-computer interface research at the Wadsworth Center. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[3]  Luca Citi,et al.  Defining brain–machine interface applications by matching interface performance with device requirements , 2008, Journal of Neuroscience Methods.

[4]  E Donchin,et al.  The mental prosthesis: assessing the speed of a P300-based brain-computer interface. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[5]  G. Pfurtscheller,et al.  Event-related beta EEG-changes during passive and attempted foot movements in paraplegic patients , 2007, Brain Research.

[6]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[7]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[8]  H. Flor,et al.  A spelling device for the paralysed , 1999, Nature.

[9]  E Donchin,et al.  Brain-computer interface technology: a review of the first international meeting. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[10]  Christian Kaufmann,et al.  Altered Processing of Acoustic Stimuli during Sleep: Reduced Auditory Activation and Visual Deactivation Detected by a Combined fMRI/EEG Study , 2002, NeuroImage.

[11]  Nelson J. Trujillo-Barreto,et al.  Biophysical model for integrating neuronal activity, EEG, fMRI and metabolism , 2008, NeuroImage.

[12]  Karl J. Friston,et al.  Functional magnetic resonance imaging of human absence seizures , 2003, Annals of neurology.

[13]  G Pfurtscheller,et al.  Current trends in Graz Brain-Computer Interface (BCI) research. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[14]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[15]  Karl J. Friston,et al.  Statistical parametric mapping for event-related potentials: I. Generic considerations , 2004, NeuroImage.

[16]  Sneh Anand,et al.  Quantitative EEG analysis for assessment to 'plan' a task in amyotrophic lateral sclerosis patients: a study of executive functions (planning) in ALS patients. , 2004, Brain research. Cognitive brain research.

[17]  D J McFarland,et al.  An EEG-based brain-computer interface for cursor control. , 1991, Electroencephalography and clinical neurophysiology.

[18]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[19]  J J Vidal,et al.  Toward direct brain-computer communication. , 1973, Annual review of biophysics and bioengineering.

[20]  M. Bianciardi,et al.  Single-epoch analysis of interleaved evoked potentials and fMRI responses during steady-state visual stimulation , 2009, Clinical Neurophysiology.

[21]  Miguel A. L. Nicolelis,et al.  Brain–machine interfaces: past, present and future , 2006, Trends in Neurosciences.

[22]  G. R. Muller,et al.  Clinical application of an EEG-based brain–computer interface: a case study in a patient with severe motor impairment , 2003, Clinical Neurophysiology.

[23]  R. Deichmann,et al.  Real-time functional magnetic resonance imaging: methods and applications. , 2007, Magnetic resonance imaging.

[24]  F. Jolesz,et al.  Brain–machine interface via real-time fMRI: Preliminary study on thought-controlled robotic arm , 2009, Neuroscience Letters.

[25]  David Poeppel,et al.  How can EEG/MEG and fMRI/PET data be combined? , 2002, Human brain mapping.

[26]  J.J. Vidal,et al.  Real-time detection of brain events in EEG , 1977, Proceedings of the IEEE.

[27]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[28]  J. Pineda.  The functional significance of mu rhythms: Translating “seeing” and “hearing” into “doing” , 2005, Brain Research Reviews.

[29]  Andreas Kleinschmidt,et al.  EEG-correlated fMRI of human alpha activity , 2003, NeuroImage.

[30]  Fumikazu Miwakeichi,et al.  Concurrent EEG/fMRI analysis by multiway Partial Least Squares , 2004, NeuroImage.

[31]  P. Nunez,et al.  On the Relationship of Synaptic Activity to Macroscopic Measurements: Does Co-Registration of EEG with fMRI Make Sense? , 2004, Brain Topography.

[32]  Ethan R. Buch,et al.  Physiological regulation of thinking: brain-computer interface (BCI) research. , 2006, Progress in brain research.

[33]  R. Veit,et al.  Self-regulation of local brain activity using real-time functional magnetic resonance imaging (fMRI) , 2004, Journal of Physiology-Paris.

[34]  Michael Erb,et al.  Physiological self-regulation of regional brain activity using real-time functional magnetic resonance imaging (fMRI): methodology and exemplary data , 2003, NeuroImage.

[35]  Michael Erb,et al.  Brain areas activated in fMRI during self-regulation of slow cortical potentials (SCPs) , 2003, Experimental Brain Research.

[36]  R. Savoy.  History and future directions of human brain mapping and functional neuroimaging. , 2001, Acta psychologica.

[37]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[38]  Hellmuth Obrig,et al.  Correlates of alpha rhythm in functional magnetic resonance imaging and near infrared spectroscopy , 2003, NeuroImage.

[39]  Nikolaus Weiskopf,et al.  An EEG-driven brain-computer interface combined with functional magnetic resonance imaging (fMRI) , 2004, IEEE Transactions on Biomedical Engineering.

[40]  Brigitte Röder,et al.  On the relationship between slow cortical potentials and BOLD signal changes in humans. , 2008, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[41]  Lucia Rita Quitadamo,et al.  How the NPX data format handles EEG data acquired simultaneously with fMRI. , 2007, Magnetic resonance imaging.

[42]  Paolo Maria Rossini,et al.  Neuroplasticity in amputees: Main implications on bidirectional interfacing of cybernetic hand prostheses , 2009, Progress in Neurobiology.

[43]  F. Babiloni,et al.  Estimation of the cortical functional connectivity with the multimodal integration of high-resolution EEG and fMRI data by directed transfer function , 2005, NeuroImage.