Real-Time Decoding of Brain Responses to Visuospatial Attention Using 7T fMRI

Brain-Computer interface technologies mean to create new communication channels between our mind and our environment, independent of the motor system, by detecting and classifying self regulation of local brain activity. BCIs can provide patients with severe paralysis a means to communicate and to live more independent lives. There has been a growing interest in using invasive recordings for BCI to improve the signal quality. This also potentially gives access to new control strategies previously inaccessible by non-invasive methods. However, before surgery, the best implantation site needs to be determined. The blood-oxygen-level dependent signal changes measured with fMRI have been shown to agree well spatially with those found with invasive electrodes, and are the best option for pre-surgical localization. We show, using real-time fMRI at 7T, that eye movement-independent visuospatial attention can be used as a reliable control strategy for BCIs. At this field strength even subtle signal changes can be detected in single trials thanks to the high contrast-to-noise ratio. A group of healthy subjects were instructed to move their attention between three (two peripheral and one central) spatial target regions while keeping their gaze fixated at the center. The activated regions were first located and thereafter the subjects were given real-time feedback based on the activity in these regions. All subjects managed to regulate local brain areas without training, which suggests that visuospatial attention is a promising new target for intracranial BCI. ECoG data recorded from one epilepsy patient showed that local changes in gamma-power can be used to separate the three classes.

[1]  Michael Erb,et al.  Physiological self-regulation of regional brain activity using real-time functional magnetic resonance imaging (fMRI): methodology and exemplary data , 2003, NeuroImage.

[2]  Epifanio Bagarinao,et al.  Estimation of general linear model coefficients for real-time application , 2003, NeuroImage.

[3]  Erich E. Sutter,et al.  The brain response interface: communication through visually-induced electrical brain responses , 1992 .

[4]  B. Fischer,et al.  Visual field representations and locations of visual areas V1/2/3 in human visual cortex. , 2003, Journal of vision.

[5]  G. Pfurtscheller,et al.  Graz brain-computer interface II: towards communication between humans and computers based on online classification of three different EEG patterns , 1996, Medical and Biological Engineering and Computing.

[6]  R. Dolan,et al.  Attentional load and sensory competition in human vision: modulation of fMRI responses by load at fixation during task-irrelevant stimulation in the peripheral visual field. , 2005, Cerebral cortex.

[7]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[8]  G. Pfurtscheller,et al.  How many people are able to operate an EEG-based brain-computer interface (BCI)? , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[9]  B. Allison,et al.  BCI Demographics: How Many (and What Kinds of) People Can Use an SSVEP BCI? , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  N. Birbaumer,et al.  Brain–computer interfaces and communication in paralysis: Extinction of goal directed thinking in completely paralysed patients? , 2008, Clinical Neurophysiology.

[11]  Nicholas G. Hatsopoulos,et al.  Brain-machine interface: Instant neural control of a movement signal , 2002, Nature.

[12]  Rajesh P. N. Rao,et al.  Generalized Features for Electrocorticographic BCIs , 2008, IEEE Transactions on Biomedical Engineering.

[13]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[14]  Leslie G. Ungerleider,et al.  Mechanisms of directed attention in the human extrastriate cortex as revealed by functional MRI. , 1998, Science.

[15]  O. Bertrand,et al.  Relationship between task‐related gamma oscillations and BOLD signal: New insights from combined fMRI and intracranial EEG , 2007, Human brain mapping.

[16]  Bernhard Graimann,et al.  Toward a direct brain interface based on human subdural recordings and wavelet-packet analysis , 2004, IEEE Transactions on Biomedical Engineering.

[17]  M. A. Lopez-Gordo,et al.  Customized stimulation enhances performance of independent binary SSVEP-BCIs , 2011, Clinical Neurophysiology.

[18]  R. DeCharms Applications of real-time fMRI , 2008, Nature Reviews Neuroscience.

[19]  N. Ramsey,et al.  Neurophysiologic correlates of fMRI in human motor cortex , 2012, Human brain mapping.

[20]  Leslie G. Ungerleider,et al.  Neuroimaging Studies of Attention: From Modulation of Sensory Processing to Top-Down Control , 2003, The Journal of Neuroscience.

[21]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[22]  Peter G. Morris,et al.  fMRI at 1.5, 3 and 7 T: Characterising BOLD signal changes , 2009, NeuroImage.

[23]  Simon P. Kelly,et al.  Visual spatial attention control in an independent brain-computer interface , 2005, IEEE Transactions on Biomedical Engineering.

[24]  D. Somers,et al.  Functional MRI reveals spatially specific attentional modulation in human primary visual cortex. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[25]  Jose C. Principe,et al.  Extraction and localization of mesoscopic motor control signals for human ECoG neuroprosthetics , 2008, Journal of Neuroscience Methods.

[26]  N. Ramsey,et al.  Towards human BCI applications based on cognitive brain systems: an investigation of neural signals recorded from the dorsolateral prefrontal cortex , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[27]  L. Cohen,et al.  Brain–computer interfaces: communication and restoration of movement in paralysis , 2007, The Journal of physiology.

[28]  Brendan Z. Allison,et al.  Could Anyone Use a BCI? , 2010, Brain-Computer Interfaces.

[29]  N. Birbaumer,et al.  fMRI Brain-Computer Interfaces , 2008, IEEE Signal Processing Magazine.

[30]  Notger G. Müller,et al.  Attention-modulated activity in visual cortex—More than a simple ‘spotlight’ , 2008, NeuroImage.

[31]  John D E Gabrieli,et al.  Control over brain activation and pain learned by using real-time functional MRI. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[32]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[33]  A. Kleinschmidt,et al.  The attentional field has a Mexican hat distribution , 2005, Vision Research.

[34]  Gerwin Schalk,et al.  A brain–computer interface using electrocorticographic signals in humans , 2004, Journal of neural engineering.

[35]  E. Sellers,et al.  How many people are able to control a P300-based brain–computer interface (BCI)? , 2009, Neuroscience Letters.

[36]  Josien P. W. Pluim,et al.  Evaluation of Optimization Methods for Nonrigid Medical Image Registration Using Mutual Information and B-Splines , 2007, IEEE Transactions on Image Processing.

[37]  James W. Lewis,et al.  The Topography of Visuospatial Attention as Revealed by a Novel Visual Field Mapping Technique , 2009, Journal of Cognitive Neuroscience.

[38]  Gerwin Schalk,et al.  Brain–computer interfacing based on cognitive control , 2010, Annals of neurology.

[39]  E. DeYoe,et al.  A physiological correlate of the 'spotlight' of visual attention , 1999, Nature Neuroscience.

[40]  Soo-Young Lee,et al.  Brain–computer interface using fMRI: spatial navigation by thoughts , 2004, Neuroreport.

[41]  J. Duyn,et al.  Investigation of Low Frequency Drift in fMRI Signal , 1999, NeuroImage.

[42]  Miguel A. L. Nicolelis,et al.  Brain–machine interfaces to restore motor function and probe neural circuits , 2003, Nature Reviews Neuroscience.

[43]  Mika P. Tarvainen,et al.  An advanced detrending method with application to HRV analysis , 2002, IEEE Transactions on Biomedical Engineering.

[44]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[45]  J. Selhorst,et al.  "Locked-in" syndrome. , 1987, Stroke.

[46]  Tobias Moench,et al.  Real-time classification of activated brain areas for fMRI-based human-brain-interfaces , 2008, SPIE Medical Imaging.

[47]  E. Donchin,et al.  A P300-based brain–computer interface: Initial tests by ALS patients , 2006, Clinical Neurophysiology.

[48]  Alan C. Evans,et al.  A new anatomical landmark for reliable identification of human area V5/MT: a quantitative analysis of sulcal patterning. , 2000, Cerebral cortex.

[49]  David J Heeger,et al.  Neural correlates of sustained spatial attention in human early visual cortex. , 2007, Journal of neurophysiology.

[50]  John J. Foxe,et al.  Independent Brain Computer Interface Control using Visual Spatial Attention-Dependent Modulations of Parieto-occipital Alpha , 2005, Conference Proceedings. 2nd International IEEE EMBS Conference on Neural Engineering, 2005..

[51]  Touradj Ebrahimi,et al.  An efficient P300-based brain–computer interface for disabled subjects , 2008, Journal of Neuroscience Methods.

[52]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[53]  Robert R. Hoffman,et al.  Influencing versus Informing Design, Part 1: A Gap Analysis , 2008, IEEE Intelligent Systems.

[54]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[55]  E. Knudsen Fundamental components of attention. , 2007, Annual review of neuroscience.

[56]  Edgar A. DeYoe,et al.  I know where you are secretly attending! The topography of human visual attention revealed with fMRI , 2009, Vision Research.

[57]  Biyu J. He,et al.  Electrophysiological correlates of the brain's intrinsic large-scale functional architecture , 2008, Proceedings of the National Academy of Sciences.

[58]  B. Wandell,et al.  Visual Field Maps in Human Cortex , 2007, Neuron.

[59]  Tom Heskes,et al.  Selecting features for BCI control based on a covert spatial attention paradigm , 2009, Neural Networks.

[60]  G Pfurtscheller,et al.  EEG-based communication: improved accuracy by response verification. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[61]  Klaus-Robert Müller,et al.  Neurophysiological predictor of SMR-based BCI performance , 2010, NeuroImage.

[62]  Linda V. Heinemann,et al.  Exploring BOLD Changes during Spatial Attention in Non-Stimulated Visual Cortex , 2009, PloS one.

[63]  G Pfurtscheller,et al.  Toward a hybrid brain–computer interface based on imagined movement and visual attention , 2010, Journal of neural engineering.