Optimizing fMRI experimental design for MVPA-based BCI control: Combining the strengths of block and event-related designs

&NA; Functional Magnetic Resonance Imaging (fMRI) has been successfully used for Brain Computer Interfacing (BCI) to classify (imagined) movements of different limbs. However, reliable classification of more subtle signals originating from co‐localized neural networks in the sensorimotor cortex, e.g. individual movements of fingers of the same hand, has proved to be more challenging, especially when taking into account the requirement for high single trial reliability in the BCI context. In recent years, Multi Voxel Pattern Analysis (MVPA) has gained momentum as a suitable method to disclose such weak, distributed activation patterns. Much attention has been devoted to developing and validating data analysis strategies, but relatively little guidance is available on the choice of experimental design, even less so in the context of BCI‐MVPA. When applicable, block designs are considered the safest choice, but the expectations, strategies and adaptation induced by blocking of similar trials can make it a sub‐optimal strategy. Fast event‐related designs, in contrast, require a more complicated analysis and show stronger dependence on linearity assumptions but allow for randomly alternating trials. However, they lack resting intervals that enable the BCI participant to process feedback. In this proof‐of‐concept paper a hybrid blocked fast‐event related design is introduced that is novel in the context of MVPA and BCI experiments, and that might overcome these issues by combining the rest periods of the block design with the shorter and randomly alternating trial characteristics of a rapid event‐related design. A well‐established button‐press experiment was used to perform a within‐subject comparison of the proposed design with a block and a slow event‐related design. The proposed hybrid blocked fast‐event related design showed a decoding accuracy that was close to that of the block design, which showed highest accuracy. It allowed for across‐design decoding, i.e. reliable prediction of examples obtained with another design. Finally, it also showed the most stable incremental decoding results, obtaining good performance with relatively few blocks. Our findings suggest that the blocked fast event‐related design could be a viable alternative to block designs in the context of BCI‐MVPA, when expectations, strategies and adaptation make blocking of trials of the same type a sub‐optimal strategy. Additionally, the blocked fast event‐related design is also suitable for applications in which fast incremental decoding is desired, and enables the use of a slow or block design during the test phase.

[1]  N. Schiff,et al.  Dissociations between behavioural and functional magnetic resonance imaging-based evaluations of cognitive function after brain injury. , 2011, Brain : a journal of neurology.

[2]  M. Boly,et al.  Willful modulation of brain activity in disorders of consciousness. , 2010, The New England journal of medicine.

[3]  J. Kruschke Doing Bayesian Data Analysis , 2010 .

[4]  S. R. Searle,et al.  Generalized, Linear, and Mixed Models , 2005 .

[5]  R. Buckner,et al.  Dissociating State and Item Components of Recognition Memory Using fMRI , 2001, NeuroImage.

[6]  J. Haynes A Primer on Pattern-Based Approaches to fMRI: Principles, Pitfalls, and Perspectives , 2015, Neuron.

[7]  J. A. Frost,et al.  Somatotopic mapping of the human primary motor cortex with functional magnetic resonance imaging , 1995, Neurology.

[8]  Dagmar Zeithamova,et al.  Trial timing and pattern-information analyses of fMRI data , 2017, NeuroImage.

[9]  R. Goebel,et al.  A Real-Time fMRI-Based Spelling Device Immediately Enabling Robust Motor-Independent Communication , 2012, Current Biology.

[10]  A. Schwartz,et al.  High-performance neuroprosthetic control by an individual with tetraplegia , 2013, The Lancet.

[11]  Janaina Mourão Miranda,et al.  The impact of temporal compression and space selection on SVM analysis of single-subject and multi-subject fMRI data , 2006, NeuroImage.

[12]  Rainer Goebel,et al.  Analysis of functional image analysis contest (FIAC) data with brainvoyager QX: From single‐subject to cortically aligned group general linear model analysis and self‐organizing group independent component analysis , 2006, Human brain mapping.

[13]  C. A. Ruf,et al.  Brain communication in a completely locked-in patient using bedside near-infrared spectroscopy , 2014, Neurology.

[14]  N. Kriegeskorte,et al.  Revealing representational content with pattern-information fMRI--an introductory guide. , 2009, Social cognitive and affective neuroscience.

[15]  Geoffrey M. Boynton,et al.  Efficient Design of Event-Related fMRI Experiments Using M-Sequences , 2002, NeuroImage.

[16]  Masashi Kiguchi,et al.  A Communication Means for Totally Locked-in ALS Patients Based on Changes in Cerebral Blood Volume Measured with Near-Infrared Light , 2007, IEICE Trans. Inf. Syst..

[17]  G. Boynton,et al.  Adaptation: from single cells to BOLD signals , 2006, Trends in Neurosciences.

[18]  Randy L. Buckner,et al.  Mixed blocked/event-related designs separate transient and sustained activity in fMRI , 2003, NeuroImage.

[19]  Russell A. Poldrack,et al.  Deconvolving BOLD activation in event-related designs for multivoxel pattern classification analyses , 2012, NeuroImage.

[20]  Guohua Shen,et al.  Decoding the individual finger movements from single‐trial functional magnetic resonance imaging recordings of human brain activity , 2014, The European journal of neuroscience.

[21]  Russell Thompson,et al.  Vascular contributions to pattern analysis: Comparing gradient and spin echo fMRI at 3T , 2011, NeuroImage.

[22]  J. Diedrichsen,et al.  Hand use predicts the structure of representations in sensorimotor cortex , 2015, Nature Neuroscience.

[23]  Bettina Sorger,et al.  Another kind of 'BOLD Response': answering multiple-choice questions via online decoded single-trial brain signals. , 2009, Progress in brain research.

[24]  John-Dylan Haynes,et al.  Valid population inference for information-based imaging: From the second-level t-test to prevalence inference , 2015, NeuroImage.

[25]  R. Goebel,et al.  Brain–computer interfaces for communication with nonresponsive patients , 2012, Annals of neurology.

[26]  Karl J. Friston,et al.  Multisubject fMRI Studies and Conjunction Analyses , 1999, NeuroImage.

[27]  Bin Xia,et al.  Brain–Computer Interface–Based Communication in the Completely Locked-In State , 2017, GBCIC.

[28]  Rainer Goebel,et al.  Measuring structural–functional correspondence: Spatial variability of specialised brain regions after macro-anatomical alignment , 2012, NeuroImage.

[29]  Rainer Goebel,et al.  Combining multivariate voxel selection and support vector machines for mapping and classification of fMRI spatial patterns , 2008, NeuroImage.

[30]  J. Donoghue,et al.  Shared neural substrates controlling hand movements in human motor cortex. , 1995, Science.

[31]  Paul E. Downing,et al.  A comparison of volume-based and surface-based multi-voxel pattern analysis , 2011, NeuroImage.

[32]  Bettina Sorger,et al.  When the Brain Takes ‘BOLD’ Steps: Real-Time fMRI Neurofeedback Can Further Enhance the Ability to Gradually Self-regulate Regional Brain Activation , 2016, Neuroscience.

[33]  Soo-Young Lee,et al.  Brain–computer interface using fMRI: spatial navigation by thoughts , 2004, Neuroreport.

[34]  Rainer Goebel,et al.  An Efficient Algorithm for Topologically Correct Segmentation of the Cortical Sheet in Anatomical MR Volumes , 2001, NeuroImage.

[35]  J.P. Donoghue,et al.  BCI meeting 2005-workshop on clinical issues and applications , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[36]  DesignsWilliam J. Martin Mixed Block , 1998 .

[37]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[38]  David B. Dunson,et al.  Bayesian Data Analysis , 2010 .

[39]  Karl J. Friston,et al.  The physiological basis of attentional modulation in extrastriate visual areas , 1999, Nature Neuroscience.

[40]  Giancarlo Valente,et al.  Multivariate analysis of fMRI time series: classification and regression of brain responses using machine learning. , 2008, Magnetic resonance imaging.

[41]  Sayan Mukherjee,et al.  Permutation Tests for Classification , 2005, COLT.

[42]  Xiaoping P. Hu,et al.  Real‐time fMRI using brain‐state classification , 2007, Human brain mapping.

[43]  Mathijs Raemaekers,et al.  Give Me a Sign: Decoding Complex Coordinated Hand Movements Using High-Field fMRI , 2013, Brain Topography.

[44]  C. Tane Akamatsu Give Me a Sign , 2007 .

[45]  A. Owen,et al.  Making every word count for nonresponsive patients. , 2013, JAMA neurology.

[46]  E. Halgren,et al.  Motor-cortical activity in tetraplegics , 2001, Nature.

[47]  Yi Chen,et al.  Statistical inference and multiple testing correction in classification-based multi-voxel pattern analysis (MVPA): Random permutations and cluster size control , 2011, NeuroImage.

[48]  Robin C. Ashmore,et al.  An Electrocorticographic Brain Interface in an Individual with Tetraplegia , 2013, PloS one.

[49]  Tom M. Mitchell,et al.  Machine learning classifiers and fMRI: A tutorial overview , 2009, NeuroImage.

[51]  Bettina Sorger,et al.  Yes or no? - Binary brain-based Communication utilizing motor imagery and fNIRS , 2017, GBCIC.

[52]  Joachim M. Buhmann,et al.  Bayesian mixed-effects inference on classification performance in hierarchical data sets , 2012, J. Mach. Learn. Res..

[53]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[54]  Michael Eickenberg,et al.  Data-driven HRF estimation for encoding and decoding models , 2014, NeuroImage.

[55]  Russell A. Poldrack,et al.  Spatiotemporal activity estimation for multivoxel pattern analysis with rapid event-related designs , 2012, NeuroImage.

[56]  Sean M. Polyn,et al.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data , 2006, Trends in Cognitive Sciences.

[57]  Jeff H. Duyn,et al.  Hemodynamic nonlinearities affect BOLD fMRI response timing and amplitude , 2009, NeuroImage.

[58]  Russell A. Poldrack,et al.  The impact of study design on pattern estimation for single-trial multivariate pattern analysis , 2014, NeuroImage.

[59]  H. Alkadhi,et al.  Localization of the motor hand area to a knob on the precentral gyrus. A new landmark. , 1997, Brain : a journal of neurology.

[60]  André J. Szameitat,et al.  Cortical activation during executed, imagined, observed, and passive wrist movements in healthy volunteers and stroke patients , 2012, NeuroImage.

[61]  I Berry,et al.  Virtual Movements Activate Primary Sensorimotor Areas in Amputees: Report of Three Cases , 2001, Neurosurgery.

[62]  F. Jolesz,et al.  Brain–machine interface via real-time fMRI: Preliminary study on thought-controlled robotic arm , 2009, Neuroscience Letters.

[63]  Klaus-Robert Müller,et al.  Introduction to machine learning for brain imaging , 2011, NeuroImage.

[64]  Rhodri Cusack,et al.  The Brain's Silent Messenger: Using Selective Attention to Decode Human Thought for Brain-Based Communication , 2013, The Journal of Neuroscience.

[65]  Michael-Paul Schallmo,et al.  Selective BOLD responses to individual finger movement measured with fMRI at 3T , 2012, Human brain mapping.

[66]  Paul E. Summers,et al.  Preservation of motor programs in paraplegics as demonstrated by attempted and imagined foot movements , 2008, NeuroImage.

[67]  Steven E. Petersen,et al.  The mixed block/event-related design , 2012, NeuroImage.