Experimental and Computational Study on Motor Control and Recovery After Stroke: Toward a Constructive Loop Between Experimental and Virtual Embodied Neuroscience

Being able to replicate real experiments with computational simulations is a unique opportunity to refine and validate models with experimental data and redesign the experiments based on simulations. However, since it is technically demanding to model all components of an experiment, traditional approaches to modeling reduce the experimental setups as much as possible. In this study, our goal is to replicate all the relevant features of an experiment on motor control and motor rehabilitation after stroke. To this aim, we propose an approach that allows continuous integration of new experimental data into a computational modeling framework. First, results show that we could reproduce experimental object displacement with high accuracy via the simulated embodiment in the virtual world by feeding a spinal cord model with experimental registration of the cortical activity. Second, by using computational models of multiple granularities, our preliminary results show the possibility of simulating several features of the brain after stroke, from the local alteration in neuronal activity to long-range connectivity remodeling. Finally, strategies are proposed to merge the two pipelines. We further suggest that additional models could be integrated into the framework thanks to the versatility of the proposed approach, thus allowing many researchers to achieve continuously improved experimental design.

[1]  Monika Harvey,et al.  Tribute to Glyn W. Humphreys, 1954–2016 , 2018, Cortex.

[2]  Silvestro Micera,et al.  Boosting generalized recovery by combined optogenetic stimulation and training after stroke , 2020, bioRxiv.

[3]  Anthony R. McIntosh,et al.  The Virtual Brain: Modeling Biological Correlates of Recovery after Chronic Stroke , 2015, Front. Neurol..

[4]  Jiwei He,et al.  Perturbation of Brain Oscillations after Ischemic Stroke: A Potential Biomarker for Post-Stroke Function and Therapy , 2015, International journal of molecular sciences.

[5]  Andreas Spiegler,et al.  Heterogeneity of time delays determines synchronization of coupled oscillators. , 2016, Physical review. E.

[6]  Joachim Gross,et al.  Perilesional pathological oscillatory activity in the magnetoencephalogram of patients with cortical brain lesions , 2004, Neuroscience Letters.

[7]  Anthony R. McIntosh,et al.  Functional Mechanisms of Recovery after Chronic Stroke: Modeling with the Virtual Brain123 , 2016, eNeuro.

[8]  Rüdiger Dillmann,et al.  Connecting Artificial Brains to Robots in a Comprehensive Simulation Framework: The Neurorobotics Platform , 2017, Front. Neurorobot..

[9]  Stefan R. Pulver,et al.  Ultra-sensitive fluorescent proteins for imaging neuronal activity , 2013, Nature.

[10]  Stefan Ulbrich,et al.  A Framework for Coupled Simulations of Robots and Spiking Neuronal Networks , 2016, J. Intell. Robotic Syst..

[11]  R. N. Lemon,et al.  An electron microscopic examination of the corticospinal projection to the cervical spinal cord in the rat: lack of evidence for cortico-motoneuronal synapses , 2003, Experimental Brain Research.

[12]  G. Deco,et al.  Ongoing Cortical Activity at Rest: Criticality, Multistability, and Ghost Attractors , 2012, The Journal of Neuroscience.

[13]  Niels Birbaumer,et al.  Movement related slow cortical potentials in severely paralyzed chronic stroke patients , 2015, Front. Hum. Neurosci..

[14]  Marian Joëls,et al.  Transient Prepubertal Mifepristone Treatment Normalizes Deficits in Contextual Memory and Neuronal Activity of Adult Male Rats Exposed to Maternal Deprivation , 2017, eNeuro.

[15]  Bard Ermentrout,et al.  Linearization of F-I Curves by Adaptation , 1998, Neural Computation.

[16]  Gustavo Deco,et al.  Cognitive performance in healthy older adults relates to spontaneous switching between states of functional connectivity during rest , 2017, Scientific Reports.

[17]  Morten L. Kringelbach,et al.  Modeling the outcome of structural disconnection on resting-state functional connectivity , 2012, NeuroImage.

[18]  Matthew Millard,et al.  Flexing computational muscle: modeling and simulation of musculotendon dynamics. , 2013, Journal of biomechanical engineering.

[19]  A. Destexhe,et al.  Enhanced Responsiveness and Low-Level Awareness in Stochastic Network States , 2017, Neuron.

[20]  Rogério Rodrigues Lima Cisi,et al.  Simulation system of spinal cord motor nuclei and associated nerves and muscles, in a Web-based architecture , 2008, Journal of Computational Neuroscience.

[21]  G. Deco,et al.  Emerging concepts for the dynamical organization of resting-state activity in the brain , 2010, Nature Reviews Neuroscience.

[22]  Viktor Jirsa,et al.  Individual structural features constrain the mouse functional connectome , 2019, Proceedings of the National Academy of Sciences.

[23]  Maurizio Corbetta,et al.  Resting-State Temporal Synchronization Networks Emerge from Connectivity Topology and Heterogeneity , 2015, PLoS Comput. Biol..

[24]  R. Traub Simulation of intrinsic bursting in CA3 hippocampal neurons , 1982, Neuroscience.

[25]  J. Valls-Solé The circuitry of the human spinal cord: Its role in motor control and movement disorders Pierrot-Deseilligny E, Burke D, editors. Hardback. Cambridge University Press; 2005. 642 p. [ISBN: 13978052182581]. , 2008, Clinical Neurophysiology.

[26]  David A. Abbink,et al.  A rigorous model of reflex function indicates that position and force feedback are flexibly tuned to position and force tasks , 2009, Experimental Brain Research.

[27]  Trygve B Leergaard,et al.  Spatial registration of serial microscopic brain images to three-dimensional reference atlases with the QuickNII tool , 2019, PloS one.

[28]  G. Loeb,et al.  Mathematical models of proprioceptors. I. Control and transduction in the muscle spindle. , 2006, Journal of neurophysiology.

[29]  Maurizio Corbetta,et al.  Linking Entropy at Rest with the Underlying Structural Connectivity in the Healthy and Lesioned Brain , 2018, Cerebral cortex.

[30]  Gustavo Deco,et al.  Role of local network oscillations in resting-state functional connectivity , 2011, NeuroImage.

[31]  Robert W. Batterman,et al.  Minimal Model Explanations , 2014, Philosophy of Science.

[32]  Ludovico Silvestri,et al.  Towards a comprehensive understanding of brain machinery by correlative microscopy , 2015, Journal of biomedical optics.

[33]  Christine Grienberger,et al.  Imaging Calcium in Neurons , 2012, Neuron.

[34]  Frans C. T. van der Helm,et al.  Analysis of reflex modulation with a biologically realistic neural network , 2007, Journal of Computational Neuroscience.

[35]  Andreas Spiegler,et al.  Selective Activation of Resting-State Networks following Focal Stimulation in a Connectome-Based Network Model of the Human Brain , 2016, eNeuro.

[36]  Steve M. Potter,et al.  Closed-loop neuroscience and neuroengineering , 2014, Front. Neural Circuits.

[37]  Andrew W. Kraft,et al.  Functional connectivity structure of cortical calcium dynamics in anesthetized and awake mice , 2017, PloS one.

[38]  G. B. Young,et al.  Continuous EEG monitoring in the intensive care unit. , 2017, Handbook of clinical neurology.

[39]  Ann M. Stowe,et al.  Extensive Cortical Rewiring after Brain Injury , 2005, The Journal of Neuroscience.

[40]  Christoph Zrenner,et al.  Closed-Loop Neuroscience and Non-Invasive Brain Stimulation: A Tale of Two Loops , 2016, Front. Cell. Neurosci..

[41]  Silvestro Micera,et al.  Boosting generalized recovery by combined optogenetic stimulation and training after stroke , 2020, bioRxiv.

[42]  Sergio Martinoia,et al.  Modular Neuronal Assemblies Embodied in a Closed-Loop Environment: Toward Future Integration of Brains and Machines , 2012, Front. Neural Circuits.

[43]  Wulfram Gerstner,et al.  Adaptive exponential integrate-and-fire model as an effective description of neuronal activity. , 2005, Journal of neurophysiology.

[44]  M. Chesselet,et al.  Synchronous Neuronal Activity Is a Signal for Axonal Sprouting after Cortical Lesions in the Adult , 2002, The Journal of Neuroscience.

[45]  F. Varela,et al.  Measuring phase synchrony in brain signals , 1999, Human brain mapping.

[46]  Gustavo Deco,et al.  The dynamics of resting fluctuations in the brain: metastability and its dynamical cortical core , 2016, bioRxiv.

[47]  Marc-Oliver Gewaltig,et al.  NEST (NEural Simulation Tool) , 2007, Scholarpedia.

[48]  Viktor K. Jirsa,et al.  The Virtual Brain: a simulator of primate brain network dynamics , 2013, Front. Neuroinform..

[49]  A Stefanovska,et al.  Characterizing an ensemble of interacting oscillators: the mean-field variability index. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[50]  James G. King,et al.  Reconstruction and Simulation of Neocortical Microcircuitry , 2015, Cell.

[51]  T. Murphy,et al.  Mesoscale Mapping of Mouse Cortex Reveals Frequency-Dependent Cycling between Distinct Macroscale Functional Modules , 2017, The Journal of Neuroscience.

[52]  Pierre Yger,et al.  PyNN: A Common Interface for Neuronal Network Simulators , 2008, Front. Neuroinform..

[53]  Stefan Ulbrich,et al.  A Domain-Specific Language (DSL) for Integrating Neuronal Networks in Robot Control , 2015 .

[54]  Byron M. Yu,et al.  A high-performance brain–computer interface , 2006, Nature.

[55]  S. Carmichael,et al.  Molecular, cellular and functional events in axonal sprouting after stroke , 2017, Experimental Neurology.

[56]  Marcello Massimini,et al.  Shaping the Default Activity Pattern of the Cortical Network , 2017, Neuron.

[57]  Silvestro Micera,et al.  A Robotic System for Adaptive Training and Function Assessment of Forelimb Retraction in Mice , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[58]  Ferdinando A. Mussa-Ivaldi,et al.  Connecting Brains to Robots: An Artificial Body for Studying the Computational Properties of Neural Tissues , 2000, Artificial Life.

[59]  Mikael Djurfeldt,et al.  Closed Loop Interactions between Spiking Neural Network and Robotic Simulators Based on MUSIC and ROS , 2016, Front. Neuroinform..

[60]  R. Nudo Recovery after brain injury: mechanisms and principles , 2013, Front. Hum. Neurosci..

[61]  Cori Bargmann,et al.  Microfluidics for in vivo imaging of neuronal and behavioral activity in Caenorhabditis elegans , 2007, Nature Methods.

[62]  Yanhua Hu,et al.  Transdifferentiated Human Vascular Smooth Muscle Cells are a New Potential Cell Source for Endothelial Regeneration , 2017, Scientific Reports.

[63]  Karl J. Friston,et al.  Degeneracy and cognitive anatomy , 2002, Trends in Cognitive Sciences.

[64]  Mark P. Richardson,et al.  Dynamics on Networks: The Role of Local Dynamics and Global Networks on the Emergence of Hypersynchronous Neural Activity , 2014, PLoS Comput. Biol..

[65]  S. Micera,et al.  A Robotic System for Quantitative Assessment and Poststroke Training of Forelimb Retraction in Mice , 2014, Neurorehabilitation and neural repair.

[66]  S. Micera,et al.  Combining robotic training and inactivation of the healthy hemisphere restores pre-stroke motor patterns in mice , 2017, eLife.

[67]  Xiao-Jing Wang,et al.  A Recurrent Network Mechanism of Time Integration in Perceptual Decisions , 2006, The Journal of Neuroscience.

[68]  T. Murphy,et al.  Extensive Turnover of Dendritic Spines and Vascular Remodeling in Cortical Tissues Recovering from Stroke , 2007, The Journal of Neuroscience.

[69]  Viktor K. Jirsa,et al.  Fast–Slow Bursters in the Unfolding of a High Codimension Singularity and the Ultra-slow Transitions of Classes , 2016, The Journal of Mathematical Neuroscience.

[70]  Maurizio Corbetta,et al.  On the low dimensionality of behavioral deficits and alterations of brain network connectivity after focal injury , 2018, Cortex.

[71]  Stefan J. Kiebel,et al.  Inferring Neuronal Dynamics from Calcium Imaging Data Using Biophysical Models and Bayesian Inference , 2016, PLoS Comput. Biol..

[72]  Karl J. Friston,et al.  The Dynamic Brain: From Spiking Neurons to Neural Masses and Cortical Fields , 2008, PLoS Comput. Biol..

[73]  Viktor K. Jirsa,et al.  Phase-lags in large scale brain synchronization: Methodological considerations and in-silico analysis , 2018, PLoS Comput. Biol..

[74]  S. Micera,et al.  Mechanisms Underlying the Neuromodulation of Spinal Circuits for Correcting Gait and Balance Deficits after Spinal Cord Injury , 2016, Neuron.

[75]  Jürgen Kurths,et al.  Synchronization - A Universal Concept in Nonlinear Sciences , 2001, Cambridge Nonlinear Science Series.

[76]  Viktor K. Jirsa,et al.  Noise during Rest Enables the Exploration of the Brain's Dynamic Repertoire , 2008, PLoS Comput. Biol..

[77]  Cecilia Laschi,et al.  Proprioceptive Feedback through a Neuromorphic Muscle Spindle Model , 2017, Front. Neurosci..

[78]  J. Cowan,et al.  Excitatory and inhibitory interactions in localized populations of model neurons. , 1972, Biophysical journal.

[79]  S. Panzeri,et al.  An inhibitory gate for state transition in cortex , 2017, eLife.

[80]  Lin Tian,et al.  Functional imaging of hippocampal place cells at cellular resolution during virtual navigation , 2010, Nature Neuroscience.

[81]  Carl D. Hacker,et al.  Decreased integration and information capacity in stroke measured by whole brain models of resting state activity , 2017, Brain : a journal of neurology.

[82]  A. L. Allegra Mascaro,et al.  Combined Rehabilitation Promotes the Recovery of Structural and Functional Features of Healthy Neuronal Networks after Stroke. , 2019, Cell reports.

[83]  Daniel A. Wagenaar,et al.  The Neurally Controlled Animat: Biological Brains Acting with Simulated Bodies , 2001, Auton. Robots.

[84]  David P. Bashor,et al.  A large-scale model of some spinal reflex circuits , 1998, Biological Cybernetics.

[85]  Michael B. Reiser,et al.  Real neuroscience in virtual worlds , 2012, Current Opinion in Neurobiology.

[86]  Aneta Stefanovska,et al.  Alterations in the coupling functions between cortical and cardio-respiratory oscillations due to anaesthesia with propofol and sevoflurane , 2016, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[87]  George Paxinos,et al.  The Mouse Brain in Stereotaxic Coordinates , 2001 .

[88]  Karl Herrup,et al.  Neurons in vulnerable regions of the Alzheimer ' s disease brain display reduced 1 ATM signaling 2 Abbreviated title : Loss of ATM function in Alzheimer ' s disease 3 , 2016 .

[89]  Francesco Saverio Pavone,et al.  Large Scale Double-Path Illumination System with Split Field of View for the All-Optical Study of Inter-and Intra-Hemispheric Functional Connectivity on Mice , 2019, Methods and protocols.

[90]  Sergio Martinoia,et al.  A simulated neuro-robotic environment for bi-directional closed-loop experiments , 2010, Paladyn J. Behav. Robotics.

[91]  Viktor K. Jirsa,et al.  Transmission time delays organize the brain network synchronization , 2019, Philosophical Transactions of the Royal Society A.

[92]  Dipanjan Roy,et al.  Phase description of spiking neuron networks with global electric and synaptic coupling. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[93]  Brenda C. Shields,et al.  Thy1-GCaMP6 Transgenic Mice for Neuronal Population Imaging In Vivo , 2014, PloS one.

[94]  Heidi Johansen-Berg,et al.  Using diffusion imaging to study human connectional anatomy. , 2009, Annual review of neuroscience.

[95]  Alain Destexhe,et al.  Self-sustained Asynchronous Irregular States and Up–down States in Thalamic, Cortical and Thalamocortical Networks of Nonlinear Integrate-and-fire Neurons , 2022 .

[96]  Viktor K. Jirsa,et al.  A Low Dimensional Description of Globally Coupled Heterogeneous Neural Networks of Excitatory and Inhibitory Neurons , 2008, PLoS Comput. Biol..

[97]  L. Ng,et al.  The Allen Mouse Brain Common Coordinate Framework: A 3D Reference Atlas , 2020, Cell.

[98]  Yoshihiko Nakamura,et al.  Modeling and Identification of a Realistic Spiking Neural Network and Musculoskeletal Model of the Human Arm, and an Application to the Stretch Reflex , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[99]  Andrew Howard,et al.  Design and use paradigms for Gazebo, an open-source multi-robot simulator , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[100]  Christophe Bernard,et al.  The Virtual Mouse Brain: A Computational Neuroinformatics Platform to Study Whole Mouse Brain Dynamics , 2017, eNeuro.

[101]  Gustavo Deco,et al.  Bottom up modeling of the connectome: Linking structure and function in the resting brain and their changes in aging , 2013, NeuroImage.

[102]  Tanuj Gulati,et al.  Low frequency cortical activity is a neuromodulatory target that tracks recovery after stroke , 2018, Nature Medicine.

[103]  G. Loeb,et al.  Mathematical models of proprioceptors. II. Structure and function of the Golgi tendon organ. , 2006, Journal of neurophysiology.

[104]  W. Stacey,et al.  On the nature of seizure dynamics. , 2014, Brain : a journal of neurology.

[105]  Allan R. Jones,et al.  A mesoscale connectome of the mouse brain , 2014, Nature.

[106]  Tomasz Górski,et al.  Cholinergic switch between two different types of slow waves in cerebral cortex , 2018, bioRxiv.

[107]  Viktor K. Jirsa,et al.  Mathematical framework for large-scale brain network modeling in The Virtual Brain , 2015, NeuroImage.

[108]  G. Edelman,et al.  Large-scale model of mammalian thalamocortical systems , 2008, Proceedings of the National Academy of Sciences.

[109]  Michelle Y. Cheng,et al.  Optogenetic modulation in stroke recovery. , 2016, Neurosurgical focus.

[110]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[111]  Michael H. Dickinson,et al.  A modular display system for insect behavioral neuroscience , 2008, Journal of Neuroscience Methods.

[112]  K. Svoboda,et al.  Imaging Calcium Concentration Dynamics in Small Neuronal Compartments , 2004, Science's STKE.

[113]  Karl Deisseroth,et al.  Optogenetic neuronal stimulation promotes functional recovery after stroke , 2014, Proceedings of the National Academy of Sciences.

[114]  O. Sporns,et al.  Key role of coupling, delay, and noise in resting brain fluctuations , 2009, Proceedings of the National Academy of Sciences.

[115]  Jürgen Kurths,et al.  Synchronization: Phase locking and frequency entrainment , 2001 .

[116]  Murray Shanahan,et al.  Effects of lesions on synchrony and metastability in cortical networks , 2015, NeuroImage.

[117]  D. Winter,et al.  Models of recruitment and rate coding organization in motor-unit pools. , 1993, Journal of neurophysiology.

[118]  J. Fetcho,et al.  In Vivo Imaging of Zebrafish Reveals Differences in the Spinal Networks for Escape and Swimming Movements , 2001, The Journal of Neuroscience.

[119]  Vivek Prabhakaran,et al.  Role of the Contralesional vs. Ipsilesional Hemisphere in Stroke Recovery , 2017, Front. Hum. Neurosci..

[120]  Gustavo Deco,et al.  Structure-Function Discrepancy: Inhomogeneity and Delays in Synchronized Neural Networks , 2014, PLoS Comput. Biol..

[121]  Gongcheng Xu,et al.  Alterations in the coupling functions between cerebral oxyhaemoglobin and arterial blood pressure signals in post-stroke subjects , 2018, PloS one.

[122]  Yoshiki Kuramoto,et al.  Chemical Oscillations, Waves, and Turbulence , 1984, Springer Series in Synergetics.

[123]  Tom Misteli,et al.  In vivo imaging. , 2003, Methods.

[124]  Stefan Mihalas,et al.  Synchronization dependent on spatial structures of a mesoscopic whole-brain network , 2019, PLoS Comput. Biol..

[125]  Joelle Zimmermann,et al.  Structural architecture supports functional organization in the human aging brain at a regionwise and network level , 2016, Human brain mapping.

[126]  Olaf Sporns,et al.  Network structure of cerebral cortex shapes functional connectivity on multiple time scales , 2007, Proceedings of the National Academy of Sciences.

[127]  Andreas Daffertshofer,et al.  Generative Models of Cortical Oscillations: Neurobiological Implications of the Kuramoto Model , 2010, Front. Hum. Neurosci..

[128]  E. Izhikevich Phase models with explicit time delays , 1998 .

[129]  Diane Lipscombe,et al.  Neuronal L-Type Calcium Channels Open Quickly and Are Inhibited Slowly , 2005, The Journal of Neuroscience.

[130]  Gemma Lancaster,et al.  Surrogate data for hypothesis testing of physical systems , 2018, Physics Reports.

[131]  A. Stefanovska,et al.  Kuramoto model with time-varying parameters. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.