Robustness, flexibility, and sensitivity in a multifunctional motor control model

Motor systems must adapt to perturbations and changing conditions both within and outside the body. We refer to the ability of a system to maintain performance despite perturbations as “robustness,” and the ability of a system to deploy alternative strategies that improve fitness as “flexibility.” Different classes of pattern-generating circuits yield dynamics with differential sensitivities to perturbations and parameter variation. Depending on the task and the type of perturbation, high sensitivity can either facilitate or hinder robustness and flexibility. Here we explore the role of multiple coexisting oscillatory modes and sensory feedback in allowing multiphasic motor pattern generation to be both robust and flexible. As a concrete example, we focus on a nominal neuromechanical model of triphasic motor patterns in the feeding apparatus of the marine mollusk Aplysia californica. We find that the model can operate within two distinct oscillatory modes and that the system exhibits bistability between the two. In the “heteroclinic mode,” higher sensitivity makes the system more robust to changing mechanical loads, but less robust to internal parameter variations. In the “limit cycle mode,” lower sensitivity makes the system more robust to changes in internal parameter values, but less robust to changes in mechanical load. Finally, we show that overall performance on a variable feeding task is improved when the system can flexibly transition between oscillatory modes in response to the changing demands of the task. Thus, our results suggest that the interplay of sensory feedback and multiple oscillatory modes can allow motor systems to be both robust and flexible in a variable environment.

[1]  Hiroaki Kitano,et al.  Biological robustness , 2008, Nature Reviews Genetics.

[2]  E. Marder,et al.  Understanding circuit dynamics using the stomatogastric nervous system of lobsters and crabs. , 2007, Annual review of physiology.

[3]  R. Beer,et al.  Mechanical reconfiguration mediates swallowing and rejection in Aplysia californica , 2006, Journal of Comparative Physiology A.

[4]  Ramón Huerta,et al.  Dynamical encoding by networks of competing neuron groups: winnerless competition. , 2001 .

[5]  Aleksej F. Filippov,et al.  Differential Equations with Discontinuous Righthand Sides , 1988, Mathematics and Its Applications.

[6]  Jeffrey M. McManus,et al.  An in vitro preparation for eliciting and recording feeding motor programs with physiological movements in Aplysia californica. , 2012, Journal of visualized experiments : JoVE.

[7]  Hillel J. Chiel,et al.  The Brain in Its Body: Motor Control and Sensing in a Biomechanical Context , 2009, The Journal of Neuroscience.

[8]  Y. Arshavsky,et al.  Dual sensory-motor function for a molluskan statocyst network. , 2004, Journal of neurophysiology.

[9]  Randall D. Beer,et al.  The brain has a body: adaptive behavior emerges from interactions of nervous system, body and environment , 1997, Trends in Neurosciences.

[10]  T I Tóth,et al.  A neuromechanical model explaining forward and backward stepping in the stick insect. , 2012, Journal of neurophysiology.

[11]  Eduardo D. Sontag,et al.  Mathematical Control Theory: Deterministic Finite Dimensional Systems , 1990 .

[12]  V. Volterra Fluctuations in the Abundance of a Species considered Mathematically , 1926, Nature.

[13]  Eduardo D. Sontag,et al.  Mathematical control theory: deterministic finite dimensional systems (2nd ed.) , 1998 .

[14]  H. Chiel,et al.  Neuromechanics of Multifunctionality during Rejection in Aplysia californica , 2006, The Journal of Neuroscience.

[15]  Cornelia M Ulrich,et al.  A mathematical model of glutathione metabolism , 2008, Theoretical Biology and Medical Modelling.

[16]  Pablo Varona,et al.  Heteroclinic Contours in Neural Ensembles and the Winnerless Competition Principle , 2004, Int. J. Bifurc. Chaos.

[17]  Eric R Kandel,et al.  The Biology of Memory: A Forty-Year Perspective , 2009, The Journal of Neuroscience.

[18]  David W. Chestek,et al.  The kinematics of multifunctionality: comparisons of biting and swallowing in Aplysia californica , 2007, Journal of Experimental Biology.

[19]  Roger D. Quinn,et al.  Continuous wave peristaltic motion in a robot , 2012, Int. J. Robotics Res..

[20]  F. Delcomyn The Effect of Limb Amputation on Locomotion in the Cockroach Periplaneta Americana , 1971 .

[21]  J. C. Smith,et al.  Pre-Bötzinger complex: a brainstem region that may generate respiratory rhythm in mammals. , 1991, Science.

[22]  H. Chiel,et al.  Electrode fabrication and implantation in Aplysia californica for multi-channel neural and muscular recordings in intact, freely behaving animals. , 2010, Journal of visualized experiments : JoVE.

[23]  Robert J. Wood,et al.  Robustness of centipede-inspired millirobot locomotion to leg failures , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Y. Arshavsky,et al.  Winnerless competition between sensory neurons generates chaos: A possible mechanism for molluscan hunting behavior. , 2002, Chaos.

[25]  Cornelia M Ulrich,et al.  A Mathematical Model of the Folate Cycle , 2004, Journal of Biological Chemistry.

[26]  Donald C Bolser,et al.  Spatiotemporal regulation of the cough motor pattern , 2009, Cough.

[27]  J. Doyle,et al.  Essentials of Robust Control , 1997 .

[28]  M. Golubitsky,et al.  Symmetry in locomotor central pattern generators and animal gaits , 1999, Nature.

[29]  Randall D. Beer,et al.  Neural control exploits changing mechanical advantage and context dependence to generate different feeding responses in Aplysia , 2004, Biological Cybernetics.

[30]  Jian Jing,et al.  A Proprioceptive Role for an Exteroceptive Mechanoafferent Neuron in Aplysia , 2000, The Journal of Neuroscience.

[31]  I Kupfermann,et al.  Dissociation of the appetitive and consummatory phases of feeding behavior in Aplysia: a lesion study. , 1974, Behavioral biology.

[32]  E. Marder Motor pattern generation , 2000, Current Opinion in Neurobiology.

[33]  David J. W. Simpson Border-Collision Bifurcations in ℝN , 2016, SIAM Rev..

[34]  H Kitano,et al.  The theory of biological robustness and its implication in cancer. , 2007, Ernst Schering Research Foundation workshop.

[35]  R. May,et al.  Nonlinear Aspects of Competition Between Three Species , 1975 .

[36]  J. Hopfield,et al.  From molecular to modular cell biology , 1999, Nature.

[37]  E D Sontag,et al.  Some new directions in control theory inspired by systems biology. , 2004, Systems biology.

[38]  Natasha Loder,et al.  Journal under attack over controversial paper on GM food , 1999, Nature.

[39]  R Huerta,et al.  Dynamical encoding by networks of competing neuron groups: winnerless competition. , 2001, Physical review letters.

[40]  R. Quinn,et al.  Designing responsive pattern generators: stable heteroclinic channel cycles for modeling and control , 2015, Bioinspiration & biomimetics.

[41]  Mitra J. Hartmann,et al.  c ○ 2001 Kluwer Academic Publishers. Manufactured in The Netherlands. Active Sensing Capabilities of the Rat Whisker System , 2022 .

[42]  H. Nijhout,et al.  Theoretical Biology and Medical Modelling Open Access Homeostatic Mechanisms in Dopamine Synthesis and Release: a Mathematical Model , 2022 .

[43]  H. Nijhout,et al.  Escape from homeostasis. , 2014, Mathematical biosciences.

[44]  V. Zhigulin,et al.  On the origin of reproducible sequential activity in neural circuits. , 2004, Chaos.

[45]  Hillel J Chiel,et al.  Efficient worm-like locomotion: slip and control of soft-bodied peristaltic robots , 2013, Bioinspiration & biomimetics.

[46]  Pablo A. Iglesias,et al.  Control Theory and Systems Biology , 2009 .

[47]  Ian Stewart,et al.  Homeostasis, singularities, and networks , 2017, Journal of mathematical biology.

[48]  Youngmin Park Infinitesimal Phase Response Curves for Piecewise Smooth Dynamical Systems , 2013 .

[49]  K. Åström Introduction to Stochastic Control Theory , 1970 .

[50]  Jeffrey P. Gill,et al.  Motor neuronal activity varies least among individuals when it matters most for behavior. , 2015, Journal of neurophysiology.

[51]  José Eduardo Ribeiro Cury,et al.  Systems Biology, Synthetic Biology and Control Theory: A promising golden braid , 2013, Annu. Rev. Control..

[52]  C G Evans,et al.  Diverse synaptic connections between peptidergic radula mechanoafferent neurons and neurons in the feeding system of Aplysia. , 2000, Journal of neurophysiology.

[53]  H. Van Dyke Parunak A Dynamical Systems Perspective on Agent-Based "Going Concerns , 1998 .

[54]  Roger D. Quinn,et al.  A neuromechanical simulation of insect walking and transition to turning of the cockroach Blaberus discoidalis , 2013, Biological Cybernetics.

[55]  G. Ermentrout,et al.  Multiple rhythmic states in a model of the respiratory central pattern generator. , 2009, Journal of neurophysiology.

[56]  Dave Hodgson,et al.  What do you mean, 'resilient'? , 2015, Trends in ecology & evolution.

[57]  Douglas A. Baxter,et al.  EXPERIMENTAL AND COMPUTATIONAL ANALYSES OF A CENTRAL PATTERN GENERATOR UNDERLYING ASPECTS OF FEEDING BEHAVIOUR OF APLYSIA , 1993 .

[58]  H Frederik Nijhout,et al.  Homeostasis and dynamic stability of the phenotype link robustness and plasticity. , 2014, Integrative and comparative biology.

[59]  H. Chiel,et al.  Activity of an identified histaminergic neuron, and its possible role in arousal of feeding behavior in semi-intact Aplysia , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[60]  Jeffrey M. McManus,et al.  Preparing the Periphery for a Subsequent Behavior: Motor Neuronal Activity during Biting Generates Little Force but Prepares a Retractor Muscle to Generate Larger Forces during Swallowing in Aplysia , 2015, The Journal of Neuroscience.

[61]  A. Selverston,et al.  Invertebrate central pattern generator circuits , 2010, Philosophical Transactions of the Royal Society B: Biological Sciences.

[62]  Ben Mitchinson,et al.  Feedback control in active sensing: rat exploratory whisking is modulated by environmental contact , 2007, Proceedings of the Royal Society B: Biological Sciences.

[63]  Jian Jing,et al.  Feeding Neural Networks in the Mollusc Aplysia , 2004, Neurosignals.

[64]  D. Vecchio,et al.  Biomolecular Feedback Systems , 2014 .

[65]  Shouchuan Hu Differential equations with discontinuous right-hand sides☆ , 1991 .

[66]  I Kupfermann,et al.  Functional role of serotonergic neuromodulation in Aplysia. , 1979, Federation proceedings.

[67]  Manu S. Madhav,et al.  Feedback control as a framework for understanding tradeoffs in biology. , 2014, Integrative and comparative biology.

[68]  A. Lesne Robustness: confronting lessons from physics and biology , 2008, Biological reviews of the Cambridge Philosophical Society.

[69]  Youngmin Park,et al.  Phase Resetting in an Asymptotically Phaseless System: On the Phase Response of Limit Cycles Verging on a Heteroclinic Orbit , 2011, SIAM J. Appl. Dyn. Syst..

[70]  Anna M. Lieb,et al.  The biological significance of substrate inhibition: A mechanism with diverse functions , 2010, BioEssays : news and reviews in molecular, cellular and developmental biology.

[71]  Stanley J. Rosenschein,et al.  A dynamical systems perspective on agent-environment interaction , 1996 .

[72]  I. Hurwitz,et al.  Adaptation of Feeding Sequences in Aplysia Oculifera to Changes in the Load and Width of Food , 1992 .

[73]  E. Marder,et al.  Variability, compensation and homeostasis in neuron and network function , 2006, Nature Reviews Neuroscience.

[74]  Hui Lu,et al.  The significance of dynamical architecture for adaptive responses to mechanical loads during rhythmic behavior , 2014, Journal of Computational Neuroscience.

[75]  Daniel E. Koditschek,et al.  Multistable phase regulation for robust steady and transitional legged gaits , 2012, Int. J. Robotics Res..

[76]  G. Odell,et al.  Robustness, Flexibility, and the Role of Lateral Inhibition in the Neurogenic Network , 2002, Current Biology.

[77]  Kevin L. Briggman,et al.  Multifunctional pattern-generating circuits. , 2008, Annual review of neuroscience.

[78]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[79]  J. Bonner Cells, embryos, and evolution: Toward a cellular and developmental understanding of phenotypic variation and evolutionary adaptability , 1998 .

[80]  Ramón Huerta,et al.  Transient Cognitive Dynamics, Metastability, and Decision Making , 2008, PLoS Comput. Biol..

[81]  J. Jing,et al.  Neural Mechanisms of Motor Program Switching inAplysia , 2001, The Journal of Neuroscience.

[82]  Alexander B Neiman,et al.  Robust design of polyrhythmic neural circuits. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[83]  Jonathan E. Rubin,et al.  Conditions for Multi-functionality in a Rhythm Generating Network Inspired by Turtle Scratching , 2015, Journal of mathematical neuroscience.

[84]  John T. Workman,et al.  Optimal Control Applied to Biological Models , 2007 .

[85]  Mark H. A. Davis Piecewise‐Deterministic Markov Processes: A General Class of Non‐Diffusion Stochastic Models , 1984 .

[86]  Jeffrey M. McManus,et al.  Differential activation of an identified motor neuron and neuromodulation provide Aplysia's retractor muscle an additional function. , 2014, Journal of neurophysiology.

[87]  A. Isidori Nonlinear Control Systems , 1985 .

[88]  S. Smale On the differential equations of species in competition , 1976, Journal of mathematical biology.

[89]  J. Simmers,et al.  Behavioral and In Vitro Correlates of Compulsive-Like Food Seeking Induced by Operant Conditioning in Aplysia , 2007, The Journal of Neuroscience.

[90]  Jessica L. Allen,et al.  Neuromechanical Principles Underlying Movement Modularity and Their Implications for Rehabilitation , 2015, Neuron.

[91]  Sung-Nien Yu,et al.  Biomechanical properties and a kinetic simulation model of the smooth muscle I2 in the buccal mass of Aplysia , 1999, Biological Cybernetics.

[92]  H. Chiel,et al.  Kinematics of the buccal mass during swallowing based on magnetic resonance imaging in intact, behaving Aplysia californica. , 2002, The Journal of experimental biology.

[93]  Andrew J. Millar,et al.  Robustness from flexibility in the fungal circadian clock , 2010, BMC Systems Biology.

[94]  A. J. Lotka Analytical Note on Certain Rhythmic Relations in Organic Systems , 1920, Proceedings of the National Academy of Sciences.