A unified internal model theory to resolve the paradox of active versus passive self-motion sensation

Brainstem and cerebellar neurons implement an internal model to accurately estimate self-motion during externally generated (‘passive’) movements. However, these neurons show reduced responses during self-generated (‘active’) movements, indicating that predicted sensory consequences of motor commands cancel sensory signals. Remarkably, the computational processes underlying sensory prediction during active motion and their relationship to internal model computations during passive movements remain unknown. We construct a Kalman filter that incorporates motor commands into a previously established model of optimal passive self-motion estimation. The simulated sensory error and feedback signals match experimentally measured neuronal responses during active and passive head and trunk rotations and translations. We conclude that a single sensory internal model can combine motor commands with vestibular and proprioceptive signals optimally. Thus, although neurons carrying sensory prediction error or feedback signals show attenuated modulation, the sensory cues and internal model are both engaged and critically important for accurate self-motion estimation during active head movements.

[1]  T. Brandt,et al.  Arthrokinetic nystagmus and ego-motion sensation , 1977, Experimental Brain Research.

[2]  Wilsaan M. Joiner,et al.  Adaptive Control of Saccades via Internal Feedback , 2008, The Journal of Neuroscience.

[3]  Jessica X. Brooks,et al.  Early vestibular processing does not discriminate active from passive self-motion if there is a discrepancy between predicted and actual proprioceptive feedback. , 2014, Journal of neurophysiology.

[4]  G T Gdowski,et al.  Sensory processing in the vestibular nuclei during active head movements. , 2000, Archives italiennes de biologie.

[5]  D. Angelaki,et al.  Computation of linear acceleration through an internal model in the macaque cerebellum , 2013, Nature Neuroscience.

[6]  B. Cohen,et al.  Stabilization of gaze during circular locomotion in darkness. II. Contribution of velocity storage to compensatory eye and head nystagmus in the running monkey. , 1992, Journal of neurophysiology.

[7]  Thomas Brandt,et al.  Differential effects of vestibular stimulation on walking and running , 2000, Neuroreport.

[8]  W. Becker,et al.  Estimation of self-turning in the dark: comparison between active and passive rotation , 1999, Experimental Brain Research.

[9]  D. Angelaki,et al.  Frequency-Selective Coding of Translation and Tilt in Macaque Cerebellar Nodulus and Uvula , 2008, The Journal of Neuroscience.

[10]  D. Heck The Neuronal Codes of the Cerebellum , 2015 .

[11]  B J Hess,et al.  Computation of Inertial Motion: Neural Strategies to Resolve Ambiguous Otolith Information , 1999, The Journal of Neuroscience.

[12]  T. Raphan,et al.  Role of the flocculus and paraflocculus in optokinetic nystagmus and visual-vestibular interactions: Effects of lesions , 2004, Experimental Brain Research.

[13]  Jelte E. Bos,et al.  Modeling human spatial orientation and motion perception , 2001 .

[14]  Jessica X. Brooks,et al.  Internal models of self-motion: computations that suppress vestibular reafference in early vestibular processing , 2011, Experimental Brain Research.

[15]  Chiming Huang,et al.  Plasticity of cerebellar Purkinje cells in behavioral training of body balance control , 2015, Front. Syst. Neurosci..

[16]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[17]  Max Berniker,et al.  Bayesian approaches to sensory integration for motor control. , 2011, Wiley interdisciplinary reviews. Cognitive science.

[18]  R. Tusa,et al.  Falls in patients with vestibular deficits. , 2000, The American journal of otology.

[19]  R. McCrea,et al.  Integration of vestibular and head movement signals in the vestibular nuclei during whole-body rotation. , 1999, Journal of neurophysiology.

[20]  Xiao-Jing Wang,et al.  The importance of mixed selectivity in complex cognitive tasks , 2013, Nature.

[21]  Jefferson E. Roy,et al.  Dissociating Self-Generated from Passively Applied Head Motion: Neural Mechanisms in the Vestibular Nuclei , 2004, The Journal of Neuroscience.

[22]  Christian Laugier,et al.  Probabilistic Reasoning and Decision Making in Sensory-Motor Systems , 2008, Springer Tracts in Advanced Robotics.

[23]  Jean Laurens Modélisation Bayésienne des interactions visuo-vestibulaires , 2006 .

[24]  T. Mergner,et al.  Human perception of horizontal trunk and head rotation in space during vestibular and neck stimulation , 2004, Experimental Brain Research.

[25]  J. Krakauer,et al.  Sensory prediction errors drive cerebellum-dependent adaptation of reaching. , 2007, Journal of neurophysiology.

[26]  F. O. Black,et al.  Abnormal postural control associated with peripheral vestibular disorders. , 1988, Progress in brain research.

[27]  D. Alpini,et al.  Figure ice skating induces vestibulo-ocular adaptation specific to required athletic skills , 2009, Sport Sciences for Health.

[28]  Nathaniel B Sawtell,et al.  Neural mechanisms for filtering self-generated sensory signals in cerebellum-like circuits , 2011, Current Opinion in Neurobiology.

[29]  D E Angelaki,et al.  Lesion of the nodulus and ventral uvula abolish steady-state off-vertical axis otolith response. , 1995, Journal of neurophysiology.

[30]  T. Brandt,et al.  You are better off running than walking with acute vestibulopathy , 1999, The Lancet.

[31]  U Büttner,et al.  Fastigial nucleus activity during different frequencies and orientations of vertical vestibular stimulation in the monkey. , 1999, Journal of neurophysiology.

[32]  Frans C. T. van der Helm,et al.  An adaptive model of sensory integration in a dynamic environment applied to human stance control , 2001, Biological Cybernetics.

[33]  G T Gdowski,et al.  Firing behavior of vestibular neurons during active and passive head movements: vestibulo-spinal and other non-eye-movement related neurons. , 1999, Journal of neurophysiology.

[34]  S. Glasauer,et al.  Optimal Control of Natural Eye-Head Movements Minimizes the Impact of Noise , 2011, The Journal of Neuroscience.

[35]  G D Paige,et al.  Characteristics of the VOR in Response to Linear Acceleration , 1999, Annals of the New York Academy of Sciences.

[36]  Konrad Paul Kording,et al.  Learning Priors for Bayesian Computations in the Nervous System , 2010, PloS one.

[37]  D. Angelaki,et al.  Neural Representation of Orientation Relative to Gravity in the Macaque Cerebellum , 2013, Neuron.

[38]  Dora E Angelaki,et al.  Properties of cerebellar fastigial neurons during translation, rotation, and eye movements. , 2005, Journal of neurophysiology.

[39]  Pierre Denise,et al.  Vestibulo-ocular reflex and motion sickness in figure skaters , 2008, European Journal of Applied Physiology.

[40]  S. Glasauer,et al.  Canal-otolith interaction in the fastigial nucleus of the alert monkey , 2000, Experimental Brain Research.

[41]  D. Angelaki,et al.  Purkinje Cells in Posterior Cerebellar Vermis Encode Motion in an Inertial Reference Frame , 2007, Neuron.

[42]  D. Angelaki,et al.  Vestibular system: the many facets of a multimodal sense. , 2008, Annual review of neuroscience.

[43]  V. Henn,et al.  Neuronal activity in the vestibular nuclei of the alert monkey during vestibular and optokinetic stimulation , 1977, Experimental Brain Research.

[44]  T. Mergner,et al.  Canal-neck interaction in vestibular nuclear neurons of the cat , 2004, Experimental Brain Research.

[45]  Konrad Paul Kording,et al.  Estimating the sources of motor errors for adaptation and generalization , 2008, Nature Neuroscience.

[46]  C. Foster,et al.  Vestibular rehabilitation. , 1994, Bailliere's clinical neurology.

[47]  A. Einstein Über das Relativitätsprinzip und die aus demselben gezogenen Folgerungen , 1908 .

[48]  Dora E Angelaki,et al.  Transformation of spatiotemporal dynamics in the macaque vestibular system from otolith afferents to cortex , 2017, eLife.

[49]  B. Cohen,et al.  Velocity storage in the vestibulo-ocular reflex arc (VOR) , 1979, Experimental Brain Research.

[50]  J E Zacher,et al.  Post-rotatory nystagmus and turning sensations after active and passive turning. , 1998, Journal of vestibular research : equilibrium & orientation.

[51]  Jean Laurens,et al.  Bayesian processing of vestibular information , 2007, Biological Cybernetics.

[52]  W. E. Collins,et al.  Vestibular System Part 2: Psychophysics, Applied Aspects and General Interpretations , 2012, Handbook of Sensory Physiology.

[53]  Christian Darlot,et al.  Using sensory weighting to model the influence of canal, otolith and visual cues on spatial orientation and eye movements , 2002, Biological Cybernetics.

[54]  W. Becker,et al.  Canal-neck interaction in vestibular neurons of the cat's cerebral cortex , 2004, Experimental Brain Research.

[55]  D E Angelaki,et al.  Three-dimensional organization of otolith-ocular reflexes in rhesus monkeys. II. Inertial detection of angular velocity. , 1996, Journal of neurophysiology.

[56]  Michael I. Jordan,et al.  An internal model for sensorimotor integration. , 1995, Science.

[57]  Jerome Carriot,et al.  Multimodal Integration of Self-Motion Cues in the Vestibular System: Active versus Passive Translations , 2013, The Journal of Neuroscience.

[58]  D. Merfeld Modeling the vestibulo-ocular reflex of the squirrel monkey during eccentric rotation and roll tilt , 2004, Experimental Brain Research.

[59]  B. Hess,et al.  Angular velocity detection by head movements orthogonal to the plane of rotation , 2004, Experimental Brain Research.

[60]  D. Straumann,et al.  Experimental parameter estimation of a visuo-vestibular interaction model in humans. , 2011, Journal of vestibular research : equilibrium & orientation.

[61]  V. J. Wilson,et al.  Dynamics and directional sensitivity of neck muscle spindle responses to head rotation. , 1987, Journal of neurophysiology.

[62]  Daniel M Merfeld,et al.  A distributed, dynamic, parallel computational model: the role of noise in velocity storage. , 2012, Journal of neurophysiology.

[63]  Jean Laurens,et al.  How the Vestibulocerebellum Builds an Internal Model of Self-motion , 2016 .

[64]  D M Merfeld,et al.  Humans use internal models to estimate gravity and linear acceleration , 1999, Nature.

[65]  B. Hess,et al.  Processing of angular motion and gravity information through an internal model. , 2010, Journal of neurophysiology.

[66]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[67]  Stefano Fusi,et al.  Why neurons mix: high dimensionality for higher cognition , 2016, Current Opinion in Neurobiology.

[68]  H. Reisine,et al.  Neural basis for eye velocity generation in the vestibular nuclei of alert monkeys during off-vertical axis rotation , 2004, Experimental Brain Research.

[69]  Dora E Angelaki,et al.  Computational approaches to spatial orientation: from transfer functions to dynamic Bayesian inference. , 2008, Journal of neurophysiology.

[70]  L. Young,et al.  The vestibulo-ocular reflex of the squirrel monkey during eccentric rotation and roll tilt , 2004, Experimental Brain Research.

[71]  A GRAYBIEL,et al.  Oculogravic illusion. , 1952, A.M.A. archives of ophthalmology.

[72]  W. King,et al.  Responses of monkey vestibular-only neurons to translation and angular rotation. , 2006, Journal of neurophysiology.

[73]  Jessica X. Brooks,et al.  The Primate Cerebellum Selectively Encodes Unexpected Self-Motion , 2013, Current Biology.

[74]  Dora E Angelaki,et al.  Responses of ventral posterior thalamus neurons to three-dimensional vestibular and optic flow stimulation. , 2010, Journal of neurophysiology.

[75]  S. Glasauer,et al.  Modelling Three-Dimensional Vestibular Responses During Complex Motion Stimulation , 1997 .

[76]  V. Dietz,et al.  The contribution of vestibular input to the stabilization of human posture: A new experimental approach , 1988, Neuroscience Letters.

[77]  R. Mayne,et al.  A Systems Concept of the Vestibular Organs , 1974 .

[78]  B. Cohen,et al.  Coding of Velocity Storage in the Vestibular Nuclei , 2017, Front. Neurol..

[79]  P. May,et al.  Vestibular Signals in Primate Thalamus: Properties and Origins , 2007, The Journal of Neuroscience.

[80]  David W. Franklin,et al.  Computational Mechanisms of Sensorimotor Control , 2011, Neuron.

[81]  D. Angelaki,et al.  The functional significance of velocity storage and its dependence on gravity , 2011, Experimental Brain Research.

[82]  Nora Riley Neuromuscular adaptations during perturbations in individuals with and without bilateral vestibular loss , 2010 .

[83]  Kathleen E Cullen,et al.  Semicircular Canal Afferents Similarly Encode Active and Passive Head-On-Body Rotations: Implications for the Role of Vestibular Efference , 2002, The Journal of Neuroscience.

[84]  B Cohen,et al.  Control of spatial orientation of the angular vestibuloocular reflex by the nodulus and uvula. , 1998, Journal of neurophysiology.

[85]  Dora E. Angelaki,et al.  Neurons compute internal models of the physical laws of motion , 2004, Nature.

[86]  U Büttner,et al.  Trunk position influences vestibular responses of fastigial nucleus neurons in the alert monkey. , 2004, Journal of neurophysiology.

[87]  Stefan Glasauer,et al.  Quantification of Head Movement Predictability and Implications for Suppression of Vestibular Input during Locomotion , 2017, Front. Comput. Neurosci..

[88]  B. Hess,et al.  Spinning versus Wobbling: How the Brain Solves a Geometry Problem , 2011, The Journal of Neuroscience.

[89]  J. Taube The head direction signal: origins and sensory-motor integration. , 2007, Annual review of neuroscience.

[90]  Daniel M Merfeld,et al.  Perceptual precision of passive body tilt is consistent with statistically optimal cue integration. , 2017, Journal of neurophysiology.

[91]  M. Sanders Control of Gaze by Brain Stem Neurons , 1978 .

[92]  C. Oman A heuristic mathematical model for the dynamics of sensory conflict and motion sickness. , 1982, Acta oto-laryngologica. Supplementum.

[93]  Stefan Glasauer,et al.  Vestibular and cerebellar contribution to gaze optimality. , 2014, Brain : a journal of neurology.

[94]  D Straumann,et al.  Velocity storage contribution to vestibular self-motion perception in healthy human subjects. , 2011, Journal of neurophysiology.

[95]  Michael Fetter,et al.  Three-Dimensional Kinematics of Eye, Head and Limb Movements , 1997 .

[96]  Jan Evangelista Purkinje Purkinje Cells , 2002 .

[97]  U Büttner,et al.  Rostral fastigial nucleus activity in the alert monkey during three-dimensional passive head movements. , 1997, Journal of neurophysiology.

[98]  Kathleen E. Cullen,et al.  The vestibular system: multimodal integration and encoding of self-motion for motor control , 2012, Trends in Neurosciences.

[99]  B. Hess,et al.  Inertial representation of angular motion in the vestibular system of rhesus monkeys. I. Vestibuloocular reflex. , 1994, Journal of neurophysiology.

[100]  L R Young,et al.  Optimal estimator model for human spatial orientation. , 1988, Annals of the New York Academy of Sciences.

[101]  J. Krakauer,et al.  Error correction, sensory prediction, and adaptation in motor control. , 2010, Annual review of neuroscience.

[102]  Mohsen Jamali,et al.  Response of vestibular nerve afferents innervating utricle and saccule during passive and active translations. , 2009, Journal of neurophysiology.

[103]  J. H. J. Allum,et al.  Postural coactivation and adaptation in the sway stabilizing responses of normals and patients with bilateral vestibular deficit , 2004, Experimental Brain Research.

[104]  Kathleen E Cullen,et al.  Response of vestibular-nerve afferents to active and passive rotations under normal conditions and after unilateral labyrinthectomy. , 2007, Journal of neurophysiology.

[105]  Jefferson E. Roy,et al.  Selective Processing of Vestibular Reafference during Self-Generated Head Motion , 2001, The Journal of Neuroscience.

[106]  R. McCrea,et al.  Self-motion signals in vestibular nuclei neurons projecting to the thalamus in the alert squirrel monkey. , 2009, Journal of neurophysiology.

[107]  A. Benson,et al.  Modification of per- and postrotational responses by voluntary motor activity of the limbs , 2004, Experimental Brain Research.

[108]  Jean Laurens,et al.  Bayesian Modelling of Visuo-Vestibular Interactions , 2008, Probabilistic Reasoning and Decision Making in Sensory-Motor Systems.

[109]  Jerome Carriot,et al.  Learning to expect the unexpected: rapid updating in primate cerebellum during voluntary self-motion , 2015, Nature Neuroscience.

[110]  D. Angelaki,et al.  Spatiotemporal Properties of Optic Flow and Vestibular Tuning in the Cerebellar Nodulus and Uvula , 2013, The Journal of Neuroscience.

[111]  Hongge Luan,et al.  Signal Processing of Semicircular Canal and Otolith Signals in the Vestibular Nuclei during Passive and Active Head Movements , 2003, Annals of the New York Academy of Sciences.

[112]  Greg Wayne,et al.  A temporal basis for predicting the sensory consequences of motor commands in an electric fish , 2014, Nature Neuroscience.

[113]  E. Todorov Optimality principles in sensorimotor control , 2004, Nature Neuroscience.

[114]  B. Hess,et al.  Inertial representation of angular motion in the vestibular system of rhesus monkeys. II. Otolith-controlled transformation that depends on an intact cerebellar nodulus. , 1995, Journal of neurophysiology.

[115]  R. McCrea,et al.  Coding of self-motion signals in ventro-posterior thalamus neurons in the alert squirrel monkey , 2008, Experimental Brain Research.

[116]  John Crawford,et al.  LIVING WITHOUT A BALANCING MECHANISM* , 1964, The British journal of ophthalmology.

[117]  Jessica X Brooks,et al.  Multimodal Integration in Rostral Fastigial Nucleus Provides an Estimate of Body Movement , 2009, The Journal of Neuroscience.