Dynamic Reweighting of Three Modalities for Sensor Fusion

We simultaneously perturbed visual, vestibular and proprioceptive modalities to understand how sensory feedback is re-weighted so that overall feedback remains suited to stabilizing upright stance. Ten healthy young subjects received an 80 Hz vibratory stimulus to their bilateral Achilles tendons (stimulus turns on-off at 0.28 Hz), a ±1 mA binaural monopolar galvanic vestibular stimulus at 0.36 Hz, and a visual stimulus at 0.2 Hz during standing. The visual stimulus was presented at different amplitudes (0.2, 0.8 deg rotation about ankle axis) to measure: the change in gain (weighting) to vision, an intramodal effect; and a change in gain to vibration and galvanic vestibular stimulation, both intermodal effects. The results showed a clear intramodal visual effect, indicating a de-emphasis on vision when the amplitude of visual stimulus increased. At the same time, an intermodal visual-proprioceptive reweighting effect was observed with the addition of vibration, which is thought to change proprioceptive inputs at the ankles, forcing the nervous system to rely more on vision and vestibular modalities. Similar intermodal effects for visual-vestibular reweighting were observed, suggesting that vestibular information is not a “fixed” reference, but is dynamically adjusted in the sensor fusion process. This is the first time, to our knowledge, that the interplay between the three primary modalities for postural control has been clearly delineated, illustrating a central process that fuses these modalities for accurate estimates of self-motion.

[1]  Tim Kiemel,et al.  Comparing internal models of the dynamics of the visual environment , 2005, Biological Cybernetics.

[2]  J. Coast Handbook of Physiology. Section 12. Exercise: Regulation and Integration of Multiple Systems , 1997 .

[3]  B. Day,et al.  Human body‐segment tilts induced by galvanic stimulation: a vestibularly driven balance protection mechanism. , 1997, The Journal of physiology.

[4]  A Cappello,et al.  Human postural response to lower leg muscle vibration of different duration. , 2006, Physiological research.

[5]  David N. Lee Visual proprioceptive control of stance , 1975 .

[6]  Kelvin S. Oie,et al.  Asymmetric adaptation with functional advantage in human sensorimotor control , 2008, Experimental Brain Research.

[7]  Kelvin S. Oie,et al.  Position and velocity coupling of postural sway to somatosensory drive. , 1998, Journal of neurophysiology.

[8]  Patrick J. Loughlin,et al.  Sensory re-weighting in human postural control during moving-scene perturbations , 2005, Experimental Brain Research.

[9]  L. Rowell,et al.  Exercise : regulation and integration of multiple systems , 1996 .

[10]  J. Bendat,et al.  Random Data: Analysis and Measurement Procedures , 1971 .

[11]  C. Gielen,et al.  Temporal stability of the action-perception cycle for postural control in a moving visual environment , 2004, Experimental Brain Research.

[12]  Ian P. Howard,et al.  Human visual orientation , 1982 .

[13]  Martin A. Giese,et al.  Frequency dependence of the action-perception cycle for postural control in a moving visual environment: relative phase dynamics , 1994, Biological Cybernetics.

[14]  Elijane Ramsay,et al.  Non‐linear vector summation of left and right vestibular signals for human balance , 2010, The Journal of physiology.

[15]  Patrick J. Loughlin,et al.  A mechanism for sensory re-weighting in postural control , 2009, Medical & Biological Engineering & Computing.

[16]  B E Maki,et al.  Preferred placement of the feet during quiet stance: development of a standardized foot placement for balance testing. , 1997, Clinical biomechanics.

[17]  Tim Kiemel,et al.  Slow dynamics of postural sway are in the feedback loop. , 2006, Journal of neurophysiology.

[18]  G. DeAngelis,et al.  Visual–Vestibular Integration for Self-Motion Perception , 2012 .

[19]  Kelvin S. Oie,et al.  Multisensory fusion: simultaneous re-weighting of vision and touch for the control of human posture. , 2002, Brain research. Cognitive brain research.

[20]  R. Johansson,et al.  Galvanic vestibular stimulation for analysis of postural adaptation and stability , 1995, IEEE Transactions on Biomedical Engineering.

[21]  R. Fitzpatrick,et al.  Proprioceptive, visual and vestibular thresholds for the perception of sway during standing in humans. , 1994, The Journal of physiology.

[22]  R. Peterka,et al.  Role of somatosensory and vestibular cues in attenuating visually induced human postural sway , 2004, Experimental Brain Research.

[23]  Romi Nijhawan,et al.  Visual prediction: Psychophysics and neurophysiology of compensation for time delays , 2008, Behavioral and Brain Sciences.

[24]  Tim Kiemel,et al.  The role of vestibular and somatosensory systems in intersegmental control of upright stance. , 2008, Journal of vestibular research : equilibrium & orientation.

[25]  Frans C. T. van der Helm,et al.  An adaptive model of sensory integration in a dynamic environment applied to human stance control , 2001, Biological Cybernetics.

[26]  Tim Kiemel,et al.  Multisensory fusion and the stochastic structure of postural sway , 2002, Biological Cybernetics.

[27]  Gabor Stepan,et al.  Delay effects in the human sensory system during balancing , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[28]  R. Johansson,et al.  Identification of human postural dynamics , 1988, IEEE Transactions on Biomedical Engineering.

[29]  P. Riley,et al.  Double-Blind, Placebo-Controlled Trial of Rehabilitation for Bilateral Vestibular Hypofunction: Preliminary Report , 1993, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[30]  Boualem Boashash,et al.  The bootstrap and its application in signal processing , 1998, IEEE Signal Process. Mag..

[31]  Rolf Johansson,et al.  Adaptation of multi-segmented body movements during vibratory proprioceptive and galvanic vestibular stimulation. , 2007, Journal of vestibular research : equilibrium & orientation.

[32]  S. A. Campbell Time Delays in Neural Systems , 2007 .

[33]  J. Allum Organization of stabilizing reflex responses in tibialis anterior muscles following ankle flexion perturbations of standing man , 1983, Brain Research.

[34]  T. Kiemel,et al.  Visual Flow Is Interpreted Relative to Multisegment Postural Control , 2011, Journal of motor behavior.

[35]  F. Horak,et al.  Postural Orientation and Equilibrium , 2011 .

[36]  Robert J Peterka,et al.  Dynamic regulation of sensorimotor integration in human postural control. , 2004, Journal of neurophysiology.

[37]  R Johansson,et al.  Multi-stimulus multi-response posturography. , 2001, Mathematical biosciences.

[38]  J. Lackner,et al.  Fingertip contact suppresses the destabilizing influence of leg muscle vibration. , 2000, Journal of neurophysiology.

[39]  R. Peterka Sensorimotor integration in human postural control. , 2002, Journal of neurophysiology.

[40]  L. Nashner,et al.  Influence of head position and proprioceptive cues on short latency postural reflexes evoked by galvanic stimulation of the human labyrinth. , 1974, Brain research.

[41]  J. F. Soechting,et al.  The role of vision in the control of posture during linear motion. , 1979, Progress in brain research.

[42]  C. C. A. M. Gielen,et al.  Postural adjustments induced by simulated motion of differently structured environments , 2004, Experimental Brain Research.

[43]  Kelvin S. Oie,et al.  Human multisensory fusion of vision and touch: detecting non-linearity with small changes in the sensory environment , 2001, Neuroscience Letters.

[44]  Viktor K. Jirsa,et al.  Handbook of Brain Connectivity , 2007 .

[45]  Patrick J. Loughlin,et al.  Analysis and validation of a human postural control model , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[46]  Arash Mahboobin,et al.  Computational and robotic models of human postural control , 2007 .

[47]  F Hlavacka,et al.  Postural responses evoked by sinusoidal galvanic stimulation of the labyrinth. Influence of head position. , 1985, Acta oto-laryngologica.

[48]  J. F. Soechting,et al.  Postural readjustments induced by linear motion of visual scenes , 1977, Experimental Brain Research.

[49]  Tim Kiemel,et al.  Modeling the Dynamics of Sensory Reweighting , 2006, Biological Cybernetics.

[50]  Régine Roll,et al.  From balance regulation to body orientation: two goals for muscle proprioceptive information processing? , 1999, Experimental Brain Research.

[51]  A. Bronstein,et al.  Suppression of visually evoked postural responses , 2004, Experimental Brain Research.

[52]  J. Lackner,et al.  Coupling of fingertip somatosensory information to head and body sway , 1997, Experimental Brain Research.

[53]  J. F. Soechting,et al.  Dynamic role of vision in the control of posture in man , 1979, Experimental Brain Research.

[54]  Katharina Burger,et al.  Random Data Analysis And Measurement Procedures , 2016 .

[55]  T. Kiemel,et al.  Identification of the plant for upright stance in humans: multiple movement patterns from a single neural strategy. , 2008, Journal of neurophysiology.