Vestibular humanoid postural control

Many of our motor activities require stabilization against external disturbances. This especially applies to biped stance since it is inherently unstable. Disturbance compensation is mainly reactive, depending on sensory inputs and real-time sensor fusion. In humans, the vestibular system plays a major role. When there is no visual space reference, vestibular-loss clearly impairs stance stability. Most humanoid robots do not use a vestibular system, but stabilize upright body posture by means of center of pressure (COP) control. We here suggest using in addition a vestibular sensor and present a biologically inspired vestibular sensor along with a human-inspired stance control mechanism. We proceed in two steps. First, in an introductory review part, we report on relevant human sensors and their role in stance control, focusing on own models of transmitter fusion in the vestibular sensor and sensor fusion in stance control. In a second, experimental part, the models are used to construct an artificial vestibular system and to embed it into the stance control of a humanoid. The robot's performance is investigated using tilts of the support surface. The results are compared to those of humans. Functional significance of the vestibular sensor is highlighted by comparing vestibular-able with vestibular-loss states in robot and humans. We show that a kinematic body-space sensory feedback (vestibular) is advantageous over a kinetic one (force cues) for dynamic body-space balancing. Our embodiment of human sensorimotor control principles into a robot is more than just bionics. It inspired our biological work (neurorobotics: 'learning by building', proof of principle, and more). We envisage a future clinical use in the form of hardware-in-the-loop simulations of neurological symptoms for improving diagnosis and therapy and designing medical assistive devices.

[1]  Michel Guerraz,et al.  Expectation and the Vestibular Control of Balance , 2005, Journal of Cognitive Neuroscience.

[2]  Patrick J. Loughlin,et al.  Sensory adaptation in human balance control: Lessons for biomimetic robotic bipeds , 2008, Neural Networks.

[3]  T. Mergner,et al.  Human balance control during cutaneous stimulation of the plantar soles , 2001, Neuroscience Letters.

[4]  Michael Fetter,et al.  Three-Dimensional Kinematics of Eye, Head and Limb Movements , 1997 .

[5]  S C Gandevia,et al.  Loop gain of reflexes controlling human standing measured with the use of postural and vestibular disturbances. , 1996, Journal of neurophysiology.

[6]  C Maurer,et al.  Visual object localisation in space. Interaction of retinal, eye position, vestibular and neck proprioceptive information. , 2001, Experimental brain research.

[7]  J. Goldberg,et al.  Responses of peripheral vestibular neurons to angular and linear accelerations in the squirrel monkey. , 1975, Acta oto-laryngologica.

[8]  J Campos Castelló,et al.  [Neurological examination of the full term newborn infant]. , 1979, Revista de medicina de la Universidad de Navarra.

[9]  Bernhard J. M. Hess,et al.  Sensorimotor Transformations in Spatial Orientation Relative to Gravity , 2007 .

[10]  Jelte E. Bos,et al.  Theoretical considerations on canal–otolith interaction and an observer model , 2002, Biological Cybernetics.

[11]  Thomas Mergner,et al.  Potential roles of force cues in human stance control , 2009, Experimental Brain Research.

[12]  T. Mergner,et al.  Multisensory control of human upright stance , 2006, Experimental Brain Research.

[13]  F. O. Black,et al.  Adaptation to altered support and visual conditions during stance: patients with vestibular deficits , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[14]  Tim Kiemel,et al.  Multisensory fusion and the stochastic structure of postural sway , 2002, Biological Cybernetics.

[15]  Frans C T van der Helm,et al.  Comparison of different methods to identify and quantify balance control. , 2005, Journal of neuroscience methods.

[16]  R. Peterka,et al.  Stimulus-dependent changes in the vestibular contribution to human postural control. , 2006, Journal of neurophysiology.

[17]  T. Mergner,et al.  A cognitive intersensory interaction mechanism in human postural control , 2006, Experimental Brain Research.

[18]  J. Duysens,et al.  Load-regulating mechanisms in gait and posture: comparative aspects. , 2000, Physiological reviews.

[19]  Wolfgang Günthner Enhancing Cognitive Assistance Systems with Inertial Measurement Units , 2008, Studies in Computational Intelligence.

[20]  L. Young,et al.  A multidimensional model of the effect of gravity on the spatial orientation of the monkey. , 1993, Journal of vestibular research : equilibrium & orientation.

[21]  T. Mergner,et al.  Abnormal resonance behavior of the postural control loop in Parkinson’s disease , 2004, Experimental Brain Research.

[22]  Thomas Mergner,et al.  Biological and engineering approaches to human postural control , 2007, Integr. Comput. Aided Eng..

[23]  T. Brandt Vertigo: Its Multisensory Syndromes , 1991, Clinical Medicine and the Nervous System.

[24]  Herman van der Kooij,et al.  A multisensory integration model of human stance control , 1999, Biological Cybernetics.

[25]  B J Hess,et al.  Computation of Inertial Motion: Neural Strategies to Resolve Ambiguous Otolith Information , 1999, The Journal of Neuroscience.

[26]  Joseph L. Demer,et al.  A linear canal-otolith interaction model to describe the human vestibulo-ocular reflex , 1999, Biological Cybernetics.

[27]  F. Plum Handbook of Physiology. , 1960 .

[28]  Herman van der Kooij,et al.  Postural responses evoked by platform pertubations are dominated by continuous feedback. , 2007, Journal of neurophysiology.

[29]  T. Mergner,et al.  Human perception of horizontal trunk and head rotation in space during vestibular and neck stimulation , 2004, Experimental Brain Research.

[30]  L. Young,et al.  Integration of semicircular canal and otolith information for multisensory orientation stimuli , 1977 .

[31]  T Mergner,et al.  Vestibular-neck interaction and transformation of sensory coordinates. , 1997, Journal of vestibular research : equilibrium & orientation.

[32]  A. G. Feldman New insights into action–perception coupling , 2009, Experimental Brain Research.

[33]  R. Fitzpatrick,et al.  Proprioceptive, visual and vestibular thresholds for the perception of sway during standing in humans. , 1994, The Journal of physiology.

[34]  Thomas Mergner The Matryoshka dolls principle in human dynamic behavior in space: A theory of linked references for multisensory perception and control of action , 2002 .

[35]  C Maurer,et al.  Vestibular, visual, and somatosensory contributions to human control of upright stance , 2000, Neuroscience Letters.

[36]  J. A. Simpson,et al.  The Neurological Examination of the Full-Term Newborn Infant , 1978 .

[37]  J. Droulez,et al.  Motion perceptions induced by off-vertical axis rotation (OVAR) at small angles of tilt , 2004, Experimental Brain Research.

[38]  T. Squires Optimizing the vertebrate vestibular semicircular canal: could we balance any better? , 2004, Physical review letters.

[39]  R.H.S. Carpenter,et al.  Mammalian vestibular physiology , 1980, Nature.

[40]  A H Clarke,et al.  On the vestibular labyrinth of Brachiosaurus brancai. , 2005, Journal of vestibular research : equilibrium & orientation.

[41]  Prahlad Vadakkepat,et al.  Disturbance rejection by online ZMP compensation , 2008, Robotica.

[42]  Christian Darlot,et al.  Using sensory weighting to model the influence of canal, otolith and visual cues on spatial orientation and eye movements , 2002, Biological Cybernetics.

[43]  Alexander A. Frolov,et al.  Biomechanical analysis of movement strategies in human forward trunk bending. II. Experimental study , 2001, Biological Cybernetics.

[44]  R. Caballero,et al.  Methodology for Zero-moment Point Experimental Modeling in the Frequency Domain , 2006 .

[45]  L R Young,et al.  Optimal estimator model for human spatial orientation. , 1988, Annals of the New York Academy of Sciences.

[46]  Thomas Mergner,et al.  Sensory contributions to the control of stance: a posture control model. , 2002, Advances in experimental medicine and biology.

[47]  H. Kooij,et al.  POSTURAL RESPONSES EVOKED BY PLATFORM PERTUBATIONS ARE DOMINATED BY CONTINUOUS FEEDBACK , 2007 .

[48]  A.-J. Baerveldt,et al.  A low-cost and low-weight attitude estimation system for an autonomous helicopter , 1997, Proceedings of IEEE International Conference on Intelligent Engineering Systems.

[49]  Rolf Johansson,et al.  Human postural dynamics. , 1991, Critical reviews in biomedical engineering.

[50]  R Johansson,et al.  Significance of pressor input from the human feet in anterior-posterior postural control. The effect of hypothermia on vibration-induced body-sway. , 1990, Acta oto-laryngologica.

[51]  R. Mayne,et al.  A Systems Concept of the Vestibular Organs , 1974 .

[52]  Régine Roll,et al.  From balance regulation to body orientation: two goals for muscle proprioceptive information processing? , 1999, Experimental Brain Research.

[53]  Alexander A. Frolov,et al.  Biomechanical analysis of movement strategies in human forward trunk bending. I. Modeling , 2001, Biological Cybernetics.

[54]  Friedrich Pfeiffer,et al.  Sensors and Control Concept of Walking “Johnnie” , 2003, Int. J. Robotics Res..

[55]  S. Watanabe,et al.  Postural readjustment to body sway induced by vibration in man , 2004, Experimental Brain Research.

[56]  C Maurer,et al.  A multisensory posture control model of human upright stance. , 2003, Progress in brain research.

[57]  David A. Winter,et al.  Biomechanics and Motor Control of Human Movement , 1990 .

[58]  T Mergner Meta level concept versus classic reflex concept for the control of posture and movement. , 2004, Archives italiennes de biologie.

[59]  F. Spoor,et al.  Vestibular evidence for the evolution of aquatic behaviour in early cetaceans , 2002, Nature.

[60]  Olivier Faugeras,et al.  Computation of inertial information on a Robot , 1991 .

[61]  Robert J Peterka,et al.  Dynamic regulation of sensorimotor integration in human postural control. , 2004, Journal of neurophysiology.

[62]  G. Eklund,et al.  Further studies of vibration-induced effects on balance. , 1973, Upsala journal of medical sciences.

[63]  Jean Laurens,et al.  Bayesian processing of vestibular information , 2007, Biological Cybernetics.

[64]  T. Mergner,et al.  Human stance control beyond steady state response and inverted pendulum simplification , 2008, Experimental Brain Research.

[65]  Patrick J. Loughlin,et al.  Sensory re-weighting in human postural control during moving-scene perturbations , 2005, Experimental Brain Research.

[66]  Thomas Mergner,et al.  Posture Control in Vestibular‐Loss Patients , 2009, Annals of the New York Academy of Sciences.

[67]  Thomas Mergner,et al.  Modeling sensorimotor control of human upright stance. , 2007, Progress in brain research.

[68]  S Glasauer,et al.  A Simple Model of Vestibular Canal‐Otolith Signal Fusion , 1999, Annals of the New York Academy of Sciences.

[69]  T. Mergner,et al.  Human postural responses to motion of real and virtual visual environments under different support base conditions , 2005, Experimental Brain Research.

[70]  R. Peterka Sensorimotor integration in human postural control. , 2002, Journal of neurophysiology.

[71]  F. Horak,et al.  Postural Orientation and Equilibrium , 2011 .

[72]  G D Paige,et al.  Eye movement responses to linear head motion in the squirrel monkey. II. Visual-vestibular interactions and kinematic considerations. , 1991, Journal of neurophysiology.