Human-Like Sensor Fusion Implemented in the Posture Control of a Bipedal Robot

Posture control represents the basis for many human sensorimotor activities such as standing, walking or reaching. It involves inputs from joint angle, joint torque, vestibular and visual sensors as well as fusions of the sensor data. Roboticists may draw inspirations from the human posture control methods when building devices that interact with humans such as prostheses or exoskeletons. This study describes multisensory fusion mechanisms that were derived from human perception of ego-motion. They were implemented in a posture control model that describes human balancing of biped stance during external disturbances. The fusions are used for estimating the disturbances and the estimates, in turn, command joint servo controls to compensate them (disturbance estimation and compensation, DEC, concept). An emergent property of the network of sensory estimators is an automatic adaptation to changes in disturbance type and magnitude and in sensor availability. Previously, the model described human and robot balancing about the ankle joints in the sagittal plane. Here, the approach is extended to include the hip joints. The extended human-derived model is again re-embodied in a biped posture control robot constructed with human anthropometrics. The robot is tested in direct comparison with human subjects. Results on hip and ankle sway responses to support surface rotation are described. Basic resemblance of the results suggests that the robot’s DEC controls capture important aspects of the human balancing.

[1]  Herman van der Kooij,et al.  Non-linear stimulus-response behavior of the human stance control system is predicted by optimization of a system with sensory and motor noise , 2010, Journal of Computational Neuroscience.

[2]  Vincenzo Perciavalle,et al.  Cerebellar encoding of limb position , 2008, The Cerebellum.

[3]  David A. Winter,et al.  Biomechanics and Motor Control of Human Movement , 1990 .

[4]  Patrick J. Loughlin,et al.  Sensory adaptation in human balance control: Lessons for biomimetic robotic bipeds , 2008, Neural Networks.

[5]  A. Berthoz,et al.  Head stabilization during various locomotor tasks in humans , 2004, Experimental Brain Research.

[6]  S. Park,et al.  Feedback equilibrium control during human standing , 2005, Biological Cybernetics.

[7]  Leonard A. Rozendaal,et al.  Stability of bipedal stance: the contribution of cocontraction and spindle feedback , 2003, Biological Cybernetics.

[8]  O. Pompeiano,et al.  Convergence and interaction of neck and macular vestibular inputs on vestibulospinal neurons. , 1981, Journal of neurophysiology.

[9]  D. Winter,et al.  Stiffness control of balance in quiet standing. , 1998, Journal of neurophysiology.

[10]  Georg Hettich,et al.  Human hip-ankle coordination emerging from multisensory feedback control. , 2014, Human movement science.

[11]  T Mergner,et al.  Effects of static tilt on cervical spinoreticular tract neurons. , 1976, Journal of neurophysiology.

[12]  J. Lackner,et al.  Rapid adaptation to Coriolis force perturbations of arm trajectory. , 1994, Journal of neurophysiology.

[13]  P. Morasso,et al.  Can muscle stiffness alone stabilize upright standing? , 1999, Journal of neurophysiology.

[14]  A. Berthoz,et al.  Visual contribution to rapid motor responses during postural control , 1978, Brain Research.

[15]  L. Nashner,et al.  The organization of human postural movements: A formal basis and experimental synthesis , 1985, Behavioral and Brain Sciences.

[16]  F. Plum Handbook of Physiology. , 1960 .

[17]  T. Mergner,et al.  Multisensory control of human upright stance , 2006, Experimental Brain Research.

[18]  B. Bloem,et al.  Role of the Basal Ganglia in Balance Control , 2005, Neural plasticity.

[19]  Thomas Mergner,et al.  The Matryoshka dolls principle in human dynamic behavior in space: A theory of linked references for multisensory perception and control of action , 2002 .

[20]  W. Becker,et al.  Canal-neck interaction in vestibular neurons of the cat's cerebral cortex , 2004, Experimental Brain Research.

[21]  T. Mergner,et al.  Human perception of horizontal trunk and head rotation in space during vestibular and neck stimulation , 2004, Experimental Brain Research.

[22]  Thomas Mergner,et al.  A neurological view on reactive human stance control , 2010, Annu. Rev. Control..

[23]  F. Zajac,et al.  Determining Muscle's Force and Action in Multi‐Articular Movement , 1989, Exercise and sport sciences reviews.

[24]  Herman van der Kooij,et al.  A multisensory integration model of human stance control , 1999, Biological Cybernetics.

[25]  Thomas Mergner,et al.  Neurorobotics approaches to human and humanoid sensorimotor control , 2009, Journal of Physiology-Paris.

[26]  F. Horak,et al.  Central programming of postural movements: adaptation to altered support-surface configurations. , 1986, Journal of neurophysiology.

[27]  C Maurer,et al.  A multisensory posture control model of human upright stance. , 2003, Progress in brain research.

[28]  A J Bastian,et al.  Mechanisms of ataxia. , 1997, Physical therapy.

[29]  A. Kuo An optimal state estimation model of sensory integration in human postural balance , 2005, Journal of neural engineering.

[30]  A M Bronstein,et al.  Evidence for a vestibular input contributing to dynamic head stabilization in man. , 1988, Acta oto-laryngologica.

[31]  J. C. Rothwell,et al.  Postural electromyographic responses in the arm and leg following galvanic vestibular stimulation in man , 2004, Experimental Brain Research.

[32]  R. Poppele,et al.  Independent representations of limb axis length and orientation in spinocerebellar response components. , 2002, Journal of neurophysiology.

[33]  R. Wehner ‘Matched filters’ — neural models of the external world , 1987, Journal of Comparative Physiology A.

[34]  R E Poppele,et al.  Representation of multiple kinematic parameters of the cat hindlimb in spinocerebellar activity. , 1997, Journal of neurophysiology.

[35]  Thomas Mergner,et al.  Biological and engineering approaches to human postural control , 2007, Integr. Comput. Aided Eng..

[36]  Thomas Rosemeier,et al.  Interaction of vestibular, somatosensory and visual signals for postural control and motion perception under terrestrial and microgravity conditions—a conceptual model , 1998, Brain Research Reviews.

[37]  H. Saunders,et al.  Book Reviews : APPLIED TIME SERIES ANALYSIS VOLUME 1. BASIC TECHNIQUES R.K. Otnes and L. Enochson John Wiley & Sons, New York, NY 1978, $33.50 , 1981 .

[38]  Tim Kiemel,et al.  Navigating sensory conflict in dynamic environments using adaptive state estimation , 2011, Biological Cybernetics.

[39]  R. Peterka Sensorimotor integration in human postural control. , 2002, Journal of neurophysiology.

[40]  F. Horak,et al.  Postural Orientation and Equilibrium , 2011 .

[41]  Peter M. H. Rack,et al.  Limitations of Somatosensory Feedback in Control of Posture and Movement , 2011 .

[42]  Simon C Gandevia,et al.  Proprioception: peripheral inputs and perceptual interactions. , 2002, Advances in experimental medicine and biology.

[43]  Thomas Mergner,et al.  Vestibular humanoid postural control , 2009, Journal of Physiology-Paris.

[44]  T Mergner,et al.  Vestibular-neck interaction and transformation of sensory coordinates. , 1997, Journal of vestibular research : equilibrium & orientation.

[45]  Robert K. Otnes,et al.  Digital time series analysis , 1972 .

[46]  T. Mergner,et al.  The role of canal-neck interaction for the perception of horizontal trunk and head rotation , 2004, Experimental Brain Research.

[47]  T. Mergner,et al.  Canal-neck interaction in vestibular nuclear neurons of the cat , 2004, Experimental Brain Research.

[48]  A. Berthoz,et al.  Head stabilization during various locomotor tasks in humans , 1990, Experimental Brain Research.

[49]  W. Edwards,et al.  Effect of joint stiffness on standing stability. , 2007, Gait & posture.

[50]  Karim A. Tahboub,et al.  Biologically-inspired humanoid postural control , 2009, Journal of Physiology-Paris.

[51]  S. S. Stevens,et al.  Psychophysics: Introduction to Its Perceptual, Neural and Social Prospects , 1975 .