A comprehensive gaze stabilization controller based on cerebellar internal models

Gaze stabilization is essential for clear vision; it is the combined effect of two reflexes relying on vestibular inputs: the vestibulocollic reflex (VCR), which stabilizes the head in space and the vestibulo-ocular reflex (VOR), which stabilizes the visual axis to minimize retinal image motion. The VOR works in conjunction with the opto-kinetic reflex (OKR), which is a visual feedback mechanism that allows the eye to move at the same speed as the observed scene. Together they keep the image stationary on the retina. In this work, we implement on a humanoid robot a model of gaze stabilization based on the coordination of VCR, VOR and OKR. The model, inspired by neuroscientific cerebellar theories, is provided with learning and adaptation capabilities based on internal models. We present the results for the gaze stabilization model on three sets of experiments conducted on the SABIAN robot and on the iCub simulator, validating the robustness of the proposed control method. The first set of experiments focused on the controller response to a set of disturbance frequencies along the vertical plane. The second shows the performances of the system under three-dimensional disturbances. The last set of experiments was carried out to test the capability of the proposed model to stabilize the gaze in locomotion tasks. The results confirm that the proposed model is beneficial in all cases reducing the retinal slip (velocity of the image on the retina) and keeping the orientation of the head stable.

[1]  A. Takanishi,et al.  Implementation of a human model for head stabilization on a humanoid platform , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[2]  Stefan Schaal,et al.  Locally Weighted Projection Regression: Incremental Real Time Learning in High Dimensional Space , 2000, ICML.

[3]  Giulio Sandini,et al.  Oculo-motor stabilization reflexes: integration of inertial and visual information , 1998, Neural Networks.

[4]  Paolo Dario,et al.  Using trunk compensation to model head stabilization during locomotion , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[5]  Atsuo Takanishi,et al.  Stabilization control for biped follow walking , 2002, Adv. Robotics.

[6]  W. Becker,et al.  Gaze Stabilization by Optokinetic Reflex (OKR) and Vestibulo-ocular Reflex (VOR) During Active Head Rotation in Man , 1997, Vision Research.

[7]  Angelo Cangelosi,et al.  An open-source simulator for cognitive robotics research: the prototype of the iCub humanoid robot simulator , 2008, PerMIS.

[8]  G. Barnes,et al.  Visual-vestibular interaction in the control of head and eye movement: The role of visual feedback and predictive mechanisms , 1993, Progress in neurobiology.

[9]  Atsuo Takanishi,et al.  Online walking pattern generation for biped humanoid robot with trunk , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[10]  Shigeo Hirose,et al.  Stabilization of the head of an undulating snake-like robot , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Stéphane Viollet,et al.  A high speed gaze control system based on the Vestibulo-Ocular Reflex , 2005, Robotics Auton. Syst..

[12]  Simon Parsons,et al.  Learning to stabilize the head of a quadrupedal robot with an artificial vestibular system , 2009, 2009 IEEE International Conference on Robotics and Automation.

[13]  Atsuo Takanishi,et al.  Development of a bipedal humanoid robot-control method of whole body cooperative dynamic biped walking , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[14]  B W Peterson,et al.  Dynamic and Kinematic Strategies for Head Movement Control , 2001, Annals of the New York Academy of Sciences.

[15]  Giulio Sandini,et al.  Visuo-inertial stabilization in space-variant binocular systems , 2000, Robotics Auton. Syst..

[16]  Paolo Dario,et al.  Head stabilization in a humanoid robot: models and implementations , 2016, Autonomous Robots.

[17]  J J Bloomberg,et al.  The Effects of Target Distance on Eye and Head Movement during Locomotion , 1992, Annals of the New York Academy of Sciences.

[18]  Mitsuo Kawato,et al.  Adaptive feedback control models of the vestibulocerebellum and spinocerebellum , 2004, Biological Cybernetics.

[19]  H. Galiana,et al.  A bilateral model for central neural pathways in vestibuloocular reflex. , 1984, Journal of neurophysiology.

[20]  R M Steinman,et al.  NATURAL RETINAL IMAGE MOTION: ORIGIN AND CHANGE * , 1981, Annals of the New York Academy of Sciences.

[21]  A. Takanishi,et al.  Biped walking stabilization on soft ground based on gait analysis , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[22]  Alessandro Roncone,et al.  Gaze stabilization for humanoid robots: A comprehensive framework , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[23]  Auke Jan Ijspeert,et al.  Learning robot gait stability using neural networks as sensory feedback function for Central Pattern Generators , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Paolo Dario,et al.  Realization of biped walking on soft ground with stabilization control based on gait analysis , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  D Manzoni,et al.  Depression of the vestibulospinal reflex adaptation by intravermal microinjection of GABA-A and GABA-B agonists in the cat. , 1994, Archives italiennes de biologie.

[26]  A. Berthoz,et al.  Head stabilization during various locomotor tasks in humans , 2004, Experimental Brain Research.

[27]  Giorgio Metta,et al.  Design of the robot-cub (iCub) head , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[28]  Tomaso Poggio,et al.  From the Retina to the Neocortex: Selected Papers of David Marr , 2012 .

[29]  Silvia Tolu,et al.  Adaptive and Predictive Control of a Simulated Robot arm , 2013, Int. J. Neural Syst..

[30]  B. W. Peterson,et al.  A dynamical model for reflex activated head movements in the horizontal plane , 1996, Biological Cybernetics.

[31]  Alfred C. Schouten,et al.  Task, muscle and frequency dependent vestibular control of posture , 2015, Front. Integr. Neurosci..

[32]  Jay M. Goldberg,et al.  Vestibular control of the head: possible functions of the vestibulocollic reflex , 2011, Experimental Brain Research.

[33]  Kathleen E. Cullen,et al.  The vestibular system: multimodal integration and encoding of self-motion for motor control , 2012, Trends in Neurosciences.

[34]  Renaud Ronsse,et al.  Gaze stabilization of a humanoid robot based on virtual linkage , 2016, 2016 6th IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[35]  Mary C Verstraete,et al.  Modulation of head movement control in humans during treadmill walking. , 2002, Gait & posture.

[36]  Jefferson E. Roy,et al.  Signal processing in the vestibular system during active versus passive head movements. , 2004, Journal of neurophysiology.

[37]  M. Yamamoto,et al.  Specific patterns of neuronal connexions involved in the control of the rabbit's vestibulo‐ocular reflexes by the cerebellar flocculus. , 1977, The Journal of physiology.

[38]  Frans C. T. van der Helm,et al.  Dependency of human neck reflex responses on the bandwidth of pseudorandom anterior-posterior torso perturbations , 2013, Experimental brain research.

[39]  A G Pipe,et al.  An adaptive gaze stabilization controller inspired by the vestibulo-ocular reflex , 2008, Bioinspiration & biomimetics.

[40]  Paolo Dario,et al.  Adaptive gaze stabilization through cerebellar internal models in a humanoid robot , 2016, 2016 6th IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[41]  John Porrill,et al.  Recurrent Cerebellar Loops Simplify Adaptive Control of Redundant and Nonlinear Motor Systems , 2007, Neural Computation.

[42]  Atsuo Takanishi,et al.  Development of a new humanoid robot WABIAN-2 , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[43]  J. Albus A Theory of Cerebellar Function , 1971 .

[44]  Stefan Schaal,et al.  Biomimetic gaze stabilization based on feedback-error-learning with nonparametric regression networks , 2001, Neural Networks.

[45]  A. Buizza,et al.  A non-linear model for visual-vestibular interaction during body rotation in man , 2004, Biological Cybernetics.

[46]  Silvia Tolu,et al.  Bio-inspired adaptive feedback error learning architecture for motor control , 2012, Biological Cybernetics.

[47]  Paolo Dario,et al.  Eye-Head Stabilization Mechanism for a Humanoid Robot Tested on Human Inertial Data , 2016, Living Machines.

[48]  A. Takanishi,et al.  Dynamic Locomotion and Mechanism of Biped Walking Robot , 2006, 2006 SICE-ICASE International Joint Conference.

[49]  M Stefanelli,et al.  Mathematical modelling. A contribution to clinical vestibular analysis. , 1971, Acta oto-laryngologica.

[50]  Masao Ito The Cerebellum And Neural Control , 1984 .

[51]  F. A. Miles,et al.  Plasticity in the vestibulo-ocular reflex: a new hypothesis. , 1981, Annual review of neuroscience.

[52]  R D Yee,et al.  Linear model for visual-vestibular interaction. , 1978, Aviation, space, and environmental medicine.

[53]  Steven Morrison,et al.  The role of the neck and trunk in facilitating head stability during walking , 2006, Experimental Brain Research.

[54]  D. Robinson Adaptive gain control of vestibuloocular reflex by the cerebellum. , 1976, Journal of neurophysiology.

[55]  Paolo Dario,et al.  A comparison between two bio-inspired adaptive models of Vestibulo-Ocular Reflex (VOR) implemented on the iCub robot , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[56]  Masao Ito Mechanisms of motor learning in the cerebellum 1 1 Published on the World Wide Web on 24 November 2000. , 2000, Brain Research.

[57]  Dora E Angelaki,et al.  An integrative neural network for detecting inertial motion and head orientation. , 2004, Journal of neurophysiology.

[58]  Paolo Dario,et al.  Head stabilization based on a feedback error learning in a humanoid robot , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[59]  James V. Stone,et al.  Recurrent cerebellar architecture solves the motor-error problem , 2004, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[60]  Paolo Dario,et al.  A robotic implementation of a bio-inspired head motion stabilization model on a humanoid platform , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.