Gaze stabilization of a humanoid robot based on virtual linkage

Gaze stabilization is a fundamental function for humanoid robots. Stabilizing the image being perceived facilitates the processing and thus the interpretation of visual data. In parallel, fixation should also guarantee that the visual target remains centered in the image. Several approaches exist to address the problem of gaze stabilization: closed-loop algorithms processing the visual data or inferring head movements from kinematic measurements, and feed-forward algorithms anticipating head movements from the lower-body commands. In this contribution, we develop a feed-forward controller addressing both image stabilization and target fixation into a unified framework. The addition of a virtual linkage between the robot eye and the visual target offers to elegantly rephrase the gaze control problem as the classical control of a redundant serial robot manipulator. Furthermore, a novel method to estimate the self-induced optical flow based on the robot kinematics - extended with this virtual linkage - is developed. It is then possible to solve the redundancy (i.e. guaranteeing target fixation) through a minimization of the optical flow (i.e. achieving image stabilization). This method is validated in simulation with a model of the head of the ARMAR IV humanoid. It is shown that the proposed controller offers to accurately estimate and minimize the optical flow, while keeping the visual target exactly in the center of the image.

[1]  J. Gibson.  The visual perception of objective motion and subjective movement. , 1994, Psychological review.

[2]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[3]  W. Becker,et al.  Gaze Stabilization by Optokinetic Reflex (OKR) and Vestibulo-ocular Reflex (VOR) During Active Head Rotation in Man , 1997, Vision Research.

[4]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[5]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[6]  Giuseppe Oriolo,et al.  Kinematically Redundant Manipulators , 2008, Springer Handbook of Robotics.

[7]  Steven S. Beauchemin,et al.  The computation of optical flow , 1995, CSUR.

[8]  Stefan Schaal,et al.  Biomimetic gaze stabilization based on feedback-error-learning with nonparametric regression networks , 2001, Neural Networks.

[9]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[10]  H. Straka,et al.  An intrinsic feed-forward mechanism for vertebrate gaze stabilization , 2008, Current Biology.

[11]  Ales Ude,et al.  Redundant control of a humanoid robot head with foveated vision for object tracking , 2010, 2010 IEEE International Conference on Robotics and Automation.

[12]  J. Henderson.  Human gaze control during real-world scene perception , 2003, Trends in Cognitive Sciences.

[13]  Alessandro Roncone,et al.  Gaze stabilization for humanoid robots: A comprehensive framework , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[14]  Bernhard J. M. Hess,et al.  Self-motion-induced eye movements: effects on visual acuity and navigation , 2005, Nature Reviews Neuroscience.

[15]  Patrick Rives,et al.  Classification and realization of the different vision-based tasks , 1993 .

[16]  Auke Jan Ijspeert,et al.  Predictive gaze stabilization during periodic locomotion based on Adaptive Frequency Oscillators , 2012, 2012 IEEE International Conference on Robotics and Automation.

[17]  Paul Fisette,et al.  ROBOTRAN: a powerful symbolic gnerator of multibody models , 2013 .

[18]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[19]  A. Berthoz,et al.  Head and trunk movements in the frontal plane during complex dynamic equilibrium tasks in humans , 2004, Experimental Brain Research.

[20]  C Detrembleur,et al.  Computation of spine intervertebral motions in scoliotic patients: a multibody approach , 2015, Computer methods in biomechanics and biomedical engineering.

[21]  Tamim Asfour,et al.  ARMAR-4: A 63 DOF torque controlled humanoid robot , 2013, 2013 13th IEEE-RAS International Conference on Humanoid Robots (Humanoids).