Learning Robotic Hand-eye Coordination Through a Developmental Constraint Driven Approach

The skill of robotic hand-eye coordination not only helps robots to deal with real time environment, but also affects the fundamental framework of robotic cognition. A number of approaches have been developed in the literature for construction of the robotic hand-eye coordination. However, several important features within infant developmental procedure have not been introduced into such approaches. This paper proposes a new method for robotic hand-eye coordination by imitating the developmental progress of human infants. The work employs a brain-like neural network system inspired by infant brain structure to learn hand-eye coordination, and adopts a developmental mechanism from psychology to drive the robot. The entire learning procedure is driven by developmental constraint: The robot starts to act under fully constrained conditions, when the robot learning system becomes stable, a new constraint is assigned to the robot. After that, the robot needs to act with this new condition again. When all the contained conditions have been overcome, the robot is able to obtain hand-eye coordination ability. The work is supported by experimental evaluation, which shows that the new approach is able to drive the robot to learn autonomously, and make the robot also exhibit developmental progress similar to human infants.

[1]  Martin Jägersand,et al.  Towards Learning Robotic Reaching and Pointing: An Uncalibrated Visual Servoing Approach , 2009, 2009 Canadian Conference on Computer and Robot Vision.

[2]  Huosheng Hu,et al.  An analysis of the inverse kinematics for a 5-DOF manipulator , 2005, Int. J. Autom. Comput..

[3]  Masaki Ogino,et al.  Cognitive Developmental Robotics: A Survey , 2009, IEEE Transactions on Autonomous Mental Development.

[4]  Martin Hülse,et al.  Developmental robotics architecture for active vision and reaching , 2011, 2011 IEEE International Conference on Development and Learning (ICDL).

[5]  A. Takanishi,et al.  Learning the reachable space of a humanoid robot: A bio-inspired approach , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[6]  Mark H. Lee,et al.  Novelty and Habituation: The Driving Forces in Early Stage Learning for Developmental Robotics , 2005, Biomimetic Neural Learning for Intelligent Robots.

[7]  Mark Lee,et al.  Infant Development Sequences for Shaping Sensorimotor Learning in Humanoid Robots , 2010, EpiRob.

[8]  Giulio Sandini,et al.  Autonomous learning of 3D reaching in a humanoid robot , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Mian Liu,et al.  Design of robotic visual servo control based on neural network and genetic algorithm , 2012, International Journal of Automation and Computing.

[10]  Mark H. Lee,et al.  Robot Competence Development by Constructive Learning , 2010 .

[11]  Alexander Stoytchev,et al.  Some Basic Principles of Developmental Robotics , 2009, IEEE Transactions on Autonomous Mental Development.

[12]  Mark H. Lee,et al.  A developmental algorithm for ocular-motor coordination , 2010, Robotics Auton. Syst..

[13]  Min Jiang,et al.  Robotic 3D reaching through a development-driven double neural network architecture , 2011 .

[14]  Marco Antonelli,et al.  Implicit Sensorimotor Mapping of the Peripersonal Space by Gazing and Reaching , 2011, IEEE Transactions on Autonomous Mental Development.

[15]  De Xu,et al.  A new calibration method for an inertial and visual sensing system , 2012, Int. J. Autom. Comput..

[16]  Min Jiang,et al.  A developmental constraint driven approach to developmental robotic hand-eye coordination , 2012, 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[17]  Piotr Dudek,et al.  Self-Organizing Neural Population Coding for improving robotic visuomotor coordination , 2011, The 2011 International Joint Conference on Neural Networks.

[18]  Mark H. Lee,et al.  Staged Competence Learning in Developmental Robotics , 2007, Adapt. Behav..

[19]  Philippe Gaussier,et al.  Learning Invariant Sensorimotor Behaviors: A Developmental Approach to Imitation Mechanisms , 2004, Adapt. Behav..

[20]  Giulio Sandini,et al.  Developmental robotics: a survey , 2003, Connect. Sci..

[21]  Laxmidhar Behera,et al.  Visual servoing of redundant manipulator with Jacobian matrix estimation using self-organizing map , 2010, Robotics Auton. Syst..

[22]  P. Rochat,et al.  Multimodal perception in the control of infant reaching. , 1994, Journal of experimental psychology. Human perception and performance.

[23]  Patricia Shaw,et al.  A biologically constrained architecture for developmental learning of eye–head gaze control on a humanoid robot , 2013, Auton. Robots.

[24]  Mark H. Lee,et al.  Error-driven active learning in growing radial basis function networks for early robot learning , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[25]  Qinggang Meng,et al.  Psychologically Inspired Sensory-Motor Development in Early Robot Learning , 2005 .

[26]  Peter Ford Dominey,et al.  Robot Cognitive Control with a Neurophysiologically Inspired Reinforcement Learning Model , 2011, Front. Neurorobot..

[27]  Fei Chao,et al.  An autonomous developmental learning approach for robotic eye-hand coordination. , 2009 .

[28]  Mark H. Lee,et al.  Developmental learning for autonomous robots , 2007, Robotics Auton. Syst..

[29]  J C Houk,et al.  Action selection and refinement in subcortical loops through basal ganglia and cerebellum , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[30]  Mark H. Lee,et al.  The infant development timeline and its application to robot shaping , 2011, Adapt. Behav..

[31]  Atsuo Takanishi,et al.  Incremental development of multiple tool models for robotic reaching through autonomous exploration , 2012, Paladyn J. Behav. Robotics.

[32]  Qinggang Meng,et al.  Automated cross-modal mapping in robotic eye/hand systems using plastic radial basis function networks , 2007, Connect. Sci..

[33]  Min Jiang,et al.  Integration of brain-like computational structure and infant behaviorial pattern for robotic hand-eye coordination , 2012, 2012 12th International Conference on Control Automation Robotics & Vision (ICARCV).

[34]  Mark H. Lee,et al.  Integration of Active Vision and Reaching From a Developmental Robotics Perspective , 2010, IEEE Transactions on Autonomous Mental Development.

[35]  Neil E. Berthier,et al.  The Syntax of Human Infant Reaching , 2022 .

[36]  T. Prescott,et al.  Modelling Natural Action Selection: Index , 2011 .

[37]  N. Berthier,et al.  Visual information and object size in infant reaching. , 2010, Infant behavior & development.

[38]  Thomas R. Shultz,et al.  Connectionist Models of Reinforcement, Imitation, and Instruction in Learning to Solve Complex Problems , 2009, IEEE Transactions on Autonomous Mental Development.