Visual servoing for the REEM humanoid robot's upper body

In this paper, a framework for visual servo control of a humanoid robot's upper body is presented. The framework is then implemented and tested on the REEM humanoid robot. The implementation is composed of 2 controllers - a head gaze control and a hand position control. The main application is precise manipulation tasks using the hand. For this, the hand controller takes top priority. The head controller is designed to keep both the hand and object in the eye field of view. For robustness, a secondary task of joint limit avoidance is implemented using the redundancy framework and a large projection operator proposed recently. For safety, joint velocity scaling is implemented. The implementation on REEM is done using the ROS and ViSP middleware. The results presented show simulations on Gazebo and experiments on the real robot. Furthermore, results with the real robot show how visual servoing is able to overcome some deficiency in REEM's kinematic calibration.

[1]  Claire Dune,et al.  Vision based control for Humanoid robots , 2011 .

[2]  Pradeep K. Khosla,et al.  Strategies for Increasing the Tracking Region of an Eye-in-Hand System by Singularity and Joint Limit Avoidance , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[3]  Andrew Howard,et al.  Design and use paradigms for Gazebo, an open-source multi-robot simulator , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[4]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[5]  A. Liegeois,et al.  Automatic supervisory control of the configuration and behavior of multi-body mechanisms , 1977 .

[6]  Olivier Stasse,et al.  Visually-Guided Grasping while Walking on a Humanoid Robot , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[7]  Seth Hutchinson,et al.  Visual Servo Control Part I: Basic Approaches , 2006 .

[8]  Danica Kragic,et al.  Model based techniques for robotic servoing and grasping , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[10]  G. Metta,et al.  Learning precise 3D reaching in a humanoid robot , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[11]  Michael Beetz,et al.  Real-time perception-guided motion planning for a personal robot , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Geoffrey Taylor,et al.  Visual Perception and Robotic Manipulation: 3D Object Recognition, Tracking and Hand-Eye Coordination (Springer Tracts in Advanced Robotics) , 2006 .

[13]  François Chaumette,et al.  Visual servo control. II. Advanced approaches [Tutorial] , 2007, IEEE Robotics & Automation Magazine.

[14]  Rüdiger Dillmann,et al.  Visual servoing for humanoid grasping and manipulation tasks , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[15]  S. Hutchinson,et al.  Visual Servo Control Part II : Advanced Approaches , 2007 .

[16]  François Chaumette,et al.  New strategies for avoiding robot joint limits: Application to visual servoing using a large projection operator , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  François Chaumette,et al.  A new large projection operator for the redundancy framework , 2010, 2010 IEEE International Conference on Robotics and Automation.

[18]  Gregory D. Hager,et al.  Dynamic sensor planning in visual servoing , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[19]  Fadi Dornaika,et al.  Visually guided object grasping , 1998, IEEE Trans. Robotics Autom..

[20]  Éric Marchand,et al.  ViSP for visual servoing: a generic software platform with a wide class of robot control skills , 2005, IEEE Robotics & Automation Magazine.