Combining force and visual feedback for physical interaction tasks in humanoid robots

In this paper we present a framework for combining force and visual feedback in the task space to deal with humanoid interaction tasks like open doors in a real kitchen environment. We present stereo-vision methods for markerless recognition and estimation of environmetal elements for applying force control strategies for compliant execution using a 6D force-torque sensor mounted in the humnaoids's wrist. The framework consists of components for model-based self-localization, visual planning, door recognition, grasping based on visual servoing, real time handle tracking and task execution considering force feedback during the physical interaction with the environment. Experimental results on the humanoid robot ARMAR-IIIa are presented.

[1]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[2]  Masayuki Inaba,et al.  Dynamically-Stable Motion Planning for Humanoid Robots , 2002, Auton. Robots.

[3]  Tamim Asfour,et al.  Toward humanoid manipulation in human-centred environments , 2008, Robotics Auton. Syst..

[4]  Srikanta Patnaik.  Robot cognition and navigation - an experiment with mobile robots , 2007, Cognitive Technologies.

[5]  Shuuji Kajita,et al.  Pushing manipulation by humanoid considering two-kinds of ZMPs , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[6]  Eduardo Bayro-Corrochano,et al.  Model-Based Visual Self-localization Using Gaussian Spheres , 2010, Geometric Algebra Computing.

[7]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[8]  Tatsuo Arai,et al.  Mobile manipulation of humanoids-real-time control based on manipulability and stability , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[9]  Tamim Asfour,et al.  ARMAR-III: An Integrated Humanoid Platform for Sensory-Motor Control , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[10]  Satoshi Kagami,et al.  Learning object models for whole body manipulation , 2007, 2007 7th IEEE-RAS International Conference on Humanoid Robots.

[11]  Angel P. del Pobil,et al.  Task-Oriented Grasping using Hand Preshapes and Task Frames , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[12]  Sukhan Lee,et al.  VIsion force control in task-oriented grasping and manipulation , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Rüdiger Dillmann,et al.  Model-based visual self-localization using geometry and graphs , 2008, 2008 19th International Conference on Pattern Recognition.

[14]  Joris De Schutter,et al.  Specification of force-controlled actions in the "task frame formalism"-a synthesis , 1996, IEEE Trans. Robotics Autom..

[15]  Masayuki Inaba,et al.  Vision based behavior verification system of humanoid robot for daily environment tasks , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[16]  Alex M. Andrew,et al.  ROBO SAPIENS: EVOLUTION OF A NEW SPECIES, by Peter Menzel and Faith D'Aluisio, Material World, Napa, California and MIT Press, Cambridge, Mass., 2000, 240 pp., ISBN 0–262–13382–2 (hardback, £19.95). , 2001, Robotica.

[17]  William J. Wilson,et al.  Relative end-effector control using Cartesian position based visual servoing , 1996, IEEE Trans. Robotics Autom..

[18]  Matthew T. Mason,et al.  Compliance and Force Control for Computer Controlled Manipulators , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[19]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Rüdiger Dillmann,et al.  Visual servoing for humanoid grasping and manipulation tasks , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[21]  Tamim Asfour,et al.  Compliant interaction in household environments by the Armar-III humanoid robot , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.