VIsion force control in task-oriented grasping and manipulation

In this paper, we present a novel approach for sensor-guided robotic execution of everyday tasks, which is amenable to be integrated in current mobile manipulators and humanoid robots. We consider a robot which is observing simultaneously his hand and the object to manipulate, by using an external camera (i.e. robot head). Task-oriented grasping algorithms are used in order to plan a suitable grasp on the object according to the task to perform. A new vision/force coupling approach [1] is used in order to, first, guide the robot hand towards the grasp position and, second, perform the task taking into account external forces. Experimental results on a real robot are presented which validate our approach.

[1]  Henrik I. Christensen,et al.  Automatic grasp planning using shape primitives , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[2]  Minoru Asada,et al.  Adaptive hybrid visual servoing/force control in unknown environment , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[3]  E. Malis,et al.  2 1/2 D Visual Servoing , 1999 .

[4]  G. Morel,et al.  Impedance based combination of visual and force control , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[5]  Éric Marchand,et al.  ViSP for visual servoing: a generic software platform with a wide class of robot control skills , 2005, IEEE Robotics & Automation Magazine.

[6]  Nicolas Mansard,et al.  Task Sequencing for High-Level Sensor-Based Control , 2007, IEEE Transactions on Robotics.

[7]  Philippe Martinet,et al.  Position based visual servoing using a non-linear approach , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[8]  Fadi Dornaika,et al.  Visually guided object grasping , 1998, IEEE Trans. Robotics Autom..

[9]  Angel P. del Pobil,et al.  Task-Oriented Grasping using Hand Preshapes and Task Frames , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[10]  Helge J. Ritter,et al.  Task-oriented quality measures for dextrous grasping , 2005, 2005 International Symposium on Computational Intelligence in Robotics and Automation.

[11]  Gerd Hirzinger,et al.  Grasp planning: how to choose a suitable task wrench space , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[12]  Éric Marchand,et al.  Virtual Visual Servoing: a framework for real‐time augmented reality , 2002, Comput. Graph. Forum.

[13]  Sukhan Lee,et al.  Robust Recognition and Pose Estimation of 3D Objects Based on Evidence Fusion in a Sequence of Images , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[14]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[15]  Véronique Perdereau,et al.  A new scheme for hybrid force-position control , 1993 .

[16]  Geoffrey Taylor,et al.  Flexible Self-Calibrated Visual Servoing for a Humanoid Robot , 2001 .