Real-time tracking meets online grasp planning

Describes a synergistic integration of a grasping simulator and a real-time visual tracking system, that work in concert to (1) find an object's pose, (2) plan grasps and movement trajectories, and (3) visually monitor task execution. Starting with a CAD model of an object to be grasped, the system can find the object's pose through vision which then synchronizes the state of the robot workcell with an online, model-based grasp planning and visualization system we have developed called GraspIt. GraspIt can then plan a stable grasp for the object, and direct the robotic hand system to perform the grasp. It can also generate trajectories for the movement of the grasped object, which are used by the visual control system to monitor the task and compare the actual grasp and trajectory with the planned ones. We present experimental results using typical grasping tasks.

[1]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[2]  Helder Araujo,et al.  A Fully Projective Formulation for Lowe's Tracking Algorithm , 1996 .

[3]  Karun B. Shimoga,et al.  Robot Grasp Synthesis Algorithms: A Survey , 1996, Int. J. Robotics Res..

[4]  Gerd Hirzinger,et al.  Real-time visual tracking of 3D objects with dynamic handling of occlusion , 1997, Proceedings of International Conference on Robotics and Automation.

[5]  Peter K. Allen,et al.  Visual control of grasping , 1997, Block Island Workshop on Vision and Control.

[6]  The XVision system : a general-purpose substrate for portable real-time vision applications , 1998 .

[7]  Ken Goldberg,et al.  Computing Parallel-Jaw Grip Points , 1998 .

[8]  Peter K. Allen,et al.  Examples of 3D grasp quality computations , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[9]  Peter K. Allen,et al.  GraspIt!: A Versatile Simulator for Grasp Analysis , 2000, Dynamic Systems and Control: Volume 2.

[10]  Vijay Kumar,et al.  Robotic grasping and contact: a review , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[11]  Patrick Bouthemy,et al.  A 2D-3D model-based approach to real-time visual tracking , 2001, Image Vis. Comput..