Object pose estimation for grasping based on robust center point detection

The objective of this study is to design a grasping system for a mobile manipulator, such that it can find and grasp a target object using vision. Speed up robust feature (SURF) algorithm was adopted to define features of the target object and match features between current image and object database to confirm the target. To strengthen the feature matching results and calculate the necessary reference control point, we adopted RANdom Sample Consensus(RANSAC) algorithm to estimate the planar transformation matrix (Homography matrix) in order to accurately mark the center of target. A control design was developed based-on coordinate estimation for visual servoing of the mobile manipulator. Experiments on a self-constructed mobile manipulator reveal that the proposed method can find and grasp a target object successfully.

[1]  C. S. G. Lee,et al.  Robotics: Control, Sensing, Vision, and Intelligence , 1987 .

[2]  Kimitoshi Yamazaki,et al.  A grasp planning for picking up an unknown object for a mobile manipulator , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[3]  Masahiro Tomono,et al.  3-D Object Map Building Using Dense Object Models with SIFT-based Recognition Features , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Sukhan Lee,et al.  A real-time 3D workspace modeling with stereo camera , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[6]  José Miguel Buenaposada,et al.  Improving RANSAC for fast landmark recognition , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[7]  Sukhan Lee,et al.  Real-time 3D object pose estimation and tracking for natural landmark based visual servo , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Kai-Tai Song,et al.  Self-localization and control of an omni-directional mobile robot based on an omni-directional camera , 2009, 2009 7th Asian Control Conference.

[9]  Aiguo Ming,et al.  Home service by a mobile manipulator system -System configuration and basic experiments- , 2008, 2008 International Conference on Information and Automation.

[10]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[11]  Moonhong Baeg,et al.  An object recognition system for a smart home environment on the basis of color and texture descriptors , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Sukhan Lee,et al.  VIsion force control in task-oriented grasping and manipulation , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Sukhan Lee,et al.  3D object recognition using multiple features for robotic manipulation , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[14]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[15]  Hadi Moradi,et al.  Spatial Reasoning for Real-time Robotic Manipulation , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Alois Knoll,et al.  Fully Automatic Real-Time 3D Object Tracking using Active Contour and Appearance Models , 2006, J. Multim..

[17]  Tamim Asfour,et al.  Stereo-based 6D object localization for grasping with humanoid robot systems , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.