Target Position and Posture Recognition Based on RGB-D Images for Autonomous Grasping Robot Arm Manipulation

Target position and posture recognition play a key role for the autonomous grasping manipulation of the robot arm. This paper proposes a novel target recognition method based on the RGB-D image. The RGB-D image is achieved by combining the target RGB image with its depth image. The combination is realized by means of the joint coordinate calibration. In order to recognize the target, this paper firstly establishes the target template by placing the target object on a reference position in the experimental scene. Furthermore, an improved Iterative Closest Point (ICP) algorithm is employed. By matching the real-time target RGB-D image with the established target template, the target position and posture can be recognized accurately. The proposed method has been applied in an experimental robot arm to grasp the object autonomously, and the result shows that the proposed method is effective.

[1]  Pavel Krsek,et al.  Robust Euclidean alignment of 3D point sets: the trimmed iterative closest point algorithm , 2005, Image Vis. Comput..

[2]  Lorenzo Bruzzone,et al.  A Novel Transductive SVM for Semisupervised Classification of Remote-Sensing Images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Hu Xiaoguang,et al.  An improved Canny edge detection algorithm for color image , 2012, IEEE 10th International Conference on Industrial Informatics.

[4]  Pavol Fedor,et al.  Autonomous flying with quadrocopter using fuzzy control and ArUco markers , 2017, Intell. Serv. Robotics.

[5]  Joseph Redmon,et al.  Real-time grasp detection using convolutional neural networks , 2014, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Patricio A. Vela,et al.  Real-World Multiobject, Multigrasp Detection , 2018, IEEE Robotics and Automation Letters.

[7]  Tim Ritchings,et al.  The use of normalized cross-correlation analysis for automatic tendon excursion measurement in dynamic ultrasound imaging. , 2013, Journal of applied biomechanics.

[8]  Timothy D. Hanks,et al.  Probabilistic Population Codes for Bayesian Decision Making , 2008, Neuron.

[9]  Lei Zhu,et al.  Image salient region detection based on the learning of feature distribution , 2017, 2017 36th Chinese Control Conference (CCC).

[10]  Vijayan K. Asari,et al.  Speeded-Up Robust Features Based Moving Object Detection on Shaky Video , 2011 .

[11]  Sung-Bae Cho,et al.  Context-Based Scene Recognition Using Bayesian Networks with Scale-Invariant Feature Transform , 2006, ACIVS.

[12]  George Kesidis,et al.  Margin-Maximizing Feature Elimination Methods for Linear and Nonlinear Kernel-Based Discriminant Functions , 2010, IEEE Transactions on Neural Networks.

[13]  Honglak Lee,et al.  Deep learning for detecting robotic grasps , 2013, Int. J. Robotics Res..

[14]  Paul D. Gader,et al.  Robust kernel PCA using fuzzy membership , 2009, 2009 International Joint Conference on Neural Networks.