Robotic grasp detection using deep learning and geometry model of soft hand

This paper proposes a method using deep learning and geometry model of soft hand for detecting the graspable positions and orientations of the objects from clustered scenes, given a point cloud from a single depth camera placed in the middle of the robot. With the method this paper proposed, which is different with others, it takes the collision problem into consideration without any segmentation and recognition of the objects. Significantly, this paper also analyses the computational complexity and the spacial complexity of CNN (a kind of deep learning), which can provide some useful tips for engineer to design the deep learning models. Firstly, a geometry model of soft hand (more flexible than hard hand) will be designed for searching appreciate closing cube in the 3D point clouds. A closing cube is regarded as a grasp hypothesis, which should be whole contained in the geometry model of soft hand without any collisions. And it includes all the parameters of positions and orientations which can be used to robotic grasping. Secondly, we use a deep learning method to classify and rank these grasp hypotheses, so that we can find out the best handle. Notably, the labeled training data set will be generated automatically with some criteria. As to say, these criteria, with which to make decision whether the grasp hypotheses are handles or not, will be instead of the trained deep learning model.

[1]  Robert Platt,et al.  Using Geometry to Detect Grasps in 3D Point Clouds , 2015, 1501.03100.

[2]  Quoc V. Le,et al.  High-accuracy 3D sensing for mobile manipulation: Improving object detection and door opening , 2009, 2009 IEEE International Conference on Robotics and Automation.

[3]  Jayantha Katupitiya,et al.  Novel robotic 3D surface mapping using range and vision fusion , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Andrew Y. Ng,et al.  Convolutional-Recursive Deep Learning for 3D Object Classification , 2012, NIPS.

[5]  R. Dillmann,et al.  Learning continuous grasp stability for a humanoid robot hand based on tactile sensing , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[6]  Saeid Nahavandi,et al.  An active stereo vision-based learning approach for robotic tracking, fixating and grasping control , 2002, 2002 IEEE International Conference on Industrial Technology, 2002. IEEE ICIT '02..

[7]  Guoyuan Liang,et al.  A vision-based robotic grasping system using deep learning for 3D object recognition and pose estimation , 2013, 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[8]  Markus Vincze,et al.  Learning grasps for unknown objects in cluttered scenes , 2013, 2013 IEEE International Conference on Robotics and Automation.

[9]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[10]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[11]  Jimmy A. Jørgensen,et al.  Assessing Grasp Stability Based on Learning and Haptic Data , 2011, IEEE Transactions on Robotics.

[12]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[13]  Robert Platt,et al.  Localizing Grasp Affordances in 3-D Points Clouds Using Taubin Quadric Fitting , 2013, ArXiv.

[14]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[15]  Honglak Lee,et al.  Deep learning for detecting robotic grasps , 2013, Int. J. Robotics Res..

[16]  Peter K. Allen,et al.  Learning grasp stability , 2012, 2012 IEEE International Conference on Robotics and Automation.

[17]  F. Medina,et al.  Classification of Solid Objects with Defined Shapes Using Stereoscopic Vision and a Robotic Arm , 2012, 2012 VI Andean Region International Conference.

[18]  Mohamed S. Kamel,et al.  An experimental approach to robotic grasping using reinforcement learning and generic grasping functions , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[19]  Ashutosh Saxena,et al.  Robotic Grasping of Novel Objects using Vision , 2008, Int. J. Robotics Res..

[20]  Danica Kragic,et al.  Learning grasp stability based on tactile data and HMMs , 2010, 19th International Symposium in Robot and Human Interactive Communication.

[21]  Ashutosh Saxena,et al.  Efficient grasping from RGBD images: Learning using a new rectangle representation , 2011, 2011 IEEE International Conference on Robotics and Automation.

[22]  Mohamed S. Kamel,et al.  A connectionist model for learning robotic grasps using reinforcement learning , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[23]  Peter K. Allen,et al.  An SVM learning approach to robotic grasping , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.