Fuzzy-Depth Objects Grasping Based on FSG Algorithm and a Soft Robotic Hand

Autonomous grasping is an important factor for robots physically interacting with the environment and executing versatile tasks. However, a universally applicable, cost-effective, and rapidly deployable autonomous grasping approach is still limited by those target objects with fuzzy-depth information. Examples are transparent, specular, flat, and small objects whose depth is difficult to be accurately sensed. In this work, we present a solution to those fuzzy-depth objects. The framework of our approach includes two major components: one is a soft robotic hand and the other one is a Fuzzy-depth Soft Grasping (FSG) algorithm. The soft hand is replaceable for most existing soft hands/grippers with body compliance. FSG algorithm exploits both RGB and depth images to predict grasps while not trying to reconstruct the whole scene. Two grasping primitives are designed to further increase robustness. The proposed method outperforms reference baselines in unseen fuzzy-depth objects grasping experiments (84% success rate).

[1]  Peter Corke,et al.  Closing the Loop for Robotic Grasping: A Real-time, Generative Grasp Synthesis Approach , 2018, Robotics: Science and Systems.

[2]  Manuel Menezes de Oliveira Neto,et al.  Domain transform for edge-aware image and video processing , 2011, ACM Trans. Graph..

[3]  Oussama Khatib,et al.  Springer Handbook of Robotics , 2007, Springer Handbooks.

[4]  Zheng Wang,et al.  A Soft-Robotic Gripper With Enhanced Object Adaptation and Grasping Reliability , 2017, IEEE Robotics and Automation Letters.

[5]  Ken Goldberg,et al.  On-Policy Dataset Synthesis for Learning Robot Grasping Policies Using Fully Convolutional Deep Networks , 2019, IEEE Robotics and Automation Letters.

[6]  Zheng Wang,et al.  BCL-13: A 13-DOF Soft Robotic Hand for Dexterous Grasping and In-Hand Manipulation , 2018, IEEE Robotics and Automation Letters.

[7]  Vijay Kumar,et al.  Robotic grasping and contact: a review , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[8]  脇元 修一,et al.  IEEE International Conference on Robotics and Automation (ICRA) におけるフルードパワー技術の研究動向 , 2011 .

[9]  Giuseppe Averta,et al.  Learning From Humans How to Grasp: A Data-Driven Architecture for Autonomous Grasping With Anthropomorphic Soft Hands , 2019, IEEE Robotics and Automation Letters.

[10]  Jürgen Leitner,et al.  Learning robust, real-time, reactive robotic grasping , 2019, Int. J. Robotics Res..

[11]  Ashutosh Saxena,et al.  Efficient grasping from RGBD images: Learning using a new rectangle representation , 2011, 2011 IEEE International Conference on Robotics and Automation.

[12]  J. Andrew Bagnell,et al.  Human-inspired force compliant grasping primitives , 2014, Auton. Robots.

[13]  Yong Hu,et al.  Adaptive Variable Stiffness Particle Phalange for Robust and Durable Robotic Grasping. , 2020, Soft robotics.

[14]  Odest Chadwicke Jenkins,et al.  LIT: Light-Field Inference of Transparency for Refractive Object Localization , 2020, IEEE Robotics and Automation Letters.

[15]  Hanan Samet,et al.  A general approach to connected-component labeling for arbitrary image representations , 1992, JACM.

[16]  Sachin Chitta,et al.  MoveIt! [ROS Topics] , 2012, IEEE Robotics Autom. Mag..

[17]  Zhengyou Zhang,et al.  Microsoft Kinect Sensor and Its Effect , 2012, IEEE Multim..

[18]  Oliver Brock,et al.  Exploitation of environmental constraints in human and robotic grasping , 2015, Int. J. Robotics Res..

[19]  Zheng Wang,et al.  A soft robotic approach to robust and dexterous grasping , 2018, 2018 IEEE International Conference on Soft Robotics (RoboSoft).

[20]  Stefan Leutenegger,et al.  Deep learning a grasp function for grasping under gripper pose uncertainty , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[21]  Monica Carfagni,et al.  Metrological and Critical Characterization of the Intel D415 Stereo Depth Camera , 2018, Sensors.

[22]  C. Majidi.  Soft Robotics: A Perspective—Current Trends and Prospects for the Future , 2014 .

[23]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[24]  Shuran Song,et al.  Clear Grasp: 3D Shape Estimation of Transparent Objects for Manipulation , 2019, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[25]  Kaiyu Hang,et al.  Pre-Grasp Sliding Manipulation of Thin Objects Using Soft, Compliant, or Underactuated Hands , 2019, IEEE Robotics and Automation Letters.

[26]  Yong Hu,et al.  A Soft-Robotic Approach to Anthropomorphic Robotic Hand Dexterity , 2019, IEEE Access.

[27]  Ferat Sahin,et al.  Antipodal Robotic Grasping using Generative Residual Convolutional Neural Network , 2019, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[28]  Odest Chadwicke Jenkins,et al.  GlassLoc: Plenoptic Grasp Pose Detection in Transparent Clutter , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[29]  Dani Lischinski,et al.  DO-Conv: Depthwise Over-Parameterized Convolutional Layer , 2020, IEEE Transactions on Image Processing.

[30]  Jianshu Zhou,et al.  A Grasping Component Mapping Approach for Soft Robotic End-Effector Control , 2019, 2019 2nd IEEE International Conference on Soft Robotics (RoboSoft).

[31]  Xinyu Liu,et al.  Dex-Net 2.0: Deep Learning to Plan Robust Grasps with Synthetic Point Clouds and Analytic Grasp Metrics , 2017, Robotics: Science and Systems.

[32]  Oliver Kroemer,et al.  Multi-Modal Transfer Learning for Grasping Transparent and Specular Objects , 2020, IEEE Robotics and Automation Letters.

[33]  Siddhartha S. Srinivasa,et al.  The YCB object and Model set: Towards common benchmarks for manipulation research , 2015, 2015 International Conference on Advanced Robotics (ICAR).

[34]  Emmanuel Dellandréa,et al.  Jacquard: A Large Scale Dataset for Robotic Grasp Detection , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[35]  Kevin Huang,et al.  Sensor-aided teleoperated grasping of transparent objects , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[36]  Mark R. Cutkosky,et al.  On grasp choice, grasp models, and the design of hands for manufacturing tasks , 1989, IEEE Trans. Robotics Autom..

[37]  Michael Firman,et al.  RGBD Datasets: Past, Present and Future , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[38]  Danica Kragic,et al.  Trends and challenges in robot manipulation , 2019, Science.