Cloth Region Segmentation for Robust Grasp Selection

Cloth detection and manipulation is a common task in domestic and industrial settings, yet such tasks remain a challenge for robots due to cloth deformability. Furthermore, in many cloth-related tasks like laundry folding and bed making, it is crucial to manipulate specific regions like edges and corners, as opposed to folds. In this work, we focus on the problem of segmenting and grasping these key regions. Our approach trains a network to segment the edges and corners of a cloth from a depth image, distinguishing such regions from wrinkles or folds. We also provide a novel algorithm for estimating the grasp location, direction, and directional uncertainty from the segmentation. We demonstrate our method on a real robot system and show that it outperforms baseline methods on grasping success. Video and other supplementary materials are available at: this https URL.

[1]  Nikos A. Aspragathos,et al.  A geometric approach to robotic unfolding of garments , 2016, Robotics Auton. Syst..

[2]  Nikos A. Aspragathos,et al.  A Vision System for the Unfolding of Highly Non-rigid Objects on a Table by One Manipulator , 2011, ICIRA.

[3]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[4]  Kyoko Hamajima,et al.  Planning strategy for task of unfolding clothes , 1997, Robotics Auton. Syst..

[5]  Michael Laskey,et al.  Learning Robust Bed Making using Deep Imitation Learning with DART , 2017, ArXiv.

[6]  Kimitoshi Yamazaki,et al.  Gripping Positions Selection for Unfolding a Rectangular Cloth Product , 2018, 2018 IEEE 14th International Conference on Automation Science and Engineering (CASE).

[7]  Nikolaus Correll,et al.  Reducing the Barrier to Entry of Complex Robotic Software: a MoveIt! Case Study , 2014, ArXiv.

[8]  Pieter Abbeel,et al.  Learning to Manipulate Deformable Objects without Demonstrations , 2019, Robotics: Science and Systems.

[9]  Tae-Kyun Kim,et al.  Autonomous active recognition and unfolding of clothes using random decision forests and probabilistic planning , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[10]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[11]  Kimitoshi Yamazaki,et al.  Picking up One of the Folded and Stacked Towels by a Single Arm Robot , 2018, 2018 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[12]  Kimitoshi Yamazaki,et al.  A method of picking up a folded fabric product by a single-armed robot , 2018 .

[13]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[14]  Ian D. Walker,et al.  Model for unfolding laundry using interactive perception , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Danica Kragic,et al.  Benchmarking Bimanual Cloth Manipulation , 2020, IEEE Robotics and Automation Letters.

[17]  Pieter Abbeel,et al.  Cloth grasp point detection based on multiple-view geometric cues with application to robotic towel folding , 2010, 2010 IEEE International Conference on Robotics and Automation.

[18]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[19]  Soshi Iba,et al.  Deep Transfer Learning of Pick Points on Fabric for Robot Bed-Making , 2018, ISRR.

[20]  Sören Kammel,et al.  Bimanual robotic cloth manipulation for laundry folding , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.