A Grasping-Centered Analysis for Cloth Manipulation

Compliant and soft hands have gained a lot of attention in the past decade because of their ability to adapt to the shape of the objects, increasing their effectiveness for grasping. However, when it comes to grasping highly flexible objects such as textiles, we face the dual problem: it is the object that will adapt to the shape of the hand or gripper. In this context, the classic grasp analysis or grasping taxonomies are not suitable for describing textile objects grasps. This article proposes a novel definition of textile object grasps that abstracts from the robotic embodiment or hand shape and recovers concepts from the early neuroscience literature on hand prehension skills. This framework enables us to identify what grasps have been used in literature until now to perform robotic cloth manipulation, and allows for a precise definition of all the tasks that have been tackled in terms of manipulation primitives based on regrasps. In addition, we also review what grippers have been used. Our analysis shows how the vast majority of cloth manipulations have relied only on one type of grasp, and at the same time we identify several tasks that need more variety of grasp types to be executed successfully. Our framework is generic, provides a classification of cloth manipulation primitives and can inspire gripper design and benchmark construction for cloth manipulation.

[1]  Dana Kulic,et al.  Incremental learning of full body motion primitives and their sequencing through human motion observation , 2012, Int. J. Robotics Res..

[2]  Alberto Rodriguez,et al.  Prehensile pushing: In-hand manipulation with push-primitives , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[3]  Carme Torras,et al.  Action selection for robotic manipulation of deformable objects , 2008 .

[4]  Sergey Levine,et al.  Learning force-based manipulation of deformable objects from multiple demonstrations , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Aaron M. Dollar,et al.  A Hand-Centric Classification of Human and Robot Dexterous Manipulation , 2013, IEEE Transactions on Haptics.

[6]  Yoshiro Imai,et al.  Development of a high-speed multifingered hand system and its application to catching , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[7]  Thea Iberall,et al.  Human Prehension and Dexterous Robot Hands , 1997, Int. J. Robotics Res..

[8]  Sònia Donaire Cónsul.  Mà robòtica multifuncional per a tasques domèstiques , 2019 .

[9]  Kosei Kitagaki,et al.  Picking up a piece of fabric from layers by a hand with 3 fingers and a palm , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[10]  Kunikatsu Takase,et al.  On better pushing for picking a piece of fabric from layers , 2007, 2007 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[11]  Carme Torras,et al.  Dimensionality Reduction for Dynamic Movement Primitives and Application to Bimanual Manipulation of Clothes , 2018, IEEE Transactions on Robotics.

[12]  Eren Erdal Aksoy,et al.  Library of actions: Implementing a generic robot execution framework by using manipulation action semantics , 2019, Int. J. Robotics Res..

[13]  Shinichi Hirai,et al.  Fabric manipulation utilizing contacts with the environment , 2012, 2012 IEEE International Conference on Automation Science and Engineering (CASE).

[14]  Belhassen-Chedli Bouzgarrou,et al.  Robotic manipulation and sensing of deformable objects in domestic and industrial applications: a survey , 2018, Int. J. Robotics Res..

[15]  Nikos A. Aspragathos,et al.  A 3-Finger Robotic Gripper for Grasping Fabrics Based on Cams-Followers Mechanism , 2017, RAAD.

[16]  Carme Torras,et al.  Service Robots for Citizens of the Future , 2016, European Review.

[17]  Kyoko Hamajima,et al.  Planning strategy for task of unfolding clothes , 1997, Robotics Auton. Syst..

[18]  Francesc Moreno-Noguer,et al.  Using depth and appearance features for informed robot grasping of highly wrinkled clothes , 2012, 2012 IEEE International Conference on Robotics and Automation.

[19]  Aaron M. Dollar,et al.  Variable-Friction Finger Surfaces to Enable Within-Hand Manipulation via Gripping and Sliding , 2018, IEEE Robotics and Automation Letters.

[20]  Sören Kammel,et al.  Bimanual robotic cloth manipulation for laundry folding , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Carme Torras,et al.  A Versatile Gripper for Cloth Manipulation , 2020, IEEE Robotics and Automation Letters.

[22]  Oliver Brock,et al.  Exploitation of environmental constraints in human and robotic grasping , 2015, Int. J. Robotics Res..

[23]  Dmitry Berenson,et al.  Accounting for Directional Rigidity and Constraints in Control for Manipulation of Deformable Objects without Physical Simulation , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[24]  Masahiko Inami,et al.  Foldy: Graphical Teaching for Garment-Folding Robot , 2010 .

[25]  Vladimír Petrík,et al.  Folding Clothes Autonomously: A Complete Pipeline , 2016, IEEE Transactions on Robotics.

[26]  Mark R. Cutkosky,et al.  On grasp choice, grasp models, and the design of hands for manufacturing tasks , 1989, IEEE Trans. Robotics Autom..

[27]  Henrik I. Christensen,et al.  A Taxonomy of Benchmark Tasks for Robot Manipulation , 2015, ISRR.

[28]  Angel P. del Pobil,et al.  Toward Replicable and Measurable Robotics Research [From the Guest Editors] , 2015, IEEE Robotics Autom. Mag..

[29]  Stefano Carpin,et al.  Combining imitation and reinforcement learning to fold deformable planar objects , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[30]  Danfei Xu,et al.  Folding deformable objects using predictive simulation and trajectory optimization , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[31]  Solvi Arnold,et al.  Unfolding of a rectangular cloth from unarranged starting shapes by a Dual-Armed robot with a mechanism for managing recognition error and uncertainty , 2017, Adv. Robotics.

[32]  Hiroaki Seki,et al.  Unfolding of Massive Laundry and Classification Types by Dual Manipulator , 2007, J. Adv. Comput. Intell. Intell. Informatics.

[33]  Khairul Salleh Mohamed Sahari,et al.  Edge Tracing Manipulation of Clothes Based on Different Gripper Types , 2010 .

[34]  Eren Erdal Aksoy,et al.  Learning the semantics of object–action relations by observation , 2011, Int. J. Robotics Res..

[35]  Nikos A. Aspragathos,et al.  Underactuated 3-finger robotic gripper for grasping fabrics , 2014, 2014 23rd International Conference on Robotics in Alpe-Adria-Danube Region (RAAD).

[36]  Carme Torras,et al.  Parameterizing prehension: a mathematical model of opposition space , 1991 .

[37]  Pieter Abbeel,et al.  Cloth grasp point detection based on multiple-view geometric cues with application to robotic towel folding , 2010, 2010 IEEE International Conference on Robotics and Automation.

[38]  Shinichi Hirai,et al.  Wiping motion for deformable object handling , 2009, 2009 IEEE International Conference on Robotics and Automation.

[39]  Masatoshi Ishikawa,et al.  Motion planning for dynamic folding of a cloth with two high-speed robot hands and two high-speed sliders , 2011, 2011 IEEE International Conference on Robotics and Automation.

[40]  Matthew P. Bell,et al.  Flexible Object Manipulation , 2010 .

[41]  Ian D. Walker,et al.  Model for unfolding laundry using interactive perception , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[42]  Nikos A. Aspragathos,et al.  A knowledge-based system for the conceptual design of grippers for handling fabrics , 1999, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[43]  Masayoshi Kakikura,et al.  Service Robot for Housekeeping - Clothing Handling - , 1998, J. Robotics Mechatronics.

[44]  Khairul Salleh Mohamed Sahari,et al.  Clothes Manipulation by Robot Grippers with Roller Fingertips , 2010, Adv. Robotics.

[45]  Kimitoshi Yamazaki,et al.  A method of picking up a folded fabric product by a single-armed robot , 2018 .

[46]  M. Arbib,et al.  Opposition Space as a Structuring Concept for the Analysis of Skilled Hand Movements , 1986 .

[47]  James F. O'Brien,et al.  Bringing clothing into desired configurations with limited perception , 2011, 2011 IEEE International Conference on Robotics and Automation.

[48]  P. Jiménez,et al.  Visual grasp point localization, classification and state recognition in robotic manipulation of cloth: An overview , 2017, Robotics Auton. Syst..

[49]  Ales Ude,et al.  A Simple Ontology of Manipulation Actions Based on Hand-Object Relations , 2013, IEEE Transactions on Autonomous Mental Development.

[50]  Nobuyuki Kita,et al.  Clothes handling based on recognition by strategic observation , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[51]  Carme Torras,et al.  POMDP approach to robotized clothes separation , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[52]  Dinesh Manocha,et al.  Manipulating Highly Deformable Materials Using a Visual Feedback Dictionary , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[53]  Dmitry Berenson,et al.  A Constraint-Aware Motion Planning Algorithm for Robotic Folding of Clothes , 2012, ISER.

[54]  Danica Kragic,et al.  The GRASP Taxonomy of Human Grasp Types , 2016, IEEE Transactions on Human-Machine Systems.

[55]  Trevor Darrell,et al.  A geometric approach to robotic laundry folding , 2012, Int. J. Robotics Res..

[56]  Matteo Zoppi,et al.  On the Development of a Specialized Flexible Gripper for Garment Handling , 2013 .

[57]  Solvi Arnold,et al.  Hanging work of T-shirt in consideration of deformability and stretchability , 2017, 2017 IEEE International Conference on Information and Automation (ICIA).

[58]  Shih-Fu Chang,et al.  Regrasping and unfolding of garments using predictive thin shell modeling , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[59]  Helge J. Ritter,et al.  Interaction skills for a coat-check robot: Identifying and handling the boundary components of clothes , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[60]  Li Sun,et al.  Accurate garment surface analysis using an active stereo robot head with application to dual-arm flattening , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[61]  Khairul Salleh Mohamed Sahari,et al.  Inchworm robot grippers for clothes manipulation , 2007, Artificial Life and Robotics.

[62]  Trevor Darrell,et al.  Parametrized shape models for clothing , 2011, 2011 IEEE International Conference on Robotics and Automation.

[63]  Siddhartha S. Srinivasa,et al.  Extrinsic dexterity: In-hand manipulation with external forces , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[64]  Pieter Abbeel,et al.  Gravity-Based Robotic Cloth Folding , 2010, WAFR.

[65]  M. Arbib.  Coordinated control programs for movements of the hand , 1985 .