Unfolding of a rectangular cloth from unarranged starting shapes by a Dual-Armed robot with a mechanism for managing recognition error and uncertainty

Graphical Abstract We propose a method for unfolding a rectangular cloth placed on a table in an arbitrary unarranged shape, using a dual arm robot. There are many situations where the manipulation of fabric products by dual arm robots is slow due to operation complexity. Also, observation of fabric products in unarranged shapes can be fraught with uncertainty, posing further difficulties for robotic manipulation. In this article, we address these problems for our specific task, implementing a ‘pinch and slide motion’ to address the former issue, and an operation selection mechanism implemented as a partially observable Markov decision process to address the latter. We used this approach to let a robot unfold a rectangular cloth, thereby experimentally verifying the effectiveness of our approach.

[1]  Danfei Xu,et al.  Multi-sensor surface analysis for robotic ironing , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Shinichi Hirai,et al.  Handling of hemmed fabrics by a single-armed robot , 2008, 2008 IEEE International Conference on Automation Science and Engineering.

[3]  Li Sun,et al.  Accurate garment surface analysis using an active stereo robot head with application to dual-arm flattening , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Carme Torras,et al.  Action Selection for Robotic Manipulation of Deformable Planar Objects , 2009 .

[5]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[6]  Carme Torras,et al.  POMDP approach to robotized clothes separation , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Milos Hauskrecht,et al.  Value-Function Approximations for Partially Observable Markov Decision Processes , 2000, J. Artif. Intell. Res..

[8]  Pieter Abbeel,et al.  Cloth grasp point detection based on multiple-view geometric cues with application to robotic towel folding , 2010, 2010 IEEE International Conference on Robotics and Automation.

[9]  Ian D. Walker,et al.  Classification of clothing using interactive perception , 2011, 2011 IEEE International Conference on Robotics and Automation.

[10]  Nobuyuki Kita,et al.  A deformable model driven method for handling clothes , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[11]  D. Sagi,et al.  Gabor filters as texture discriminator , 1989, Biological Cybernetics.

[12]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[13]  Ryuichiro Higashinaka,et al.  Dialogue Control by Pomdp Using Dialogue Data Statistics , 2011, Spoken Dialogue Systems Technology and Design.

[14]  Tsuyoshi Ohta,et al.  Robotic Unfolding of Hemmed Fabric using Pinching Slip Motion , 2010 .

[15]  Hitoshi Akami,et al.  Robot hand with sensor for handling cloth , 1990, EEE International Workshop on Intelligent Robots and Systems, Towards a New Frontier of Applications.

[16]  Vladimír Petrík,et al.  Garment perception and its folding using a dual-arm robot , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Francesc Moreno-Noguer,et al.  Using depth and appearance features for informed robot grasping of highly wrinkled clothes , 2012, 2012 IEEE International Conference on Robotics and Automation.

[18]  Carme Torras,et al.  Action selection for robotic manipulation of deformable objects , 2008 .

[19]  Tae-Kyun Kim,et al.  Autonomous active recognition and unfolding of clothes using random decision forests and probabilistic planning , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[20]  Hiroaki Seki,et al.  Unfolding of Massive Laundry and Classification Types by Dual Manipulator , 2007, J. Adv. Comput. Intell. Intell. Informatics.

[21]  Hitoshi Akami,et al.  Robot Hand with a Sensor for Cloth Handling , 1989 .