Enabling garment-agnostic laundry tasks for a Robot Household Companion

Abstract Domestic chores, such as laundry tasks, are dull and repetitive. These tasks consume a significant amount of daily time, and are however unavoidable. Additionally, a great portion of elder and disabled people require help to perform them due to lack of mobility. In this work we present advances towards a Robot Household Companion (RHC), focusing on the performance of two particular laundry tasks: unfolding and ironing garments. Unfolding is required to recognize the garment prior to any later folding operation. For unfolding, we apply an interactive algorithm based on the analysis of a colored 3D reconstruction of the garment. Regions are clustered based on height, and a bumpiness value is computed to determine the most suitable pick and place points to unfold the overlapping region. For ironing, a custom Wrinkleness Local Descriptor (WiLD) descriptor is applied to a 3D reconstruction to find the most significant wrinkles in the garment. These wrinkles are then ironed using an iterative path-following control algorithm that regulates the amount of pressure exerted on the garment. Both algorithms focus on the feasibility of a physical implementation in real unmodified environments. A set of experiments to validate the algorithms have been performed using a full-sized humanoid robot.

[1]  Carlos Balaguer,et al.  Sign Language Representation by TEO Humanoid Robot: End-User Interest, Comprehension and Satisfaction , 2019, Electronics.

[2]  Jian S. Dai,et al.  Trajectory and orientation analysis of the ironing process for robotic automation , 2004 .

[3]  Nobuyuki Kita,et al.  Clothes state recognition using 3D observed data , 2009, 2009 IEEE International Conference on Robotics and Automation.

[4]  Hiroaki Seki,et al.  Unfolding of Massive Laundry and Classification Types by Dual Manipulator , 2007, J. Adv. Comput. Intell. Intell. Informatics.

[5]  Wolfgang Straßer.  Schnelle Kurven- und Flächendarstellung auf grafischen Sichtgeräten , 1974 .

[6]  Raul Fernandez-Fernandez,et al.  Improving and evaluating robotic garment unfolding: A garment-agnostic approach , 2017, 2017 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC).

[7]  Trevor Darrell,et al.  Parametrized shape models for clothing , 2011, 2011 IEEE International Conference on Robotics and Automation.

[8]  Shih-Fu Chang,et al.  Regrasping and unfolding of garments using predictive thin shell modeling , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Helge J. Ritter,et al.  Interaction skills for a coat-check robot: Identifying and handling the boundary components of clothes , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[10]  Ian D. Walker,et al.  A new approach to clothing classification using mid-level layers , 2013, 2013 IEEE International Conference on Robotics and Automation.

[11]  Nobuyuki Kita,et al.  A deformable model driven visual method for handling clothes , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[12]  Radu Bogdan Rusu,et al.  Semantic 3D Object Maps for Everyday Manipulation in Human Living Environments , 2010, KI - Künstliche Intelligenz.

[13]  Nikos A. Aspragathos,et al.  A geometric approach to robotic unfolding of garments , 2016, Robotics Auton. Syst..

[14]  Darwin G. Caldwell,et al.  Imitation Learning of Positional and Force Skills Demonstrated via Kinesthetic Teaching and Haptic Input , 2011, Adv. Robotics.

[15]  Francesc Moreno-Noguer,et al.  FINDDD: A fast 3D descriptor to characterize textiles for robot manipulation , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Nico Blodow,et al.  Combined 2D–3D categorization and classification for multimodal perception systems , 2011, Int. J. Robotics Res..

[17]  Jian S. Dai,et al.  Folding algorithms and mechanisms synthesis for robotic ironing , 2004 .

[18]  Carlos Balaguer,et al.  TEO: FULL-SIZE HUMANOID ROBOT DESIGN POWERED BY A FUEL CELL SYSTEM , 2012, Cybern. Syst..

[19]  Tae-Kyun Kim,et al.  Active Random Forests: An Application to Autonomous Unfolding of Clothes , 2014, ECCV.

[20]  Václav Hlavác,et al.  Polygonal Models for Clothing , 2014, TAROS.

[21]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[22]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[23]  Li Sun,et al.  Accurate garment surface analysis using an active stereo robot head with application to dual-arm flattening , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[24]  Patrick Shen-Pei Wang,et al.  A comment on “a fast parallel algorithm for thinning digital patterns” , 1986, CACM.

[25]  Xin-She Yang,et al.  Introduction to Algorithms , 2021, Nature-Inspired Optimization Algorithms.

[26]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[27]  Ching Y. Suen,et al.  A fast parallel algorithm for thinning digital patterns , 1984, CACM.

[28]  Raul Fernandez-Fernandez,et al.  Robotic ironing with a humanoid robot using human tools , 2017, 2017 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC).

[29]  James F. O'Brien,et al.  Bringing clothing into desired configurations with limited perception , 2011, 2011 IEEE International Conference on Robotics and Automation.

[30]  Danfei Xu,et al.  Multi-sensor surface analysis for robotic ironing , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[31]  P. Jiménez,et al.  Visual grasp point localization, classification and state recognition in robotic manipulation of cloth: An overview , 2017, Robotics Auton. Syst..

[32]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[33]  Myron A. Diftler,et al.  The Robonaut 2 hand - designed to do work with tools , 2012, 2012 IEEE International Conference on Robotics and Automation.

[34]  D. Marquardt.  An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[35]  Oussama Khatib,et al.  Mobile manipulation: The robotic assistant , 1999, Robotics Auton. Syst..

[36]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[37]  David H. Douglas,et al.  ALGORITHMS FOR THE REDUCTION OF THE NUMBER OF POINTS REQUIRED TO REPRESENT A DIGITIZED LINE OR ITS CARICATURE , 1973 .

[38]  Shih-Fu Chang,et al.  Real-time pose estimation of deformable objects using a volumetric approach , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.