Robotic ironing with a humanoid robot using human tools

There is an increasing demand of robots able to assist people in everyday home tasks. Some of these tasks, specially garment-related tasks (e.g. laundry, ironing, etc), are currently a big challenge for robots due to deformations and the high number of possible configurations the garment can adopt. Ironing, additionally, requires manipulation and control of the iron, as if performed incorrectly it can create even more wrinkles. In this work we present a method for robotic ironing with an unmodified iron and ironing board and a full-body humanoid robot, inspired in the way people perform the ironing task. In this method, the robot performs an ironing action controlled in velocity with feedback from a force/torque sensor. This action is later analyzed by the robot using computer vision to determine if any wrinkle exists, either pre-existent or created by the ironing action. The 3D vision algorithm segments the garment surface to be ironed and computes a Wrinkleness Local Descriptor (WiLD) that determines the location of the wrinkles on the garment. Wrinkles are processed using computer vision techniques on an flattened image created from the WiLD descriptors computed in the prior stage, resulting, if present, in an optimal ironing path that reduces wrinkleness and avoids creating new wrinkles in garments when ironing. The experimental results show that using our method the humanoid robot is able to successfully iron several garments with results similar to the expected from a human performing the same task.

[1]  Josiane Zerubia,et al.  Marked point process model for facial wrinkle detection , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[2]  Baihua Li,et al.  Automatic Wrinkle Detection Using Hybrid Hessian Filter , 2014, ACCV.

[3]  Jian S. Dai,et al.  Folding algorithms and mechanisms synthesis for robotic ironing , 2004 .

[4]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[5]  Pieter Abbeel,et al.  Cloth grasp point detection based on multiple-view geometric cues with application to robotic towel folding , 2010, 2010 IEEE International Conference on Robotics and Automation.

[6]  Raul Fernandez-Fernandez,et al.  Improving and evaluating robotic garment unfolding: A garment-agnostic approach , 2017, 2017 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC).

[7]  Francesc Moreno-Noguer,et al.  Using depth and appearance features for informed robot grasping of highly wrinkled clothes , 2012, 2012 IEEE International Conference on Robotics and Automation.

[8]  Carlos Balaguer,et al.  TEO: FULL-SIZE HUMANOID ROBOT DESIGN POWERED BY A FUEL CELL SYSTEM , 2012, Cybern. Syst..

[9]  Tae-Kyun Kim,et al.  Active Random Forests: An Application to Autonomous Unfolding of Clothes , 2014, ECCV.

[10]  Danfei Xu,et al.  Multi-sensor surface analysis for robotic ironing , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Ching Y. Suen,et al.  A fast parallel algorithm for thinning digital patterns , 1984, CACM.

[12]  Shih-Fu Chang,et al.  Regrasping and unfolding of garments using predictive thin shell modeling , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[13]  Helge J. Ritter,et al.  Interaction skills for a coat-check robot: Identifying and handling the boundary components of clothes , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[14]  Carlos Balaguer,et al.  Towards Robotic Garment Folding: A Vision Approach for Fold Detection , 2016, 2016 International Conference on Autonomous Robot Systems and Competitions (ICARSC).

[15]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[16]  Hiroaki Seki,et al.  Unfolding of Massive Laundry and Classification Types by Dual Manipulator , 2007, J. Adv. Comput. Intell. Intell. Informatics.

[17]  Alejandro F. Frangi,et al.  Muliscale Vessel Enhancement Filtering , 1998, MICCAI.

[18]  Darwin G. Caldwell,et al.  Imitation Learning of Positional and Force Skills Demonstrated via Kinesthetic Teaching and Haptic Input , 2011, Adv. Robotics.

[19]  Jian S. Dai,et al.  Trajectory and orientation analysis of the ironing process for robotic automation , 2004 .

[20]  Li Sun,et al.  Accurate garment surface analysis using an active stereo robot head with application to dual-arm flattening , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).