A study on human-robot collaboration for table-setting task

As the robot technology is advancing, it is possible to use robots for basic day-to-day chores, so that the burden can be taken off from humans. To make the robots perform such tasks, it is necessary for them to handle different types of objects. Manipulation of deformable objects such as cloth is a challenging task for a robot because of high dimensionality and large number of possible configurations of cloth. Previous studies have covered large number of simple manipulations of cloth articles. In this paper, we are focusing on table setting task that requires putting on a sheet of cloth on the table. This paper proposes human-robot collaboration for table-setting task based on visual assessment. We used Baxter robot to hold two corners of rectangular tablecloth and other two corners are held by human. A head-mounted Kinect sensor is used to get the state of cloth and Robot arms are used for controlling the position of cloth corners. We use features from Kinect sensor to assess whether the placement of the cloth is successful or not. We demonstrate an initial study of the system that can achieve promising results towards table setting task through human-robot interaction.

[1]  Pieter Abbeel,et al.  Gravity-Based Robotic Cloth Folding , 2010, WAFR.

[2]  Nikos A. Aspragathos,et al.  Human Robot Collaboration for Folding Fabrics Based on Force/RGB-D Feedback , 2015, RAAD.

[3]  Kimitoshi Yamazaki,et al.  A method of classifying crumpled clothing based on image features derived from clothing fabrics and wrinkles , 2016, Autonomous Robots.

[4]  John T. Wen,et al.  Human-robot collaborative handling of highly deformable materials , 2017, 2017 American Control Conference (ACC).

[5]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[6]  Nishanth Koganti,et al.  Bayesian Nonparametric Learning of Cloth Models for Real-Time State Estimation , 2017, IEEE Transactions on Robotics.

[7]  Danfei Xu,et al.  Folding deformable objects using predictive simulation and trajectory optimization , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[8]  Trevor Darrell,et al.  A geometric approach to robotic laundry folding , 2012, Int. J. Robotics Res..

[9]  John T. Wen,et al.  Collaborative human-robot manipulation of highly deformable materials , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).