Adaptive motion generation using imitation learning and highly compliant end effector for autonomous cleaning

Recent demographic trends in super aging societies, such as Japan, is leading to severe worker shortage. Service robots can play a promising role to augment human workers for performing various household and assistive tasks. Toilet cleanup is one such challenging task that involves performing complaint motion planning in a constrained toilet setting. In this study, we propose an end-to-end robotic framework to perform various tasks related to toilet cleanup. Our key contributions include the design of a complaint and multipurpose end-effector, an adaptive motion generation algorithm, and an autonomous mobile manipulator capable of garbage detection, garbage disposal and liquid removal. We evaluate the performance of our framework with the competition setting used for toilet cleanup in the Future Convenience Store Challenge at the World Robot Summit 2018. We demonstrate that our proposed framework is capable of successfully completing all the tasks of the competition within the time limit. GRAPHICAL ABSTRACT

[1]  Youdong Chen,et al.  The Playback Trajectory Optimization Algorithm for Collaborative Robot , 2018, 2018 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[2]  Shigeki Sugano,et al.  Repeatable Folding Task by Humanoid Robot Worker Using Deep Learning , 2017, IEEE Robotics and Automation Letters.

[3]  C. L. Philip Chen,et al.  A survey of human-centered intelligent robots: issues and challenges , 2017, IEEE/CAA Journal of Automatica Sinica.

[4]  Gerard Meszaros,et al.  Agile Regression Testing Using Record and Playback , 2003, XP/Agile Universe.

[5]  Stefan Schaal,et al.  Movement reproduction and obstacle avoidance with dynamic movement primitives and potential fields , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[6]  Luís Seabra Lopes,et al.  GOOD: A global orthographic object descriptor for 3D object recognition and manipulation , 2016, Pattern Recognit. Lett..

[7]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Abhilash Pandya,et al.  A Robotic Recording and Playback Platform for Training Surgeons and Learning Autonomous Behaviors Using the da Vinci Surgical System , 2019, Robotics.

[9]  Maya Cakmak,et al.  Adaptive Coordination Strategies for Human-Robot Handovers , 2015, Robotics: Science and Systems.

[10]  H. Nishiura,et al.  Demographic supply-demand imbalance in industrial structure in the super-aged nation Japan , 2018, Theoretical Biology and Medical Modelling.

[11]  Qingsong Xu,et al.  Development of writing task recombination technology based on DMP segmentation via verbal command for Baxter robot , 2018 .

[12]  Chenguang Yang,et al.  Advanced tele-operated robot interface for teaching by demonstration , 2017, 2017 International Conference on Machine Learning and Cybernetics (ICMLC).

[13]  Ali Borji,et al.  Salient object detection: A survey , 2014, Computational Visual Media.

[14]  A. Paulo Moreira,et al.  Stereo-based real-time 6-DoF work tool tracking for robot programing by demonstration , 2016 .

[15]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Gerard Meszaros,et al.  Agile regression testing using record & playback , 2003, OOPSLA '03.

[17]  Horst-Michael Groß,et al.  Complex-YOLO: An Euler-Region-Proposal for Real-Time 3D Object Detection on Point Clouds , 2018, ECCV Workshops.

[18]  Javier Ruiz-del-Solar,et al.  Object recognition using local invariant features for robotic applications: A survey , 2016, Pattern Recognit..

[19]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[20]  Klaus Hauer,et al.  Design of a bath robot system — User definition and user requirements based on International Classification of Functioning, Disability and Health (ICF) , 2016, 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[21]  P. Gowtham,et al.  Autonomous Lavatory Cleaning System , 2015, ICRA 2015.

[22]  Wolfram Burgard,et al.  Robot, organize my shelves! Tidying up objects by predicting user preferences , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[23]  Sohyung Cho,et al.  Teach and Playback Training Device for Minimally Invasive Surgery , 2018, Minimally invasive surgery.

[24]  Jun Morimoto,et al.  Task-Specific Generalization of Discrete and Periodic Dynamic Movement Primitives , 2010, IEEE Transactions on Robotics.

[25]  Peter Mayer,et al.  On the Prototyping of an ICT-Enhanced Toilet System for Assisting Older Persons Living Independently and Safely at Home , 2017, eHealth.

[26]  Sergey Levine,et al.  Deep visual foresight for planning robot motion , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[27]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Kazuyoshi Wada.  New robot technology challenge for convenience store , 2017, 2017 IEEE/SICE International Symposium on System Integration (SII).

[29]  Javier Ruiz-del-Solar,et al.  Near Real-Time Object Recognition for Pepper based on Deep Neural Networks Running on a Backpack , 2018, RoboCup.

[30]  Sven Behnke,et al.  RGB-D object detection and semantic segmentation for autonomous manipulation in clutter , 2018, Int. J. Robotics Res..

[31]  Amarnath Banerjee,et al.  Intelligent scheduling and motion control for household vacuum cleaning robot system using simulation based optimization , 2015, 2015 Winter Simulation Conference (WSC).

[32]  Thejus Pathmakumar,et al.  Floor cleaning robot with reconfigurable mechanism , 2018, Automation in Construction.

[33]  Nishanth Koganti,et al.  Restock and straightening system for retail automation using compliant and mobile manipulation , 2020, Adv. Robotics.

[34]  Jianyu Yang,et al.  An obstacle avoidance method based on non-radial arrangement of distance sensors for vacuum cleaning robot , 2016, 2016 IEEE International Conference on Robotics and Biomimetics (ROBIO).