Robot action planning by online optimization in human–robot collaborative tasks

Collaborative robots are widely used in strict and complex hybrid assembly tasks in the context of intelligent manufacturing. However, the task efficiency and task cost evaluation, which are very significant in the robot action planning to ensure and enhance the task quality in the human–robot collaboration process, are rarely studied in previous works. In this paper, we propose a novel and practical approach based on online optimization for the robot to plan its actions in human–robot collaboration to address this challenge. First, we extract the task model by graphical representations and design the collaboration cost functions which incorporate time consumption and human efforts. After that, the robot action planning algorithms are developed to online plan robot actions by optimizing the collaborative assembly cost. In addition, appropriate robot actions can be planned by the proposed algorithms to ensure the accomplishment of assembly process when the human happens to conduct wrong actions during the collaboration. We performed studies through hybrid assembly tasks with different types of human–robot collaboration scenarios to verify the advantages of our robot action planning algorithms. Experimental results suggested that the proposed algorithms can successfully generate the optimal actions for the robot to guarantee the efficiency in human–robot collaborative assembly.

[1]  Didier Devaurs,et al.  Optimal Path Planning in Complex Cost Spaces With Sampling-Based Algorithms , 2016, IEEE Transactions on Automation Science and Engineering.

[2]  Cynthia Breazeal,et al.  Improved human-robot team performance using Chaski, A human-inspired plan execution system , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[3]  Markus Wulfmeier,et al.  Watch this: Scalable cost-function learning for path planning in urban environments , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[4]  T. K. Lien,et al.  Hybrid Automatic-manual Assembly Systems , 2001 .

[5]  Brian Scassellati,et al.  Autonomously constructing hierarchical task networks for planning and human-robot collaboration , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Dan Klein,et al.  Grounding spatial relations for human-robot interaction , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Reinhard Koch,et al.  An Adaptable Robot Vision System Performing Manipulation Actions With Flexible Objects , 2014, IEEE Transactions on Automation Science and Engineering.

[8]  Jan Peters,et al.  Learning complex motions by sequencing simpler motion templates , 2009, ICML '09.

[9]  Maria Javaid,et al.  Using pressure sensors to identify manipulation actions during human physical interaction , 2015, 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[10]  Guido Bugmann,et al.  Mobile robot programming using natural language , 2002, Robotics Auton. Syst..

[11]  M. Hagele,et al.  rob@work: Robot assistant in industrial environments , 2002, Proceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication.

[12]  Daniel E. Koditschek,et al.  Exact robot navigation using cost functions: the case of distinct spherical boundaries in E/sup n/ , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[13]  Nando de Freitas,et al.  Active Policy Learning for Robot Planning and Exploration under Uncertainty , 2007, Robotics: Science and Systems.

[14]  Hema Swetha Koppula,et al.  Learning human activities and object affordances from RGB-D videos , 2012, Int. J. Robotics Res..

[15]  Wolfram Burgard,et al.  Efficient path planning for mobile robots in environments with deformable objects , 2008, 2008 IEEE International Conference on Robotics and Automation.

[16]  Rolf Dieter Schraft,et al.  MAN-MACHINE-INTERACTION AND CO-OPERATION FOR MOBILE AND ASSISTING ROBOTS , 2004 .

[17]  Sami Haddadin,et al.  A Hierarchical Human-Robot Interaction-Planning Framework for Task Allocation in Collaborative Industrial Assembly Processes , 2017, ICRA 2017.

[18]  Brian Scassellati,et al.  Effective robot teammate behaviors for supporting sequential manipulation tasks , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[19]  Luka Peternel,et al.  Humanoid robot posture-control learning in real-time based on human sensorimotor learning ability , 2013, 2013 IEEE International Conference on Robotics and Automation.

[20]  Pedro Neto,et al.  Preface for the special issue on robotics in smart manufacturing , 2016 .

[21]  Wolfram Burgard,et al.  Learning Cost Functions for Mobile Robot Navigation in Environments with Deformable Objects , 2008 .

[22]  Jörg Krüger,et al.  Intelligent Assist Systems for Flexible Assembly , 2006 .

[23]  Cynthia Breazeal,et al.  An Empirical Analysis of Team Coordination Behaviors and Action Planning With Application to Human–Robot Teaming , 2010, Hum. Factors.

[24]  Oscar Castillo,et al.  Path planning for autonomous mobile robot navigation with ant colony optimization and fuzzy cost function evaluation , 2009, Appl. Soft Comput..

[25]  Qi Cheng,et al.  Robot semantic mapping through wearable sensor-based human activity recognition , 2012, 2012 IEEE International Conference on Robotics and Automation.

[26]  Alexander Verl,et al.  Cooperation of human and machines in assembly lines , 2009 .

[27]  Ana Paiva,et al.  Learning cost function and trajectory for robotic writing motion , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[28]  Helmut Bley,et al.  Appropriate Human Involvement in Assembly and Disassembly , 2004 .

[29]  Minoru Asada,et al.  Initiative in robot assistance during collaborative task execution , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[30]  Alexander Verl,et al.  Methodology to Identify Applications for Collaborative Robots in Powertrain Assembly , 2016 .

[31]  Yunyi Jia,et al.  Program robots manufacturing tasks by natural language instructions , 2016, 2016 IEEE International Conference on Automation Science and Engineering (CASE).

[32]  A. Paulo Moreira,et al.  Stereo-based real-time 6-DoF work tool tracking for robot programing by demonstration , 2016 .

[33]  Cynthia Breazeal,et al.  Cost-Based Anticipatory Action Selection for Human–Robot Fluency , 2007, IEEE Transactions on Robotics.