A software tool for human-robot shared-workspace collaboration with task precedence constraints

Abstract A key challenge in human-robot shared workspace is defining the decision criterion to select the next task for a fluent, efficient and safe collaboration. While working with robots in an industrial environment, tasks may comply with precedence constraints to be executed. A typical example of precedence constraint in industry occurs at an assembly station when the human cannot perform a task before the robot ends on its own. This paper presents a methodology based on the Maximum Entropy Inverse Optimal Control for the identification of a probability distribution over the human goals, packed into a software tool for human-robot shared-workspace collaboration. The software analyzes the human goal and the goal precedence constraints, and it is able to identify the best robot goal along with the relative motion plan. The approach used is, an algorithm for the management of goal precedence constraints and the Partially Observable Markov Decision Process (POMDP) for the selection of the next robot action. A comparison study with 15 participants was carried out in a real world assembly station. The experiment focused on evaluating the task fluency, the task efficiency and the human satisfaction. The presented model displayed reduction in robot idle time and increased human satisfaction.

[1]  Leslie Pack Kaelbling,et al.  Learning Policies for Partially Observable Environments: Scaling Up , 1997, ICML.

[2]  Franca Giannini,et al.  Configuration and inspection of multi-fixturing pallets in flexible manufacturing systems: Evolution of the Network Part Program approach , 2017 .

[3]  Renato Vidoni,et al.  Emerging research fields in safety and ergonomics in industrial collaborative robotics: A systematic literature review , 2021, Robotics Comput. Integr. Manuf..

[4]  Dmitry Berenson,et al.  Human-robot collaborative manipulation planning using early prediction of human motion , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Guanglong Du,et al.  Markerless human-robot interface for dual robot manipulators using Kinect sensor , 2014 .

[6]  Duc Truong Pham,et al.  Disassembly sequence planning using discrete Bees algorithm for human-robot collaboration in remanufacturing , 2020, Robotics Comput. Integr. Manuf..

[7]  Hassan Ezzaidi,et al.  Human-robot collaboration while sharing production activities in dynamic environment: SPADER system , 2017 .

[8]  Leslie Pack Kaelbling,et al.  POMCoP: Belief Space Planning for Sidekicks in Cooperative Games , 2012, AIIDE.

[9]  Tullio Tolio,et al.  Planning and Execution with Robot Trajectory Generation in Industrial Human-Robot Collaboration , 2017, AIRO@AI*IA.

[10]  Sebti Foufou,et al.  Intention recognition in manufacturing applications , 2015 .

[11]  Rachid Alami,et al.  Task planning for human-robot interaction , 2005, sOc-EUSAI '05.

[12]  Siddhartha S. Srinivasa,et al.  Effects of Robot Motion on Human-Robot Collaboration , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[13]  Xiaobin Zhang,et al.  Performance guaranteed human-robot collaboration with POMDP supervisory control , 2019 .

[14]  Marta Cialdea Mayer,et al.  Planning and execution with flexible timelines: a formal account , 2016, Acta Informatica.

[15]  Robert Givan,et al.  A framework for simulation-based network control via hindsight optimization , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[16]  Siddhartha S. Srinivasa,et al.  Human-robot shared workspace collaboration via hindsight optimization , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[17]  Siddhartha S. Srinivasa,et al.  Planning-based prediction for pedestrians , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Shogo Okamoto,et al.  Estimating probability of human hand intrusion for speed and separation monitoring using interference theory , 2020, Robotics Comput. Integr. Manuf..

[19]  Dana Kulic,et al.  Incremental learning of human behaviors using hierarchical hidden Markov models , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Emilio Frazzoli,et al.  Intention-Aware Motion Planning , 2013, WAFR.

[21]  Rachid Alami,et al.  Toward Human-Aware Robot Task Planning , 2006, AAAI Spring Symposium: To Boldly Go Where No Human-Robot Team Has Gone Before.

[22]  Leslie Pack Kaelbling,et al.  CAPIR: Collaborative Action Planning with Intention Recognition , 2011, AIIDE.

[23]  Siddhartha S. Srinivasa,et al.  Shared Autonomy via Hindsight Optimization , 2015, Robotics: Science and Systems.

[24]  Subbarao Kambhampati,et al.  Probabilistic Planning via Determinization in Hindsight , 2008, AAAI.

[25]  Laurent Jeanpierre,et al.  Partially Observable Markov Decision Process for Managing Robot Collaboration with Human , 2009, 2009 21st IEEE International Conference on Tools with Artificial Intelligence.

[26]  Przemyslaw A. Lasota,et al.  Analyzing the Effects of Human-Aware Motion Planning on Close-Proximity Human–Robot Collaboration , 2015, Hum. Factors.

[27]  Lihui Wang,et al.  Contact-less and Programming-less Human-Robot Collaboration , 2013 .

[28]  Yongji Wang,et al.  Autonomous Robot Path Planning Based on Swarm Intelligence and Stream Functions , 2007, ICES.

[29]  Tullio Tolio,et al.  A probabilistic approach to workspace sharing for human–robot cooperation in assembly tasks , 2016 .

[30]  Frederic Py,et al.  A systematic agent framework for situated autonomous systems , 2010, AAMAS.

[31]  Caihong Li,et al.  A new hybrid algorithm of dynamic obstacle avoidance based on dynamic rolling planning and RBFNN , 2007, 2007 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[32]  Shozo Takata,et al.  Human and robot allocation method for hybrid assembly systems , 2011 .

[33]  Hao Ding,et al.  Dynamic speed and separation monitoring for collaborative robot applications - Concepts and performance , 2019, Robotics Comput. Integr. Manuf..

[34]  Sotiris Makris,et al.  AI based combined scheduling and motion planning in flexible robotic assembly lines , 2019, Procedia CIRP.

[35]  Sotiris Makris,et al.  Human–robot interaction review and challenges on task planning and programming , 2016, Int. J. Comput. Integr. Manuf..

[36]  Sami Haddadin,et al.  A Hierarchical Human-Robot Interaction-Planning Framework for Task Allocation in Collaborative Industrial Assembly Processes , 2017, IEEE Robotics and Automation Letters.

[37]  Tullio Tolio,et al.  Pallet operation sequencing based on network part program logic , 2013 .

[38]  Siddhartha S. Srinivasa,et al.  A policy-blending formalism for shared control , 2013, Int. J. Robotics Res..