Human-Aware Robotic Assistant for Collaborative Assembly: Integrating Human Motion Prediction With Planning in Time

Introducing mobile robots into the collaborative assembly process poses unique challenges for ensuring efficient and safe human–robot interaction. Current human–robot work cells require the robot to cease operating completely whenever a human enters a shared region of the given cell, and the robots do not explicitly model or adapt to the behavior of the human. In this work, we present a human-aware robotic system with single-axis mobility that incorporates both predictions of human motion and planning in time to execute efficient and safe motions during automotive final assembly. We evaluate our system in simulation against three alternative methods, including a baseline approach emulating the behavior of standard safety systems in factories today. We also assess the system within a factory test environment. Through both live demonstration and results from simulated experiments, we show that our approach produces statistically significant improvements in quantitative measures of safety and fluency of interaction.

[1]  Matthias Scholer,et al.  Robot workmate, a trustworthy coworker for the continuous automotive assembly line and its implementation , 2016, ICRA 2016.

[2]  Rachid Alami,et al.  A Human-Robot Cooperative Navigation Planner , 2017, HRI.

[3]  Stefano Soatto,et al.  Intent-aware long-term prediction of pedestrian motion , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[4]  James C. Boerkoel,et al.  Towards control and sensing for an autonomous mobile robotic assistant navigating assembly lines , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Wolfram Burgard,et al.  Time dependent planning on a layered social cost map for human-aware robot navigation , 2015, 2015 European Conference on Mobile Robots (ECMR).

[6]  A. Savitzky,et al.  Smoothing and Differentiation of Data by Simplified Least Squares Procedures. , 1964 .

[7]  Reid G. Simmons,et al.  An autonomous mobile manipulator for assembly tasks , 2010, Auton. Robots.

[8]  Dmitry Berenson,et al.  Unsupervised early prediction of human reaching for human–robot collaboration in shared workspaces , 2018, Auton. Robots.

[9]  Andreas Krause,et al.  Robot navigation in dense human crowds: Statistical models and experimental studies of human–robot cooperation , 2015, Int. J. Robotics Res..

[10]  Siddhartha S. Srinivasa,et al.  Planning-based prediction for pedestrians , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Wolfram Burgard,et al.  Socially compliant mobile robot navigation via inverse reinforcement learning , 2016, Int. J. Robotics Res..

[12]  Hema Swetha Koppula,et al.  Anticipating Human Activities Using Object Affordances for Reactive Robotic Response , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Francesco Rovida,et al.  Design and development of a software architecture for autonomous mobile manipulators in industrial environments , 2015, 2015 IEEE International Conference on Industrial Technology (ICIT).

[14]  Julie A. Shah,et al.  Human-robot co-navigation using anticipatory indicators of human walking motion , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[15]  Elizabeth A. Croft,et al.  Cooperative gestures for industry: Exploring the efficacy of robot hand configurations in expression of instructional gestures for human–robot interaction , 2017, Int. J. Robotics Res..

[16]  Maya Cakmak,et al.  Timing in Human Robot Interaction , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[17]  Chonhyon Park,et al.  I-Planner: Intention-aware motion planning using learning-based human motion prediction , 2016, Robotics: Science and Systems.

[18]  Rachid Alami,et al.  Synthesizing Robot Motions Adapted to Human Presence , 2010 .

[19]  Marc Hanheide,et al.  A Computational Model of Human-Robot Spatial Interactions Based on a Qualitative Trajectory Calculus , 2015, Robotics.

[20]  Illah R. Nourbakhsh,et al.  Planning for Human-Robot Interaction Using Time-State Aggregated POMDPs , 2008, AAAI.

[21]  Tim Roughgarden,et al.  Algorithmic Game Theory , 2007 .

[22]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[23]  Tamio Arai,et al.  Assessment of operator stress induced by robot collaboration in assembly , 2010 .

[24]  Rachid Alami,et al.  Human-aware robot navigation: A survey , 2013, Robotics Auton. Syst..

[25]  Maja J. Mataric,et al.  Autonomous human–robot proxemics: socially aware navigation based on interaction potential , 2016, Autonomous Robots.

[26]  Maxim Likhachev,et al.  SIPP: Safe interval path planning for dynamic environments , 2011, 2011 IEEE International Conference on Robotics and Automation.

[27]  Przemyslaw A. Lasota,et al.  A multiple-predictor approach to human motion prediction , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[28]  Przemyslaw A. Lasota,et al.  Analyzing the Effects of Human-Aware Motion Planning on Close-Proximity Human–Robot Collaboration , 2015, Hum. Factors.

[29]  Rolf Dieter Schraft,et al.  PowerMate – A Safe and Intuitive Robot Assistant for Handling and Assembly Tasks , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[30]  Rachid Alami,et al.  A Human Aware Mobile Robot Motion Planner , 2007, IEEE Transactions on Robotics.

[31]  Siddhartha S. Srinivasa,et al.  Legibility and predictability of robot motion , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[32]  Julie A. Shah,et al.  Fast target prediction of human reaching motion for cooperative human-robot manipulation tasks using time series classification , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[33]  Wolfram Burgard,et al.  Feature-Based Prediction of Trajectories for Socially Compliant Navigation , 2012, Robotics: Science and Systems.

[34]  Dmitry Berenson,et al.  Predicting human reaching motion in collaborative tasks using Inverse Optimal Control and iterative re-planning , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[35]  Brian Peacock,et al.  Cobots for the automobile assembly line , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[36]  Jonathan P. How,et al.  Predictive Modeling of Pedestrian Motion Patterns with Bayesian Nonparametrics , 2016 .

[37]  Cynthia Rudin,et al.  Sequential event prediction , 2013, Machine Learning.

[38]  William D. Smart,et al.  Towards more efficient navigation for robots and humans , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.