Safety barrier functions and multi-camera tracking for human-robot shared environment

Abstract A new vision in human–robot collaboration has allowed to place robots nearby human operators, working close to each other in industrial environments. As a consequence, human safety has become a dominant issue, together with production efficiency. In this paper we propose an optimization-based control algorithm that allows robots to avoid obstacles (like human operators) while minimizing the difference between the nominal acceleration input and the commanded one. Control Barrier Functions are exploited to build safety barriers around each robot link, to guarantee collision-free trajectories along the whole robot body. Human accelerations and velocities are computed by means of a bank of Kalman filters. To solve obstruction problems, two RGB-D cameras are used and the measured skeleton data are processed and merged using the mentioned bank of Kalman filters. The algorithm is implemented on an Universal Robots UR5 in order to validate the proposed approach.

[1]  George Michalos,et al.  Power and force limiting on industrial robots for human-robot collaboration , 2019, Robotics Comput. Integr. Manuf..

[2]  Saverio Farsoni,et al.  Real-Time Identification of Robot Payload Using a Multirate Quaternion-Based Kalman Filter and Recursive Total Least-Squares , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[3]  Paolo Rocco,et al.  Walk-through programming for robotic manipulators based on admittance control , 2013, Robotica.

[4]  Charlie C. L. Wang,et al.  Improved Skeleton Tracking by Duplex Kinects: A Practical Approach for Real-Time Applications , 2013, J. Comput. Inf. Sci. Eng..

[5]  Norbert Schmitz,et al.  Survey of Motion Tracking Methods Based on Inertial Sensors: A Focus on Upper Limb Human Motion , 2017, Sensors.

[6]  Dana Kulic,et al.  Real-time safety for human - robot interaction , 2005, ICAR '05. Proceedings., 12th International Conference on Advanced Robotics, 2005..

[7]  Nuno Mendes,et al.  Minimum Distance Calculation for Safe Human Robot Interaction , 2017 .

[8]  Alessandro De Luca,et al.  Collision detection and reaction: A contribution to safe physical Human-Robot Interaction , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Xin Liu,et al.  Markerless Human–Manipulator Interface Using Leap Motion With Interval Kalman Filter and Improved Particle Filter , 2016, IEEE Transactions on Industrial Informatics.

[10]  Saverio Farsoni,et al.  Compensation of Load Dynamics for Admittance Controlled Interactive Industrial Robots Using a Quaternion-Based Kalman Filter , 2017, IEEE Robotics and Automation Letters.

[11]  Andrea Maria Zanchettin,et al.  Safety Assessment and Control of Robotic Manipulators Using Danger Field , 2013, IEEE Transactions on Robotics.

[12]  Cristian Secchi,et al.  TIREBOT: A collaborative robot for the tire workshop , 2019 .

[13]  Aaron D. Ames,et al.  Safety Barrier Certificates for Collisions-Free Multirobot Systems , 2017, IEEE Transactions on Robotics.

[14]  Huosheng Hu,et al.  Human motion tracking for rehabilitation - A survey , 2008, Biomed. Signal Process. Control..

[15]  Andrea Maria Zanchettin,et al.  Safety in human-robot collaborative manufacturing environments: Metrics and control , 2016, IEEE Transactions on Automation Science and Engineering.

[16]  Koji Ikuta,et al.  Safety Evaluation Method of Design and Control for Human-Care Robots , 2003, Int. J. Robotics Res..

[17]  Masayoshi Tomizuka,et al.  Real-time collision avoidance algorithm on industrial manipulators , 2017, 2017 IEEE Conference on Control Technology and Applications (CCTA).

[18]  Antonio Bicchi,et al.  Safety for Physical Human-Robot Interaction , 2008, Springer Handbook of Robotics.

[19]  Daniel Cremers,et al.  Real-time human motion tracking using multiple depth cameras , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Ping Zhang,et al.  Human–Manipulator Interface Based on Multisensory Process via Kalman Filters , 2014, IEEE Transactions on Industrial Electronics.

[21]  Sandra Hirche,et al.  Constrained robot control using control barrier functions , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[22]  Antonio Bicchi,et al.  Dealing with the Safety-Performance Tradeoff in Robot Arms Design and Control , 2004 .

[23]  Igor Boiko,et al.  Sliding mode differentiator/observer for quadcopter velocity estimation through sensor fusion , 2018, Int. J. Control.