A Simple Neural Network for Collision Detection of Collaborative Robots

Due to the epidemic threat, more and more companies decide to automate their production lines. Given the lack of adequate security or space, in most cases, such companies cannot use classic production robots. The solution to this problem is the use of collaborative robots (cobots). However, the required equipment (force sensors) or alternative methods of detecting a threat to humans are usually quite expensive. The article presents the practical aspect of collision detection with the use of a simple neural architecture. A virtual force and torque sensor, implemented as a neural network, may be useful in a team of collaborative robots. Four different approaches are compared in this article: auto-regressive (AR), recurrent neural network (RNN), convolutional long short-term memory (CNN-LSTM) and mixed convolutional LSTM network (MC-LSTM). These architectures are analyzed at different levels of input regression (motor current, position, speed, control velocity). This sensor was tested on the original CURA6 robot prototype (Cooperative Universal Robotic Assistant 6) by Intema. The test results indicate that the MC-LSTM architecture is the most effective with the regression level set at 12 samples (at 24 Hz). The mean absolute prediction error obtained by the MC-LSTM architecture was approximately 22 Nm. The conducted external test (72 different signals with collisions) shows that the presented architecture can be used as a collision detector. The MC-LSTM collision detection f1 score with the optimal threshold was 0.85. A well-developed virtual sensor based on such a network can be used to detect various types of collisions of cobot or other mobile or stationary systems operating on the basis of human-machine interaction.

[1]  Zdzislaw Kowalczuk,et al.  Intelligent decision-making system for autonomous robots , 2011, Int. J. Appl. Math. Comput. Sci..

[2]  Zdzisław Kowalczuk,et al.  Interpretation and modeling of emotions in the management of autonomous robots using a control paradigm based on a scheduling variable , 2020, Eng. Appl. Artif. Intell..

[3]  Yanhe Zhu,et al.  A new robot collision detection method: A modified nonlinear disturbance observer based-on neural networks , 2020, J. Intell. Fuzzy Syst..

[4]  Chang Nho Cho,et al.  Neural Network Based Adaptive Actuator Fault Detection Algorithm for Robot Manipulators , 2019, J. Intell. Robotic Syst..

[5]  John Y. Hung,et al.  Piezoelectric Polymer-Based Collision Detection Sensor for Robotic Applications , 2015 .

[6]  Jingfu Jin,et al.  Parameter identification for industrial robots with a fast and robust trajectory design approach , 2015 .

[7]  Andrea Maria Zanchettin,et al.  Reactive Task Adaptation Based on Hierarchical Constraints Classification for Safe Industrial Robots , 2015, IEEE/ASME Transactions on Mechatronics.

[8]  Dmitry Popov,et al.  Collision detection, localization & classification for industrial robots with joint torque sensors , 2017, 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[9]  Alex M. Andrew,et al.  Fault Diagnosis: Models, Artificial Intelligence, Applications , 2005 .

[10]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Zhijing Li,et al.  A Virtual Sensor for Collision Detection and Distinction with Conventional Industrial Robots , 2019, Sensors.

[12]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[13]  Marina Indri,et al.  Development of a Virtual Collision Sensor for Industrial Robots , 2017, Sensors.

[14]  Ning Liu,et al.  Collision Detection and Identification on Robot Manipulators Based on Vibration Analysis , 2019, Sensors.

[15]  Nikos A. Aspragathos,et al.  Neural Network Design for Manipulator Collision Detection Based Only on the Joint Position Sensors , 2019, Robotica.

[16]  Wan Kyun Chung,et al.  Collision Detection for Industrial Collaborative Robots: A Deep Learning Approach , 2019, IEEE Robotics and Automation Letters.

[17]  Shiyi Li,et al.  A momentum-based collision detection algorithm for industrial robots , 2015, 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[18]  Xing-Qi Jiang Time Varying Coefficient AR and VAR Models , 1999 .

[19]  Alessandro De Luca,et al.  Admittance Control for Human-Robot Interaction Using an Industrial Robot Equipped with a F/T Sensor , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[20]  Geng Yang,et al.  Development of Flexible Robot Skin for Safe and Natural Human–Robot Collaboration , 2018, Micromachines.

[21]  Zdzislaw Kowalczuk,et al.  Estimation of DC motor parameters using a simple CMOS camera , 2017, 2017 22nd International Conference on Methods and Models in Automation and Robotics (MMAR).

[22]  Mojtaba Ahmadi,et al.  A Limb Compliant Sensing Strategy for Robot Collision Reaction , 2016, IEEE/ASME Transactions on Mechatronics.

[23]  Sami Haddadin,et al.  Observer-Extended Direct Method for Collision Monitoring in Robot Manipulators Using Proprioception and IMU Sensing , 2020, IEEE Robotics and Automation Letters.

[24]  Erik Grafarend,et al.  Linear and Nonlinear Models: Fixed effects, random effects, and total least squares , 2012 .

[25]  Minzhou Luo,et al.  A universal algorithm for sensorless collision detection of robot actuator faults , 2018 .

[26]  Kyung-Jo Park,et al.  Fourier-based optimal excitation trajectories for the dynamic identification of robots , 2006, Robotica.

[27]  Sung-Bae Cho,et al.  Predicting residential energy consumption using CNN-LSTM neural networks , 2019, Energy.

[28]  Jun Wu,et al.  Review: An overview of dynamic parameter identification of robots , 2010 .

[29]  Antonio Visioli,et al.  A virtual force sensor for interaction tasks with conventional industrial robots , 2018 .

[30]  Alessandro De Luca,et al.  Collision Detection and Safe Reaction with the DLR-III Lightweight Manipulator Arm , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  Michał Czubenko,et al.  Safety System for an Industrial Cooperating Robot Based on Depth Cameras , 2019 .

[32]  Zhengqing Han,et al.  Modified Line-of-Sight Guidance Law With Adaptive Neural Network Control of Underactuated Marine Vehicles With State and Input Constraints , 2020, IEEE Transactions on Control Systems Technology.

[33]  Yanbiao Zou,et al.  Robot Collision Detection Without External Sensors Based on Time-Series Analysis , 2021 .

[34]  G. Schitter,et al.  A Visual Servoing Approach for a Six Degrees-of-Freedom Industrial Robot by RGB-D Sensing , 2017 .

[35]  Liang Han,et al.  Collision Detection and Coordinated Compliance Control for a Dual-Arm Robot Without Force/Torque Sensing Based on Momentum Observer , 2019, IEEE/ASME Transactions on Mechatronics.

[36]  Hua Zhang,et al.  Manipulator residual estimation and its application in collision detection , 2018, Ind. Robot.

[37]  Krzysztof Kozłowski,et al.  Modelling and Identification in Robotics , 1998 .

[38]  Francesco Leali,et al.  Survey on human–robot collaboration in industrial settings: Safety, intuitive interfaces and applications , 2018, Mechatronics.

[39]  Haitao Liu,et al.  Force/Torque Sensorless Compliant Control Strategy for Assembly Tasks Using a 6-DOF Collaborative Robot , 2019, IEEE Access.

[40]  Jan Tommy Gravdahl,et al.  Set-based collision avoidance applications to robotic systems , 2020 .

[41]  Paul M. Frank,et al.  Observer-based supervision and fault detection in robots using nonlinear and fuzzy logic residual evaluation , 1996, IEEE Trans. Control. Syst. Technol..

[42]  Alessandro De Luca,et al.  Robot Collisions: A Survey on Detection, Isolation, and Identification , 2017, IEEE Transactions on Robotics.

[43]  Nikos A. Aspragathos,et al.  Human-Robot Collision Detection Based on Neural Networks , 2016 .

[44]  Yu Yao,et al.  Dynamic Model Identification for 6-DOF Industrial Robots , 2015, J. Robotics.