An Augmented Interface to Display Industrial Robot Faults

Technology advancement is changing the way industrial factories have to face an increasingly complex and competitive market. The fourth industrial revolution (known as industry 4.0) is also changing how human workers have to carry out tasks and actions. In fact, it is no longer impossible to think of a scenario in which human operators and industrial robots work side-by-side, sharing the same environment and tools. To realize a safe work environment, workers should trust robots as well as they trust human operators. Such goal is indeed complex to achieve, especially when workers are under stress conditions, such as when a fault occurs and the human operators are no longer able to understand what is happening in the industrial manipulator. Indeed, Augmented Reality (AR) can help workers to visualize in real-time robots’ faults. This paper proposes an augmented system that assists human workers to recognize and visualize errors, improving their awareness of the system. The system has been tested using both an AR see-through device and a smartphone.

[1]  Saeed Yahyanejad,et al.  Robot Localisation and 3D Position Estimation Using a Free-Moving Camera and Cascaded Convolutional Neural Networks , 2018, 2018 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM).

[2]  Carlos Mateo,et al.  Hammer: An Android based application for end-user industrial robot programming , 2014, 2014 IEEE/ASME 10th International Conference on Mechatronic and Embedded Systems and Applications (MESA).

[3]  Carlos Martínez,et al.  Human-robot collaboration in manufacturing: Quantitative evaluation of predictable, convergent joint action , 2013, IEEE ISR 2013.

[4]  Takafumi Matsumaru.  Mobile Robot with Preliminary-announcement and Display Function of Forthcoming Motion using Projection Equipment , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[5]  Martin Buss,et al.  Human-Robot Collaboration: a Survey , 2008, Int. J. Humanoid Robotics.

[6]  Sotiris Makris,et al.  Augmented Reality (AR) Applications for Supporting Human-robot Interactive Cooperation , 2016 .

[7]  Ivan E. Sutherland,et al.  A head-mounted three dimensional display , 1968, AFIPS Fall Joint Computing Conference.

[8]  Francesco De Pace,et al.  Augmented Reality in Industry 4.0 , 2018 .

[9]  Yahia Kourd,et al.  Supervision of industrial manipulators using ANFIS system , 2017, 2017 17th International Conference on Control, Automation and Systems (ICCAS).

[10]  Marios M. Polycarpou,et al.  Neural-network-based robust fault diagnosis in robotic systems , 1997, IEEE Trans. Neural Networks.

[11]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[12]  Jie Chen,et al.  Robust Model-Based Fault Diagnosis for Dynamic Systems , 1998, The International Series on Asian Studies in Computer and Information Science.

[13]  Yu Sun,et al.  Spatial augmented reality as a method for a mobile robot to communicate intended movement , 2014, Comput. Hum. Behav..

[14]  Carlos Morato,et al.  Toward Safe Human Robot Collaboration by Using Multiple Kinects Based Real-Time Human Tracking , 2014, J. Comput. Inf. Sci. Eng..

[15]  Sahin Yildirim,et al.  Fault detection on robot manipulators using artificial neural networks , 2011 .

[16]  Federico Manuri,et al.  A Survey on Applications of Augmented Reality , 2016 .

[17]  Ravi Teja Chadalavada,et al.  That's on my mind! robot to human intention communication through on-board projection on shared floor space , 2015, 2015 European Conference on Mobile Robots (ECMR).

[18]  Emanuele Menegatti,et al.  Learning how to approach industrial robot tasks from natural demonstrations , 2013, 2013 IEEE Workshop on Advanced Robotics and its Social Impacts.

[19]  Batu Akan,et al.  Augmented Reality Meets Industry: Interactive Robot Programming , 2010 .

[20]  Thomas Hulin,et al.  Interactive Features for Robot Viewers , 2012, ICIRA.

[21]  Antonio Visioli,et al.  On the fault detection and isolation of industrial robot manipulators , 2003 .