Real-Time Remote Maintenance Support Based on Augmented Reality (AR)

In the realm of the current industrial revolution, interesting innovations as well as new techniques are constantly being introduced by offering fertile ground for further investigation and improvement in the industrial engineering domain. More specifically, cutting-edge digital technologies in the field of Extended Reality (XR) have become mainstream including Augmented Reality (AR). Furthermore, Cloud Computing has enabled the provision of high-quality services, especially in the controversial field of maintenance. However, since modern machines are becoming more complex, maintenance must be carried out from experienced and well-trained personnel, while overseas support is timely and financially costly. Although AR is a back-bone technology facilitating the development of robust maintenance support tools, they are limited to the provision of predefined scenarios, covering only a limited number of scenarios. This research work aims to address this emerging challenge with the design and development of a framework, for the support of remote maintenance and repair operation based on AR, by creating suitable communication channels between the shop-floor technicians and the expert engineers who are utilizing real-time feedback from the operator’s field of view. The applicability of the developed framework is tested in vitro in a lab-based machine shop and in a real-life industrial scenario.

[1]  Dimitris Mourtzis,et al.  Maintenance assistance application of Engineering to Order manufacturing equipment: A Product Service System (PSS) approach , 2018 .

[2]  Steven K. Feiner,et al.  Exploring the Benefits of Augmented Reality Documentation for Maintenance and Repair , 2011, IEEE Transactions on Visualization and Computer Graphics.

[3]  Dimitris Mourtzis,et al.  Simulation in the design and operation of manufacturing systems: state of the art and new trends , 2019, Int. J. Prod. Res..

[4]  Jing Chen,et al.  Maintenance, Repair, and Operations Parts Inventory Management in the Era of Industry 4.0 , 2019, IFAC-PapersOnLine.

[5]  Xun Xu,et al.  From cloud computing to cloud manufacturing , 2012 .

[6]  José-Raúl Ruiz-Sarmiento,et al.  A predictive model for the maintenance of industrial machinery in the context of industry 4.0 , 2020, Eng. Appl. Artif. Intell..

[7]  Cheng Zeng,et al.  An augmented reality based system for remote collaborative maintenance instruction of complex products , 2014, 2014 IEEE International Conference on Automation Science and Engineering (CASE).

[8]  Nikolaos Nikolakis,et al.  On a versatile scheduling concept of maintenance activities for increased availability of production resources , 2018 .

[9]  Gregoris Mentzas,et al.  Decision Making in Predictive Maintenance: Literature Review and Research Agenda for Industry 4.0 , 2019, IFAC-PapersOnLine.

[10]  Dimitris Mourtzis,et al.  Augmented Reality based Visualization of CAM Instructions towards Industry 4.0 paradigm: a CNC Bending Machine case study , 2018 .

[11]  Dimitris Mourtzis,et al.  An Adaptive Framework for Augmented Reality Instructions Considering Workforce Skill , 2019, Procedia CIRP.

[12]  Dimitris Mourtzis,et al.  Cloud-Based Augmented Reality Remote Maintenance Through Shop-Floor Monitoring: A Product-Service System Approach , 2017 .

[13]  John G. Breslin,et al.  Big data and stream processing platforms for Industry 4.0 requirements mapping for a predictive maintenance use case , 2020 .

[14]  Dimitris Mourtzis,et al.  Design and Planning of Manufacturing Networks for Mass Customisation and Personalisation: Challenges and Outlook , 2014 .

[15]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[16]  Soh-Khim Ong,et al.  A practical augmented reality-assisted maintenance system framework for adaptive user support , 2019, Robotics Comput. Integr. Manuf..

[17]  Dimitris Mourtzis,et al.  A Cloud-based Approach for Maintenance of Machine Tools and Equipment Based on Shop-floor Monitoring☆ , 2016 .

[18]  Åsa Fast-Berglund,et al.  Testing and validating Extended Reality (xR) technologies in manufacturing , 2018 .

[19]  Marcus Bengtsson,et al.  Machining Equipment Life Cycle Costing Model with Dynamic Maintenance Cost , 2016 .

[20]  Monica Bordegoni,et al.  Supporting Remote Maintenance in Industry 4.0 through Augmented Reality , 2017 .

[21]  Flávia Cristina Martins Queiroz Mariano,et al.  A survey of industrial augmented reality , 2020, Comput. Ind. Eng..

[22]  Johan Stahre,et al.  Smart Maintenance: an empirically grounded conceptualization , 2020, International Journal of Production Economics.

[23]  John Ahmet Erkoyuncu,et al.  A systematic review of augmented reality applications in maintenance , 2018 .

[24]  Dimitris Mourtzis,et al.  Augmented Reality Application to Support Remote Maintenance as a Service in the Robotics Industry , 2017 .

[25]  John Ahmet Erkoyuncu,et al.  A systematic review of Augmented Reality content-related techniques for knowledge transfer in maintenance applications , 2018, Comput. Ind..

[26]  P. Tse,et al.  Remote machine maintenance system through Internet and mobile communication , 2006 .

[27]  Dimitris Mourtzis,et al.  A cloud-based cyber-physical system for adaptive shop-floor scheduling and condition-based maintenance , 2018 .

[28]  Soh-Khim Ong,et al.  A novel maintenance system for equipment serviceability improvement , 2013 .

[29]  Ronald T. Azuma,et al.  The Most Important Challenge Facing Augmented Reality , 2016, PRESENCE: Teleoperators and Virtual Environments.

[30]  George Chryssolouris,et al.  On a Predictive Maintenance Platform for Production Systems , 2012 .