Challenges, Opportunities, and Future Trends of Emerging Techniques for Augmented Reality-Based Maintenance

Augmented reality (AR) is a well-known technology that can be exploited to provide mass-market users an effective and customizable support in a large spectrum of personal applications, by overlapping computer-generated hints to the real world. Mobile devices, such as smartphones and tablets, are playing a key role in the exponential growth of this kind of solutions. Nonetheless, there exists some application domains that just started to take advantage from the AR systems. Maintenance, repair, and assembly have been considered as strategic fields for the application of the AR technology from the 1990s, but often only specialists using ad hoc hardware were involved in limited experimental tests. Nowadays, AR-based maintenance and repair procedures are available also for end-users on consumer electronics devices. This paper aims to explore new challenges and opportunities of this technology, by also presenting the software framework that is being developed in the EASE-R3 project by exploiting reconfigurable AR procedures and tele-assistance to overcome some of the limitations of current solutions.

[1]  Paula Savioja,et al.  Developing a Mobile, Service-Based Augmented Reality Tool for Modern Maintenance Work , 2007, HCI.

[2]  Svenja Kahn,et al.  Beyond 3D "As-Built" Information Using Mobile AR Enhancing the Building Lifecycle Management , 2012, 2012 International Conference on Cyberworlds.

[3]  Agile Manifesto,et al.  Manifesto for Agile Software Development , 2001 .

[4]  Nassir Navab.  Developing killer apps for industrial augmented reality , 2004, IEEE Computer Graphics and Applications.

[5]  Blandine de Laval,et al.  STARMATE : Using Augmented Reality technology for computer guided maintenance of complex mechanical elements , 2002 .

[6]  Timo Engelke,et al.  Augmented Reality Training for Assembly and Maintenance Skills , 2011 .

[7]  Bernd Schwald,et al.  An Augmented Reality System for Training and Assistence to Maintenance in the Industrial Context , 2003, WSCG.

[8]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[9]  Peter E.D. Love,et al.  Using Animated Augmented Reality to Cognitively Guide Assembly , 2013, J. Comput. Civ. Eng..

[10]  Ivan E. Sutherland,et al.  A head-mounted three dimensional display , 1968, AFIPS Fall Joint Computing Conference.

[11]  Andrew Y. C. Nee,et al.  Augmented reality applications in manufacturing: a survey , 2008 .

[12]  Herbert Peremans,et al.  Physical interaction in a dematerialized world , 2013 .

[13]  Ning Wang,et al.  Virtual Assembly, Maintenance and Training System Based on the Virtual - Real Fusion Technology , 2013, 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing.

[14]  Alistair Cockburn,et al.  Agile Software Development , 2001 .

[15]  Yongsheng Ma,et al.  Product lifecycle management in aviation maintenance, repair and overhaul , 2008, Comput. Ind..

[16]  Frank Biocca,et al.  Comparative effectiveness of augmented reality in object assembly , 2003, CHI '03.

[17]  Alex Olwal,et al.  Spatial augmented reality on industrial CNC-machines , 2008, Electronic Imaging.

[18]  Fabian Doil,et al.  Augmented Reality-based factory planning - an application tailored to industrial needs , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[19]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[20]  Reto Lindegger.  Handheld Augmented Reality , 2013 .

[21]  Steven K. Feiner,et al.  Augmented Reality for Maintenance and Repair (ARMAR) , 2007 .

[22]  Steven K. Feiner,et al.  Opportunistic Tangible User Interfaces for Augmented Reality , 2010, IEEE Transactions on Visualization and Computer Graphics.

[23]  Asko Riitahuhta,et al.  Augmented Reality Efficiency in Manufacturing Industry:A Case Study , 2008 .

[24]  Graziano Terenzi.  SMART MAINTENANCE An Augmented Reality Platform for Training and Field Operations in the Manufacturing Industry , 2014 .

[25]  Nickolas D. Macchiarella,et al.  A mobile application of augmented reality for aerospace maintenance training , 2005, 24th Digital Avionics Systems Conference.

[26]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[27]  Wolfgang Friedrich,et al.  ARVIKA-augmented reality for development, production and service , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[28]  Michael Kleiber,et al.  User-centered design and evaluation of an integrated AR-VR system for tele-maintenance , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[29]  Luis Eduardo Garza,et al.  Augmented Reality Application for the Maintenance of a Flapper Valve of a Fuller-kynion Type M Pump , 2013, VARE.

[30]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[31]  Andrew Y. C. Nee,et al.  Augmented reality applications in design and manufacturing , 2012 .

[32]  Ömer Akin,et al.  Augmented reality-based computational fieldwork support for equipment operations and maintenance , 2011 .

[33]  Woodrow Barfield,et al.  Fundamentals of Wearable Computers and Augumented Reality , 2000 .

[34]  Tapio Salonen,et al.  Dynamic and Visual Assembly Instruction for Configurable Products Using Augmented Reality Techniques , 2008 .

[35]  Dieter Schmalstieg,et al.  Experiences with Handheld Augmented Reality , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[36]  Jung-Min Lee,et al.  An Enhanced Smart Maintenance of Piping System For the Offshore Plants , 2012 .

[37]  Steven K. Feiner,et al.  Exploring the Benefits of Augmented Reality Documentation for Maintenance and Repair , 2011, IEEE Transactions on Visualization and Computer Graphics.

[38]  Il-Young Moon,et al.  E-Training Content Delivery Networking System for Augmented Reality Car Maintenance Training Application , 2013 .

[39]  Gandjar Kiswanto,et al.  Development of Augmented Reality (AR) for machining simulation of 3-axis CNC milling , 2013, 2013 International Conference on Advanced Computer Science and Information Systems (ICACSIS).

[40]  Rüdiger Mecke,et al.  Mobile Augmented Reality in industrial applications: Approaches for solution of user-related issues , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[41]  Steven K. Feiner,et al.  Evaluating the benefits of augmented reality for task localization in maintenance of an armored personnel carrier turret , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[42]  F. Mas,et al.  Assembly Work Instruction Deployment Using Augmented Reality , 2012 .

[43]  Steven K. Feiner,et al.  Knowledge-based augmented reality , 1993, CACM.

[44]  Timo Engelke,et al.  An augmented reality training platform for assembly and maintenance skills , 2013, Robotics Auton. Syst..

[45]  Manuel Castro,et al.  Industrial Telemaintenance: Remote Management Experience From Subway to Industrial Electronics , 2011, IEEE Transactions on Industrial Electronics.

[46]  Dongyi Chen,et al.  An Augmented Reality-Based Application for Equipment Maintenance , 2005, ACII.