Augmented Reality in Industry 4.0 and Future Innovation Programs

Augmented Reality (AR) is worldwide recognized as one of the leading technologies of the 21st century and one of the pillars of the new industrial revolution envisaged by the Industry 4.0 international program. Several papers describe, in detail, specific applications of Augmented Reality developed to test its potentiality in a variety of fields. However, there is a lack of sources detailing the current limits of this technology in the event of its introduction in a real working environment where everyday tasks could be carried out by operators using an AR-based approach. A literature analysis to detect AR strength and weakness has been carried out, and a set of case studies has been implemented by authors to find the limits of current AR technologies in industrial applications outside the laboratory-protected environment. The outcome of this paper is that, even though Augmented Reality is a well-consolidated computer graphic technique in research applications, several improvements both from a software and hardware point of view should be introduced before its introduction in industrial operations. The originality of this paper lies in the detection of guidelines to improve the Augmented Reality potentialities in factories and industries.

[1]  Alessandro Ceruti,et al.  Augmented vision and interactive monitoring in 3D printing process , 2017 .

[2]  Karl-Petter Åkesson,et al.  Windows on the World: An example of Augmented Virtuality , 1997 .

[3]  K. Weimer,et al.  Mixed Reality with HoloLens: Where Virtual Reality Meets Augmented Reality in the Operating Room , 2017, Plastic and reconstructive surgery.

[4]  Yang Wang,et al.  The role of user-centered AR instruction in improving novice spatial cognition in a high-precision procedural task , 2021, Adv. Eng. Informatics.

[5]  Ben Horan,et al.  Taking the LEAP with the Oculus HMD and CAD - Plucking at thin Air? , 2015 .

[6]  Joe Gabbard,et al.  What, How, and Why are Visual Assets Used in Industrial Augmented Reality? A Systematic Review and Classification in Maintenance, Assembly, and Training (From 1997 to 2019) , 2020, IEEE Transactions on Visualization and Computer Graphics.

[7]  Dimitris Mourtzis,et al.  Real-Time Remote Maintenance Support Based on Augmented Reality (AR) , 2020, Applied Sciences.

[8]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[9]  Willibald A. Günthner,et al.  Evaluation of an Augmented Reality Supported Picking System Under Practical Conditions , 2010, Comput. Graph. Forum.

[10]  Maria Grazia Gnoni,et al.  Is Digital Twin Technology Supporting Safety Management? A Bibliometric and Systematic Review , 2021 .

[11]  Dieter Schmalstieg,et al.  Evaluating Mixed and Augmented Reality: A Systematic Literature Review (2009-2019) , 2020, 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[12]  J. M. M. Montiel,et al.  ORB-SLAM: A Versatile and Accurate Monocular SLAM System , 2015, IEEE Transactions on Robotics.

[13]  Fumio Kishino,et al.  Augmented reality: a class of displays on the reality-virtuality continuum , 1995, Other Conferences.

[14]  James A. Ferwerda,et al.  Three varieties of realism in computer graphics , 2003, IS&T/SPIE Electronic Imaging.

[15]  Maria Grazia Gnoni,et al.  A classification proposal of digital twin applications in the safety domain , 2021, Comput. Ind. Eng..

[16]  Long Chen,et al.  A Stable and Accurate Marker-Less Augmented Reality Registration Method , 2017, 2017 International Conference on Cyberworlds (CW).

[17]  Mark Billinghurst,et al.  Enhancing First-Person View Task Instruction Videos with Augmented Reality Cues , 2020, 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[18]  Miika Aittala,et al.  Inverse lighting and photorealistic rendering for augmented reality , 2010, The Visual Computer.

[19]  N. Navab,et al.  Augmented Reality in Orthopedic Surgery Is Emerging from Proof of Concept Towards Clinical Studies: a Literature Review Explaining the Technology and Current State of the Art , 2021, Current Reviews in Musculoskeletal Medicine.

[20]  Sanni Siltanen,et al.  Texture generation over the marker area , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[21]  Sharvari Govilkar,et al.  COMPARATIVE STUDY OF AUGMENTED REALITY SDK’S , 2015 .

[22]  Paulo Leitão,et al.  Augmented reality experiments with industrial robot in industry 4.0 environment , 2016, 2016 IEEE 14th International Conference on Industrial Informatics (INDIN).

[23]  Alessandro Ceruti,et al.  Semi-automatic Design for Disassembly Strategy Planning: An Augmented Reality Approach☆ , 2017 .

[24]  K. Poulose Jacob,et al.  JERIM-320: A new 320-Bit Hash Function Compared to Hash Functions with Parallel Branches , 2008, Int. J. Comput. Sci. Appl..

[25]  Michele Gattullo,et al.  Design preferences on Industrial Augmented Reality: a survey with potential technical writers , 2020, 2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct).

[26]  Luca De Marchi,et al.  Augmented Reality to Support On-Field Post-Impact Maintenance Operations on Thin Structures , 2013, J. Sensors.

[27]  Giuseppe Monno,et al.  Augmented reality on large screen for interactive maintenance instructions , 2014, Comput. Ind..

[28]  Willibald A. Günthner,et al.  Pick-by-vision: there is something to pick at the end of the augmented tunnel , 2011, Virtual Reality.

[29]  Miguel Mendoza,et al.  Machining and Dimensional Validation Training Using Augmented Reality for a Lean Process , 2015 .

[30]  Giuseppe Monno,et al.  Text legibility for projected Augmented Reality on industrial workbenches , 2015, Comput. Ind..

[31]  Robin Hanson,et al.  Augmented reality as a means of conveying picking information in kit preparation for mixed-model assembly , 2017, Comput. Ind. Eng..

[32]  Annerose Braune,et al.  Case study on applying augmented reality for process supervision in industrial use cases , 2016, 2016 IEEE 21st International Conference on Emerging Technologies and Factory Automation (ETFA).

[33]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[34]  Graham Lawton,et al.  Through the HoloLens™ looking glass: augmented reality for extremity reconstruction surgery using 3D vascular models with perforating vessels , 2018, European Radiology Experimental.

[35]  Matthias Neges,et al.  Augmented Virtuality for maintenance training simulation under various stress conditions , 2018 .

[36]  Ronald Azuma,et al.  A survey of augmented reality" Presence: Teleoperators and virtual environments , 1997 .