Augmented Reality in Industry 4.0

Since the origins of Augmented Reality (AR), industry has always been one of its prominent application domains. The recent advances in both portable and wearable AR devices and the new challenges introduced by the fourth industrial revolution (renowned as industry 4.0) further enlarge the applicability of AR to improve the productiveness and to enhance the user experience. This paper provides an overview on the most important applications of AR regarding the industry domain. Key among the issues raised in this paper are the various applications of AR that enhance the user's ability to understand the movement of mobile robot, the movements of a robot arm and the forces applied by a robot. It is recommended that, in view of the rising need for both users and data privacy, technologies which compose basis for Industry 4.0 will need to change their own way of working to embrace data privacy.

[1]  Emanuele Ruffaldi,et al.  Third Point of View Augmented Reality for Robot Intentions Visualization , 2016, AVR.

[2]  F. Mas,et al.  Assembly Work Instruction Deployment Using Augmented Reality , 2012 .

[3]  Mani Golparvar-Fard,et al.  Visualization of construction progress monitoring with 4D simulation model overlaid on time-lapsed photographs , 2009 .

[4]  Chung-Hyun Kim,et al.  Active insp ection supporting system based on mixed reality after design and manufacture in an offshore structure , 2010 .

[5]  Graziano Terenzi SMART MAINTENANCE An Augmented Reality Platform for Training and Field Operations in the Manufacturing Industry , 2014 .

[6]  Yu Sun,et al.  Spatial augmented reality as a method for a mobile robot to communicate intended movement , 2014, Comput. Hum. Behav..

[7]  Steven K. Feiner,et al.  Exploring the Benefits of Augmented Reality Documentation for Maintenance and Repair , 2011, IEEE Transactions on Visualization and Computer Graphics.

[8]  Didier Stricker,et al.  Augmented Reality 3D Discrepancy Check in Industrial Applications , 2016, 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[9]  Federico Manuri,et al.  Vocal One Switch (VOS) Selection Interfaces for Virtual and Augmented Reality Hands-free Tasks , 2016, STAG.

[10]  Marc Langheinrich,et al.  Privacy By Design , 2013, IEEE Pervasive Comput..

[11]  Lovekesh Vig,et al.  An AR Inspection Framework: Feasibility Study with Multiple AR Devices , 2016, 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct).

[12]  Blandine de Laval,et al.  STARMATE : Using Augmented Reality technology for computer guided maintenance of complex mechanical elements , 2002 .

[13]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[14]  Peter E.D. Love,et al.  Using Animated Augmented Reality to Cognitively Guide Assembly , 2013, J. Comput. Civ. Eng..

[15]  Andrew Y. C. Nee,et al.  Augmented reality applications in manufacturing: a survey , 2008 .

[16]  Didier Stricker,et al.  3D discrepancy check via Augmented Reality , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[17]  Steven K. Feiner,et al.  Knowledge-based augmented reality , 1993, CACM.

[18]  Luigi di Stefano,et al.  Augmented Reality for Aircraft Maintenance Training and Operations Support , 2011, IEEE Computer Graphics and Applications.

[19]  Svenja Kahn,et al.  Beyond 3D "As-Built" Information Using Mobile AR Enhancing the Building Lifecycle Management , 2012, 2012 International Conference on Cyberworlds.

[20]  T. P. Caudell,et al.  Augmented reality: an application of heads-up display technology to manual manufacturing processes , 1992, Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences.

[21]  Fabian Doil,et al.  Augmented Reality-based factory planning - an application tailored to industrial needs , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[22]  Nassir Navab,et al.  An Industrial Augmented Reality Solution For Discrepancy Check , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[23]  Batu Akan,et al.  Augmented Reality Meets Industry: Interactive Robot Programming , 2010 .

[24]  Federico Manuri,et al.  Challenges, Opportunities, and Future Trends of Emerging Techniques for Augmented Reality-Based Maintenance , 2014, IEEE Transactions on Emerging Topics in Computing.

[25]  D 4 AR – A 4-DIMENSIONAL AUGMENTED REALITY MODEL FOR AUTOMATING CONSTRUCTION PROGRESS MONITORING DATA COLLECTION , PROCESSING AND COMMUNICATION , 2022 .

[26]  Barbara G. Kanki,et al.  Identifying Human Factors Issues in Aircraft Maintenance Operations , 1995 .

[27]  Carlos Mateo,et al.  Hammer: An Android based application for end-user industrial robot programming , 2014, 2014 IEEE/ASME 10th International Conference on Mechatronic and Embedded Systems and Applications (MESA).

[28]  Dragos Datcu,et al.  Virtual co-location to support remote assistance for inflight maintenance in ground training for space missions , 2014, CompSysTech.

[29]  Panu Harmo,et al.  ETÄLÄ - Virtual Reality Assisted Telepresence System for Remote Control and Maintenance , 2000 .

[30]  Andrew Y. C. Nee,et al.  Augmented reality applications in design and manufacturing , 2012 .

[31]  Federico Manuri,et al.  A Workflow Analysis for Implementing AR-Based Maintenance Procedures , 2014, AVR.

[32]  Paula Savioja,et al.  Developing a Mobile, Service-Based Augmented Reality Tool for Modern Maintenance Work , 2007, HCI.

[33]  Sotiris Makris,et al.  Augmented Reality (AR) Applications for Supporting Human-robot Interactive Cooperation , 2016 .

[34]  Federico Manuri,et al.  A Flexible AR-based Training System for Industrial Maintenance , 2015, AVR.

[35]  Ivan E. Sutherland,et al.  A head-mounted three dimensional display , 1968, AFIPS Fall Joint Computing Conference.

[36]  Federico Manuri,et al.  Using Semantics to Automatically Generate Speech Interfaces for Wearable Virtual and Augmented Reality Applications , 2017, IEEE Transactions on Human-Machine Systems.

[37]  Steven K. Feiner,et al.  Augmented Reality for Maintenance and Repair (ARMAR) , 2007 .

[38]  Rosemary Luckin,et al.  “Making it real”: exploring the potential of augmented reality for teaching primary school science , 2006, Virtual Reality.

[39]  Daniel Kurz,et al.  [Poster] A Mobile Augmented reality system to assist auto mechanics , 2014, 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[40]  Luis Eduardo Garza,et al.  Augmented reality in pneumatic conveying system: Fuller pump dry material line charger , 2014, 2014 9th Iberian Conference on Information Systems and Technologies (CISTI).

[41]  Takafumi Matsumaru Mobile Robot with Preliminary-announcement and Display Function of Forthcoming Motion using Projection Equipment , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[42]  Cheng Zeng,et al.  An augmented reality based system for remote collaborative maintenance instruction of complex products , 2014, 2014 IEEE International Conference on Automation Science and Engineering (CASE).

[43]  Frank Biocca,et al.  Comparative effectiveness of augmented reality in object assembly , 2003, CHI '03.

[44]  Nickolas D. Macchiarella,et al.  A mobile application of augmented reality for aerospace maintenance training , 2005, 24th Digital Avionics Systems Conference.

[45]  Dieter Schmalstieg,et al.  Augmented Reality for Industrial Building Acceptance , 2008, 2008 IEEE Virtual Reality Conference.

[46]  Dieter Schmalstieg,et al.  Experiences with Handheld Augmented Reality , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[47]  Ravi Teja Chadalavada,et al.  That's on my mind! robot to human intention communication through on-board projection on shared floor space , 2015, 2015 European Conference on Mobile Robots (ECMR).

[48]  Horst Bischof,et al.  Augmented Reality for Construction Site Monitoring and Documentation , 2014, Proceedings of the IEEE.