Towards augmented reality manuals for industry 4.0: A methodology

Abstract Augmented Reality (AR), is one of the most promising technology for technical manuals in the context of Industry 4.0. However, the implementation of AR documentation in industry is still challenging because specific standards and guidelines are missing. In this work, we propose a novel methodology for the conversion of existing “traditional” documentation, and for the authoring of new manuals in AR in compliance to Industry 4.0 principles. The methodology is based on the optimization of text usage with the ASD Simplified Technical English, the conversion of text instructions into 2D graphic symbols, and the structuring of the content through the combination of Darwin Information Typing Architecture (DITA) and Information Mapping (IM). We tested the proposed approach with a case study of a maintenance manual of hydraulic breakers. We validated it with a user test collecting subjective feedbacks of 22 users. The results of this experiment confirm that the manual obtained using our methodology is clearer than other templates.

[1]  Joseph L. Gabbard,et al.  Legibility in Industrial AR: Text Style, Color Coding, and Illuminance , 2015, IEEE Computer Graphics and Applications.

[2]  James R. Lewis,et al.  IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use , 1995, Int. J. Hum. Comput. Interact..

[3]  Christian Knöpfle,et al.  Template based authoring for AR based service scenarios , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[4]  Rolf Schwitter,et al.  Controlled Natural Languages for Knowledge Representation , 2010, COLING.

[5]  Monica Bordegoni,et al.  An Application Based on Augmented Reality and Mobile Technology to Support Remote Maintenance , 2014, EuroVR.

[6]  Mert Bal,et al.  Virtual factory approach for implementation of holonic control in industrial applications: A case study in die-casting industry , 2009 .

[7]  John Ahmet Erkoyuncu,et al.  Augmented Reality in Maintenance: An information-centred design framework , 2018 .

[8]  Michael Weber,et al.  Metadata based authoring for technical documentation , 2005, SIGDOC '05.

[9]  Timo Engelke,et al.  An augmented reality training platform for assembly and maintenance skills , 2013, Robotics Auton. Syst..

[10]  Monica Bordegoni,et al.  Converting maintenance actions into standard symbols for Augmented Reality applications in Industry 4.0 , 2018, Comput. Ind..

[11]  Soh-Khim Ong,et al.  Real-virtual components interaction for assembly simulation and planning , 2016 .

[12]  Marcello Pellicciari,et al.  A comparative study on computer-integrated set-ups to design human-centred manufacturing systems , 2019, Robotics and Computer-Integrated Manufacturing.

[13]  Juan M. Orduña,et al.  A new AR authoring tool using depth maps for industrial procedures , 2013, Comput. Ind..

[14]  Andrew Y. C. Nee,et al.  Augmented reality applications in design and manufacturing , 2012 .

[15]  Teruko Mitamura,et al.  Controlled Language for Multilingual Document Production: Experience with Caterpillar Technical English 1 , 1998 .

[16]  Tobias Kötter,et al.  Augmented and virtual reality for inspection and maintenance processes in the aviation industry , 2018 .

[17]  George-Christopher Vosniakos,et al.  Prototyping proactive and adaptive techniques for human-robot collaboration in manufacturing using virtual reality , 2018 .

[18]  Monica Bordegoni,et al.  Supporting Remote Maintenance in Industry 4.0 through Augmented Reality , 2017 .

[19]  Tatiana Batova,et al.  The Current State of Component Content Management: An Integrative Literature Review , 2015, IEEE Transactions on Professional Communication.

[20]  Jochen Deuse,et al.  Cyber Physical Systems for Life Cycle Continuous Technical Documentation of Manufacturing Facilities , 2014 .

[21]  Giuseppe Monno,et al.  Augmented reality on large screen for interactive maintenance instructions , 2014, Comput. Ind..

[22]  Giuseppe Monno,et al.  Effect of Text Outline and Contrast Polarity on AR Text Readability in Industrial Lighting , 2015, IEEE Transactions on Visualization and Computer Graphics.

[23]  Carlos Eduardo Pereira,et al.  Technical and Organizational Issues about the Introduction of Augmented Reality in Maintenance and Technical Assistance Services , 2013 .

[24]  Jungwon Yoon,et al.  Full length Article: Assembly simulations in virtual environments with optimized haptic path and sequence , 2011 .

[25]  G. L. Cascella,et al.  Evaluating the effectiveness of spatial augmented reality in smart manufacturing: a solution for manual working stations , 2017, The International Journal of Advanced Manufacturing Technology.

[26]  Dieter Schmalstieg,et al.  Retargeting Technical Documentation to Augmented Reality , 2015, CHI.

[27]  Tobias Kuhn,et al.  A Survey and Classification of Controlled Natural Languages , 2014, CL.

[28]  Steven K. Feiner,et al.  Evaluating the benefits of augmented reality for task localization in maintenance of an armored personnel carrier turret , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[29]  John Ahmet Erkoyuncu,et al.  Improving efficiency of industrial maintenance with context aware adaptive authoring in augmented reality , 2017 .

[30]  Timo Engelke,et al.  Content first - A concept for industrial augmented reality maintenance applications using mobile devices , 2013, 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[31]  Monica Bordegoni,et al.  Multimodal training and tele-assistance systems for the maintenance of industrial products , 2013 .

[32]  Soh-Khim Ong,et al.  Towards a griddable distributed manufacturing system with augmented reality interfaces , 2016 .

[33]  Boris Otto,et al.  Design Principles for Industrie 4.0 Scenarios: A Literature Review , 2015 .

[34]  Michael Priestley.  DITA XML: a reuse by reference architecture for technical documentation , 2001, SIGDOC '01.

[35]  Nassir Navab.  Developing killer apps for industrial augmented reality , 2004, IEEE Computer Graphics and Applications.

[36]  Richard Kittredge.  Sublanguages and Controlled Languages , 2005 .

[37]  John Ahmet Erkoyuncu,et al.  A systematic review of augmented reality applications in maintenance , 2018 .