Design and Testing of an Augmented Reality Solution to Enhance Operator Safety in the Food Industry

Abstract: Augmented reality (AR) systems help users perform tasks and operations in man–machine interaction, by adding virtual information (such as live-video streams, pictures or instructions) to the real-world environment. This paper describes the design and testing of an AR solution created to enhance the safety of employees when carrying out maintenance tasks on a food processing machine. The machine which was analyzed is a hot-break juice extractor used to obtain juice from fruits and vegetables by separating out seeds and peel. The maintenance task for which the AR system is intended involves cleaning the machine’s porous sieves or substituting them with clean replacements and should be carried out at least every 12 hours while the plant is in operation. The paper discusses the main steps involved in developing the AR solution, its testing in the real operating environment and the expected pros/cons of its implementation and use.

[1]  Asko Riitahuhta,et al.  Augmented Reality Efficiency in Manufacturing Industry:A Case Study , 2008 .

[2]  Luigi di Stefano,et al.  Augmented Reality for Aircraft Maintenance Training and Operations Support , 2011, IEEE Computer Graphics and Applications.

[3]  F. Mas,et al.  Assembly Work Instruction Deployment Using Augmented Reality , 2012 .

[4]  Mohammad Rajabalinejad,et al.  Shaping the Future Maintenance Operations: Reflections on the Adoptions of Augmented Reality Through Problems and Opportunities , 2017 .

[5]  Markus König,et al.  Combining visual natural markers and IMU for improved AR based indoor navigation , 2017, Adv. Eng. Informatics.

[6]  Wojciech Moczulski,et al.  Augmented reality system for aiding engineering design process of machinery systems , 2011 .

[7]  Dima Damen,et al.  Cognitive Learning, Monitoring and Assistance of Industrial Workflows Using Egocentric Sensor Networks , 2015, PloS one.

[8]  D. W. F. van Krevelen,et al.  A Survey of Augmented Reality Technologies, Applications and Limitations , 2010, Int. J. Virtual Real..

[9]  Andrew Y. C. Nee,et al.  Augmented reality applications in design and manufacturing , 2012 .

[10]  Federico Manuri,et al.  Challenges, Opportunities, and Future Trends of Emerging Techniques for Augmented Reality-Based Maintenance , 2014, IEEE Transactions on Emerging Topics in Computing.

[11]  O. Wirth,et al.  When workplace safety depends on behavior change: topics for behavioral safety research. , 2008, Journal of safety research.

[12]  Monica Bordegoni,et al.  Augmented Reality System for the Visualization and Interaction with 3D Digital Models in a Wide Environment , 2014 .

[13]  Steven K. Feiner,et al.  Exploring the Benefits of Augmented Reality Documentation for Maintenance and Repair , 2011, IEEE Transactions on Visualization and Computer Graphics.

[14]  N.D. Macchiarella,et al.  A mobile application of augmented reality for aerospace maintenance training , 2005, 24th Digital Avionics Systems Conference.

[15]  Monica Bordegoni,et al.  Multimodal training and tele-assistance systems for the maintenance of industrial products , 2013 .

[16]  Ernesto Damiani,et al.  Augmented reality technologies, systems and applications , 2010, Multimedia Tools and Applications.

[17]  Agostino G. Bruzzone,et al.  Augmented reality and mobile technologies for maintenance, security and operations industrial facilities , 2016 .

[18]  Andrew Y. C. Nee,et al.  Augmented reality for assembly guidance using a virtual interactive tool , 2008 .

[19]  James H. Oliver,et al.  Augmented Reality-Based Manual Assembly Support With Visual Features for Different Degrees of Difficulty , 2015, Int. J. Hum. Comput. Interact..

[20]  Pierre Fite Georgel.  Is there a reality in Industrial Augmented Reality? , 2011, ISMAR.

[21]  Dongping Fang,et al.  A continuous Behavior-Based Safety strategy for persistent safety improvement in construction industry , 2013 .

[22]  Klaus Schilling,et al.  ARTab - using Virtual and Augmented Reality Methods for an improved Situation Awareness for Telemaintenance* , 2016 .

[23]  Charles Woodward,et al.  DATA PIPELINE FROM CAD TO AR BASED ASSEMBLY INSTRUCTIONS , 2009 .

[24]  Iina Aaltonen,et al.  Use of wearable and augmented reality technologies in industrial maintenance work , 2016, MindTrek.

[25]  Federico Manuri,et al.  Using handheld devices to sup port augmented reality-based maintenance and assembly tasks , 2015, 2015 IEEE International Conference on Consumer Electronics (ICCE).

[26]  Willibald A. Günthner,et al.  Evaluation of an Augmented Reality Supported Picking System Under Practical Conditions , 2010, Comput. Graph. Forum.

[27]  Giuseppe Monno,et al.  Augmented reality on large screen for interactive maintenance instructions , 2014, Comput. Ind..

[28]  Didier Stricker,et al.  Archeoguide: first results of an augmented reality, mobile computing system in cultural heritage sites , 2001, VAST '01.

[29]  Carlos Eduardo Pereira,et al.  A model-based approach for data integration to improve maintenance management by mixed reality , 2013, Comput. Ind..

[30]  Jae Yeol Lee,et al.  AR/RP-based tangible interactions for collaborative design evaluation of digital products , 2009 .

[31]  E. Scott Geller,et al.  Behavior-based safety in industry: Realizing the large-scale potential of psychology to promote human welfare , 2001 .

[32]  Juan M. Orduña,et al.  A new AR authoring tool using depth maps for industrial procedures , 2013, Comput. Ind..

[33]  Ömer Akin,et al.  Augmented reality-based computational fieldwork support for equipment operations and maintenance , 2011 .

[34]  Frank Sauer,et al.  Reality Augmentation for Medical Procedures: System Architecture, Single Camera Marker Tracking, and System Evaluation , 2006, International Journal of Computer Vision.

[35]  Timo Engelke,et al.  An augmented reality training platform for assembly and maintenance skills , 2013, Robotics Auton. Syst..

[36]  Steve Bourgeois,et al.  An interactive Augmented Reality system: A prototype for industrial maintenance training applications , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).