An AR Inspection Framework: Feasibility Study with Multiple AR Devices

We present an Augmented Reality (AR) based re-configurable framework for inspection that can be utilized in cross-domain applications such as maintenance and repair assistance in industrial inspection, health sector to record vitals, and automotive/avionics domain inspection, amongst others. The novelty of the inspection framework as compared to the existing counterparts are three fold. Firstly, the inspection check-list can be prioritized by detecting the parts viewed in inspector's field using deep learning principles. Second, the backend of the framework is easily configurable for different applications where instructions and assistance manuals can be directly imported and visually integrated with inspection type. Third, we conduct a feasibility study on inspection modes such as Google Glass, Google Cardboard, Paper based and Tablet for inspection turnaround time, ease, and usefulness by taking a 3D printer inspection use-case.

[1]  Sharvari Govilkar,et al.  COMPARATIVE STUDY OF AUGMENTED REALITY SDK’S , 2015 .

[2]  A. Wong,et al.  Vehicle Inspection and Maintenance-The California Program , 1976 .

[3]  Koen E. A. van de Sande,et al.  Segmentation as selective search for object recognition , 2011, 2011 International Conference on Computer Vision.

[4]  Steven K. Feiner,et al.  Augmented Reality for Maintenance and Repair (ARMAR) , 2007 .

[5]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  R. Hebbalaguppe,et al.  How interaction methods affect image segmentation: User experience in the task , 2013, 2013 1st IEEE Workshop on User-Centered Computer Vision (UCCV).

[7]  Lina J. Karam,et al.  A No-Reference Image Blur Metric Based on the Cumulative Probability of Blur Detection (CPBD) , 2011, IEEE Transactions on Image Processing.

[8]  Kee-Sung Lee,et al.  A Unified Framework for Augmented Reality and Knowledge-Based Systems in Maintaining Aircraft , 2014, AAAI.

[9]  D. W. F. van Krevelen,et al.  A Survey of Augmented Reality Technologies, Applications and Limitations , 2010, Int. J. Virtual Real..

[10]  Monica Bordegoni,et al.  An Augmented Reality Framework for Supporting and Monitoring Operators during Maintenance Tasks , 2014, HCI.

[11]  M. Dalva,et al.  A survey of faults on induction motors in offshore oil industry, petrochemical industry, gas terminals and oil refineries , 1994, Proceedings of IEEE Petroleum and Chemical Industry Technical Conference (PCIC '94).

[12]  Naomi B. Robbins,et al.  Plotting Likert and Other Rating Scales , 2011 .

[13]  K. Poulose Jacob,et al.  JERIM-320: A new 320-Bit Hash Function Compared to Hash Functions with Parallel Branches , 2008, Int. J. Comput. Sci. Appl..