An Approach for Construction of Augmented Reality Systems using Natural Markers and Mobile Sensors in Industrial Fields

This paper presents a methodology for the development of augmented reality (AR) visualization applications in industrial scenarios. The proposal presents the use of georreferenced natural markers detected in real time, which enables the construction of AR systems. This use of augmented visualization allows the creation of tools that can aid on-site maintenance activities for operators. AR use makes possible including information about the equipment during a specific procedure. In this work, the detection of natural markers in the scene are based on Haar-like features associated with equipment geolocalization. This approach enable the detection of equipment in multiple user’s viewpoints in the industrial scenario and makes it possible the inclusion of real information about those equipment in real time as AR annotations. In this way, beyond a methodology approach, this paper presents a new way for Power System information visualization in the field that can be used in both for training and for control operations.

[1]  Lamine Mili,et al.  Power system and communication network co-simulation for smart grid applications , 2011, ISGT 2011.

[2]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[3]  Hongbin Sun,et al.  Transmission Contingency Analysis Based on Integrated Transmission and Distribution Power Flow in Smart Grid , 2015, IEEE Transactions on Power Systems.

[4]  Lifen Zhang,et al.  Registered Localization Method-based on OpenCV for Augmented Reality , 2011, 2011 International Conference of Soft Computing and Pattern Recognition (SoCPaR).

[5]  Ehab F. El-Saadany,et al.  A Novel Cooperative Protocol for Distributed Voltage Control in Active Distribution Systems , 2013, IEEE Transactions on Power Systems.

[6]  R. D. Christie,et al.  Envisioning power system data: vulnerability and severity representations for static security assessment , 1994 .

[7]  Ondrej Popelka,et al.  Mobile Augmented Reality Applications , 2011, ArXiv.

[8]  Yang Jian,et al.  Cloud computing and visual attention based object detection for power substation surveillance robots , 2015, 2015 IEEE 28th Canadian Conference on Electrical and Computer Engineering (CCECE).

[9]  Anselmo Cardoso de Paiva,et al.  AGITO: Virtual Reality Environment for Power Systems Substations Operators Training , 2014, AVR.

[10]  Jaeyoung Kim,et al.  Implementation of image processing and augmented reality programs for smart mobile device , 2011, Proceedings of 2011 6th International Forum on Strategic Technology.

[11]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[12]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[13]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[14]  Jin-Hui Zhu,et al.  Simultaneous Recognition and Modeling for Learning 3-D Object Models From Everyday Scenes , 2015, IEEE Transactions on Cybernetics.

[15]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[16]  Costin Pribeanu.  Specification and Validation of a Formative Index to Evaluate the Ergonomic Quality of an AR-based Educational Platform , 2012, Int. J. Comput. Commun. Control.

[17]  David Blatner,et al.  Silicon Mirage: The Art and Science of Virtual Reality , 1992 .

[18]  Ronald Azuma,et al.  A survey of augmented reality" Presence: Teleoperators and virtual environments , 1997 .

[19]  Swati Nigam,et al.  Moment invariants based object recognition for different pose and appearances in real scenes , 2013, 2013 International Conference on Informatics, Electronics and Vision (ICIEV).

[20]  R. D. Christie,et al.  Envisioning power system data: concepts and a prototype system state representation , 1993 .

[21]  Thomas J. Overbye,et al.  Visualization of power system data , 2000, Proceedings of the 33rd Annual Hawaii International Conference on System Sciences.

[22]  Colin P. Schwegmann,et al.  Ship detection in South African oceans using SAR, CFAR and a Haar-like feature classifier , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[23]  Thomas J. Overbye,et al.  New methods for the visualization of electric power system information , 2000, IEEE Symposium on Information Visualization 2000. INFOVIS 2000. Proceedings.

[24]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[25]  Renaud Gervais,et al.  Offline spatial panoramic video augmentation for visual communication in the AEC industry , 2013 .

[26]  Gonzalo Farias,et al.  Using Augmented Reality in Remote Laboratories , 2013, Int. J. Comput. Commun. Control.

[27]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[28]  Matthew D. Cooper,et al.  Visualization of Power System Data on Situation Overview Displays , 2012, 2012 16th International Conference on Information Visualisation.

[29]  Thomas J. Overbye,et al.  Voltage contours for power system visualization , 2000 .

[30]  M. Antonijevic,et al.  Augmented reality for substation automation by utilizing IEC 61850 communication , 2016, 2016 39th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO).