Design and Implementation of a Connection between Augmented Reality and Sensors

Wireless sensor networks (WSN) are used by engineers to record the behavior of structures. The sensors provide data to be used by engineers to make informed choices and prioritize decisions concerning maintenance procedures, required repairs, and potential infrastructure replacements. However, reliable data collection in the field remains a challenge. The information obtained by the sensors in the field frequently needs further processing, either at the decision-making headquarters or in the office. Although WSN allows data collection and analysis, there is often a gap between WSN data analysis results and the way decisions are made in industry. The industry depends on inspectors’ decisions, so it is of vital necessity to improve the inspectors’ access in the field to data collected from sensors. This paper presents the results of an experiment that shows the way Augmented Reality (AR) may improve the availability of WSN data to inspectors. AR is a tool which overlays the known attributes of an object with the corresponding position on the headset screen. In this way, it allows the integration of reality with a virtual representation provided by a computer in real time. These additional synthetic overlays supply data that may be unavailable otherwise, but it may also display additional contextual information. The experiment reported in this paper involves the application of a smart Strain Gauge Platform, which automatically measures strain for different applications, using a wireless sensor. In this experiment, an AR headset was used to improve actionable data visualization. The results of the reported experiment indicate that since the AR headset makes it possible to visualize information collected from the sensors in a graphic form in real time, it enables automatic, effective, reliable, and instant communication from a smart low-cost sensor strain gauge to a database. Moreover, it allows inspectors to observe augmented data and compare it across time and space, which then leads to appropriate prioritization of infrastructure management decisions based on accurate observations.

[1]  Fernando Moreu,et al.  Augmented reality for next generation infrastructure inspections , 2020, Structural Health Monitoring.

[2]  Dan M. Frangopol,et al.  Maintenance Principles for Civil Structures , 2009 .

[3]  Charles R. Farrar,et al.  Structural Health Monitoring for Civil Infrastructure , 2013 .

[4]  Yi-Qing Ni,et al.  Structural Health Monitoring of Large Civil Engineering Structures , 2018 .

[5]  Charles R. Farrar,et al.  Damage identification and health monitoring of structural and mechanical systems from changes in their vibration characteristics: A literature review , 1996 .

[6]  Ian F. Akyildiz,et al.  Wireless sensor networks: a survey , 2002, Comput. Networks.

[7]  Robin Hirsch,et al.  Human Factors Considerations for the Application of Augmented Reality in an Operational Railway Environment , 2015 .

[8]  Hoon Sohn,et al.  A Review of Structural Health Review of Structural Health Monitoring Literature 1996-2001. , 2002 .

[9]  Alison B. Flatau,et al.  Review Paper: Health Monitoring of Civil Infrastructure , 2003 .

[10]  Fernando Moreu,et al.  Measuring Reference-Free Total Displacements of Piles and Columns Using Low-Cost, Battery-Powered, Efficient Wireless Intelligent Sensors (LEWIS2) , 2019, Sensors.

[11]  J M W Brownjohn,et al.  Structural health monitoring of civil infrastructure , 2007, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[12]  Branko Glisic,et al.  Combination of Image-Based Documentation and Augmented Reality for Structural Health Monitoring and Building Pathology , 2019, Front. Built Environ..

[13]  Ramesh Govindan,et al.  Monitoring civil structures with a wireless sensor network , 2006, IEEE Internet Computing.

[14]  Yi-Qing Ni,et al.  Technology developments in structural health monitoring of large-scale bridges , 2005 .

[15]  Fernando Moreu,et al.  Augmented Reality Enhancing the Inspections of Transportation Infrastructure: Research, Education, and Industry Implementation , 2019 .