Challenges and enablers of augmented reality technology for in situ walkthrough applications

The successful implementation of situational-awareness enhancement using next-generation augmented reality in construction project walkthroughs has significant associated challenges. In this research, an augmented reality (AR) approach was developed to evaluate and showcase the trade-offs between capacity, latency, and reliability for the technology. The approach, named “i-Tracker”, overlays visualizations of designs by creating virtual content to be superimposed into physical contexts. i-Tracker uses the latest generation of mobile computing technology to effectively locate design information from existing parametric engineering designs (architectural, structural, and mechanical objects) and create a fully animated scene in situ. The i-Tracker technology uses a combination of depth-sensing cameras and inertial measurement unit (IMU) sensors. The evaluation of this technology demonstrates the requirements and limitations applicable to the implementation of this technology in job sites. In the example use case, the device’s relative position and orientation with respect to the user are estimated. Performance features such as motion tracking, localization, error dispersion with respect to luminance, system processing speed, and ambiguity in the feature tracking are evaluated. i-Tracker contributes to the body of literature and current work on the use of positioning and tracking systems in real construction sites within the AR context. This project advances understanding of rapid implementations and the use of AR visualizations on job sites, utilizing significant progress in mobile and ubiquitous computing with faster central processing units (CPUs) and graphical processing units (GPUs).

[1]  Xiangyu Wang,et al.  Using Augmented Reality to Facilitate Piping Assembly: An Experiment-Based Evaluation , 2015, J. Comput. Civ. Eng..

[2]  Frank Biocca,et al.  Comparative effectiveness of augmented reality in object assembly , 2003, CHI '03.

[3]  Tian Yu,et al.  Adaptive Computation Offloading from Mobile Devices into the Cloud , 2012, 2012 IEEE 10th International Symposium on Parallel and Distributed Processing with Applications.

[4]  Ivan Mutis.  Spatial-Temporal Cognitive Ability: Coupling Representations to Situations and Contexts for Coordinating Activities in the Construction Project Environment , 2018 .

[5]  Soh-Khim Ong,et al.  A State-of-the-Art Review of Augmented Reality in Engineering Analysis and Simulation , 2017, Multimodal Technol. Interact..

[6]  Horst Bischof,et al.  Augmented Reality for Construction Site Monitoring and Documentation , 2014, Proceedings of the IEEE.

[7]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[8]  P. Anandan,et al.  A computational framework and an algorithm for the measurement of visual motion , 1987, International Journal of Computer Vision.

[9]  Ying Zhou,et al.  Implementation of augmented reality for segment displacement inspection during tunneling construction , 2017 .

[10]  David H. Jonassen,et al.  Learning to Solve Problems : A Handbook for Designing Problem-Solving Learning Environments , 2010 .

[11]  Roberta L Klatzky,et al.  Spatial Representations From Perception and Cognitive Mediation , 2008, Current directions in psychological science.

[12]  D. W. F. van Krevelen,et al.  A Survey of Augmented Reality Technologies, Applications and Limitations , 2010, Int. J. Virtual Real..

[13]  Mehdi Bennis,et al.  Toward Low-Latency and Ultra-Reliable Virtual Reality , 2018, IEEE Network.

[14]  Peter E.D. Love,et al.  Augmented Reality in built environment: Classification and implications for future research , 2013 .

[15]  Yolanda González Cid,et al.  Real-time 3d SLAM with wide-angle vision , 2004 .

[16]  Steven K. Ayer,et al.  Mobile Augmented Reality to Influence Design and Constructability Review Sessions , 2019, Journal of Architectural Engineering.

[17]  Markus König,et al.  Natural markers for augmented reality-based indoor navigation and facility maintenance , 2014 .

[18]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[19]  Xiangyu Wang,et al.  Compatibility issues in Augmented Reality systems for AEC: An experimental prototype study , 2006 .

[20]  Amir H. Behzadan,et al.  Design and Assessment of a Mobile Augmented Reality-Based Information Delivery Tool for Construction and Civil Engineering Curriculum , 2015 .

[21]  Sara Rankohi,et al.  Review and analysis of augmented reality literature for construction industry , 2013 .

[22]  D Marr,et al.  Bandpass channels, zero-crossings, and early visual information processing. , 1979, Journal of the Optical Society of America.

[23]  Wen Yi,et al.  A critical review of virtual and augmented reality (VR/AR) applications in construction safety , 2018 .

[24]  Raja R. A. Issa,et al.  Enhancing Spatial and Temporal Cognitive Ability in Construction Education Through Augmented Reality and Artificial Visualizations , 2014 .

[25]  Chan-Sik Park,et al.  A framework for construction safety management and visualization system , 2013 .

[26]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[27]  S. Gilbert,et al.  Great Expectations: Content, Communications, Productivity, and the Role of Information Technology in Higher Education , 1995 .

[28]  Cheryl Desha,et al.  Transforming of engineering education , 2010 .

[29]  David Greenwood,et al.  Mobile augmented reality applications for construction projects , 2018 .

[30]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[31]  Jun Wang,et al.  A Critical Review of the Use of Virtual Reality in Construction Engineering Education and Training , 2018, International journal of environmental research and public health.

[32]  Vineet R. Kamat,et al.  Animation Of Construction Activities In Outdoor Augmented Reality , 2006 .

[33]  Woodrow Barfield,et al.  Fundamentals of Wearable Computers and Augumented Reality , 2000 .

[34]  J. Woo.  BIM ( Building Information Modeling ) and Pedagogical Challenges , 2007 .

[35]  Oh-Seong Kwon,et al.  A framework for proactive construction defect management using BIM, augmented reality and ontology-based data collection template , 2013 .

[36]  Jake K. Aggarwal,et al.  Human Motion Analysis: A Review , 1999, Comput. Vis. Image Underst..

[37]  George Papagiannakis,et al.  A survey of mobile and wireless technologies for augmented reality systems , 2008, Comput. Animat. Virtual Worlds.