Automated optimum visualization system for construction drawing reading

The task of reading drawings on construction sites has significant efficiency and cost problems. Recent products utilising laser projectors attempt to address the issue of drawing comprehension by projecting full scale versions of the drawings onto 3D surfaces, giving an in-place representation of the steps required to complete a task. However, they only allow projection in red or green at a single brightness level due to the inherent constraints of using a laser-based system, which could cause problems depending on the surface to be projected on and the ambient conditions. Thus, there is a need for a solution that is able to adjust the visualisation parameters of the displayed information based on the surface being projected onto. This study presents a system that automatically changes the visualisation parameters based on the colour and texture of the current surface to make drawings visible under any planar-like surfaces. The proposed system consists of software and hardware, and the software algorithm contains of two parts 1) the optimisation run that computes and updates the visualisation parameters and 2) the detection loop which runs continually and checks if the optimisation run needs to be triggered or not. In order to verify the proposed system, tests on 8 subjects with 4 background surfaces commonly found on site were performed. The test subjects were timed to find 10 bolt holes projected onto the surface using the optimisation system, which was then compared to a control case of black lines projected onto a white background. The system allowed users to complete the task on the real-world backgrounds in the same time as the control case, with the system resulting in up to a 600% decrease in recognition time on some backgrounds.

[1]  A. Govardhan,et al.  Content Based Image Retrieval by Using an Integrated Matching Technique Based on Most Similar Highest Priority Principle on the Color and Texture Features of the Image Sub-blocks , 2011 .

[2]  G. Michel,et al.  Restricting the Field of View: Perceptual and Performance Effects , 1990, Perceptual and motor skills.

[3]  Leen-Seok Kang,et al.  AR-based 4D CAD System Using Marker and Markerless Recognition Method , 2017 .

[4]  Márcio Minto Fabricio,et al.  Development of an Augmented Reality environment for the assembly of a precast wood-frame wall using the BIM model , 2016 .

[5]  Effects of field of view on performance with head-mounted displays , 2000 .

[6]  H. W. Parker,et al.  Productivity improvement in construction , 1988 .

[7]  David Greenwood,et al.  Mobile augmented reality applications for construction projects , 2018 .

[8]  Hubert Dolezal Living in a World Transformed: Perceptual and Performatory Adaptation to Visual Distortion , 2004 .

[9]  Peter E.D. Love,et al.  Augmented Reality in built environment: Classification and implications for future research , 2013 .

[10]  Horst Bischof,et al.  Augmented Reality for Construction Site Monitoring and Documentation , 2014, Proceedings of the IEEE.

[11]  D 4 AR – A 4-DIMENSIONAL AUGMENTED REALITY MODEL FOR AUTOMATING CONSTRUCTION PROGRESS MONITORING DATA COLLECTION , PROCESSING AND COMMUNICATION , 2022 .

[12]  Deborah Hix,et al.  An empirical user-based study of text drawing styles and outdoor background textures for augmented reality , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[13]  Xiangyu Wang,et al.  Using Augmented Reality to Facilitate Piping Assembly: An Experiment-Based Evaluation , 2015, J. Comput. Civ. Eng..

[14]  Greg Welch,et al.  Table-top spatially-augmented realty: bringing physical models to life with projected imagery , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[15]  Xiangyu Wang,et al.  Research trends and opportunities of augmented reality applications in architecture, engineering, and construction , 2013 .

[16]  Venkata Santosh Kumar Delhi,et al.  User behaviour in AR-BIM-based site layout planning , 2018 .

[17]  Justus Thies,et al.  Real-time pixel luminance optimization for dynamic multi-projection mapping , 2015, ACM Trans. Graph..

[18]  Ramesh Raskar,et al.  Dynamic shader lamps : painting on movable objects , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[19]  Wen Yi,et al.  A critical review of virtual and augmented reality (VR/AR) applications in construction safety , 2018 .

[20]  Mani Golparvar-Fard,et al.  High-precision vision-based mobile augmented reality system for context-aware architectural, engineering, construction and facility management (AEC/FM) applications , 2013 .

[21]  Takao Terano,et al.  Big Fat Wand: A Laser Projection System for Information Sharing in a Workspace , 2011, HCI.

[22]  Greg Welch,et al.  Spatially augmented reality , 1999 .

[23]  Anselmo Lastra,et al.  Life-sized projector-based dioramas , 2001, VRST '01.

[24]  Shih-Chung Kang,et al.  Augmented Reality and Unmanned Aerial Vehicle Assist in Construction Management , 2014 .

[25]  Yao Zhao,et al.  Forensic estimation of gamma correction in digital images , 2010, 2010 IEEE International Conference on Image Processing.

[26]  Meng-Han Tsai,et al.  On-Site Building Information Retrieval by Using Projection-Based Augmented Reality , 2012, J. Comput. Civ. Eng..

[27]  Mani Golparvar-Fard,et al.  Interactive Visual Construction Progress Monitoring with D 4 AR — 4D Augmented Reality — Models , 2009 .

[28]  Yoonjung Park,et al.  DesignAR: Portable projection-based AR system specialized in interior design , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[29]  Steven K. Feiner,et al.  Knowledge-based augmented reality , 1993, CACM.

[30]  J. K. Yates Productivity Improvement for Construction and Engineering: Implementing Programs That Save Money and Time , 2014 .

[31]  Silvio Savarese,et al.  Application of D4AR - A 4-Dimensional augmented reality model for automating construction progress monitoring data collection, processing and communication , 2009, J. Inf. Technol. Constr..

[32]  Kim Halskov,et al.  3d projection on physical objects: design insights from five real life cases , 2011, CHI.

[33]  R. Edward Minchin,et al.  Using Cloud-Based Augmented Reality to 3D-Enable the 2D Drawings of AISC Steel Sculpture: A Plan-Reading Educational Experiment , 2021, Journal of Civil Engineering Education.

[34]  Sara Rankohi,et al.  Review and analysis of augmented reality literature for construction industry , 2013 .

[35]  Markus Funk,et al.  Working with Augmented Reality?: A Long-Term Analysis of In-Situ Instructions at the Assembly Workplace , 2017, PETRA.

[36]  Anselm Grundhöfer,et al.  Projection-Based Augmented Reality in Disney Theme Parks , 2012, Computer.