Markerless BIM Registration for Mobile Augmented Reality Based Inspection

On-site construction inspection requires extensive data extraction from paper or digital drawings and/or databases. This is time consuming and labour intensive. One of the potentially viable solutions to this problem is providing easier access to such data through mobile augmented reality (AR) systems. Such systems can facilitate simpler, faster and more accurate inspection processes by allowing users to have instant access to better visualisations of the Building Information Model (BIM) for the location they inspect. One of the main problems of current AR systems is in having an accurate alignment of the BIM on the user’s view. In order to solve this problem, researchers have proposed solutions that either use tags, restrict the user to specific spots, or rely on Global Positioning Systems (GPS) and compasses that are unable to be used in an indoor environment. This paper presents an alternative, markerless solution based on the Kinect Fusion, since new mobile augmented reality devices are equipped with similar RGB and depth sensors. This solution combines the registration of the camera pose provided by Kinect Fusion with the registration achieved using the Iterative Closest Point (ICP) algorithm on the 3D reconstruction generated by Kinect Fusion. The results indicate the potential for maintaining a stable registration while traversing indoors, while generating 3D data that can be used to sense the user’s surroundings.

[1]  Oh-Seong Kwon,et al.  A defect management system for reinforced concrete work utilizing BIM, image-matching and augmented reality , 2014 .

[2]  Mani Golparvar-Fard,et al.  Automated Progress Monitoring Using Unordered Daily Construction Photographs and IFC-Based Building Information Models , 2015, J. Comput. Civ. Eng..

[3]  Ying Wang,et al.  Integrating Augmented Reality with Building Information Modeling: Onsite construction process controlling for liquefied natural gas industry , 2014 .

[4]  R. Navon,et al.  Research in automated measurement of project performance indicators , 2007 .

[5]  Ronie Navon,et al.  Automated project performance control of construction projects , 2005 .

[6]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[7]  Mani Golparvar-Fard,et al.  Monitoring of Construction Performance Using Daily Progress Photograph Logs and 4D As-Planned Models , 2009 .

[8]  Bonsang Koo,et al.  Feasibility study of 4D CAD in commercial construction , 2002 .

[9]  Javier Irizarry,et al.  InfoSPOT: A mobile Augmented Reality method for accessing building information through a situation awareness approach , 2013 .

[10]  Stéphane Côté,et al.  Live mobile panoramic high accuracy augmented reality for engineering and construction , 2013 .

[11]  Javier Irizarry,et al.  Locating Building Components in a Facility Using Augmented Reality vs. Paper-Based Methods: A User-Centered Experimental Comparison , 2014 .

[12]  Ismail Abdul Rahman,et al.  The cause factors of large project's cost overrun: a survey in the southern part of Peninsular Malaysia , 2014 .

[13]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[14]  Javier Irizarry,et al.  BIM2MAR: An Efficient BIM Translation to Mobile Augmented Reality Applications , 2015 .

[15]  Phillip S. Dunston,et al.  Identification of application areas for Augmented Reality in industrial construction based on technology suitability , 2008 .

[16]  Phillip S. Dunston,et al.  Evaluation of Augmented Reality in steel column inspection , 2009 .

[17]  Edmundas Kazimieras Zavadskas,et al.  Multi-criteria analysis of Projects' performance in construction , 2014 .

[18]  Žiga Turk,et al.  Component based engineering of a mobile BIM-based Augmented Reality system , 2014 .

[19]  SangHyun Lee and Feniosky Peña-Mora Visualization Of Construction Progress Monitoring , 2006 .

[20]  Charles Woodward,et al.  Mobile Augmented Reality for Building and Construction , 2010 .

[21]  Javier Irizarry,et al.  Issues of Translating BIM for Mobile Augmented Reality (MAR) Environments , 2014 .

[22]  Ming Sun,et al.  Cost and time control of construction projects: inhibiting factors and mitigating measures in practice , 2010 .

[23]  Janet K. Yates,et al.  Avoiding and Minimizing Construction Delay Claim Disputes in Relational Contracting , 2006 .

[24]  M. Wing,et al.  Consumer-Grade Global Positioning System (GPS) Accuracy and Reliability , 2005 .

[25]  Feniosky Peña-Mora,et al.  Application of Visualization Techniques for Construction Progress Monitoring , 2007 .

[26]  Phillip S. Dunston,et al.  Technology development needs for advancing Augmented Reality-based inspection , 2010 .

[27]  David E. Breen,et al.  Real-time vision-based camera tracking for augmented reality applications , 1997, VRST '97.