Generating Absolute-Scale Point Cloud Data of Built Infrastructure Scenes Using a Monocular Camera Setting

AbstractThe global scale of point cloud data (PCD) generated through monocular photography and videogrammetry is unknown and can be calculated using at least one known dimension of the scene. Measuring one or more dimensions for this purpose induces a manual step in the three-dimensional reconstruction process; this increases the effort and reduces the speed of reconstructing scenes, and induces substantial human error in the process due to the high level of measurement accuracy needed. Other ways of measuring such dimensions are based on acquiring additional information by either using extra sensors or specific classes of objects existing in the scene; it was found that these solutions are not simple, cost effective, or general enough to be considered practical for reconstructing both indoor and outdoor built infrastructure scenes. To address the issue, this paper proposes a novel method for automatically calculating the absolute scale of built infrastructure PCD. A premeasured cube for outdoor scenes an...

[1]  Mani Golparvar-Fard,et al.  Automated Progress Monitoring Using Unordered Daily Construction Photographs and IFC-Based Building Information Models , 2015, J. Comput. Civ. Eng..

[2]  Roland Siegwart,et al.  Absolute scale in structure from motion from a single vehicle mounted camera by exploiting nonholonomic constraints , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[3]  Ioannis K. Brilakis,et al.  A videogrammetric as-built data collection method for digital fabrication of sheet metal roof panels , 2013, Adv. Eng. Informatics.

[4]  Rui Portocarrero Sarmento,et al.  Introduction to Linear Regression , 2017 .

[5]  Luc Van Gool,et al.  Markerless Vision‐Based Augmented Reality for Urban Planning , 2014, Comput. Aided Civ. Infrastructure Eng..

[6]  Patricio A. Vela,et al.  Optimized selection of key frames for monocular videogrammetric surveying of civil infrastructure , 2013, Adv. Eng. Informatics.

[7]  Hui Li,et al.  Fractal Dimension‐Based Damage Detection Method for Beams with a Uniform Cross‐Section , 2011, Comput. Aided Civ. Infrastructure Eng..

[8]  Davide Scaramuzza,et al.  Robot localization using soft object detection , 2012, 2012 IEEE International Conference on Robotics and Automation.

[9]  Guohui Zhang,et al.  Optimizing Coordinated Ramp Metering: A Preemptive Hierarchical Control Approach , 2013, Comput. Aided Civ. Infrastructure Eng..

[10]  Roland Siegwart,et al.  Fusion of IMU and Vision for Absolute Scale Estimation in Monocular SLAM , 2011, J. Intell. Robotic Syst..

[11]  Michael J. Tribou.  Recovering Scale in Relative Pose and Target Model Estimation Using Monocular Vision , 2009 .

[12]  Christian Wöhler,et al.  Monocular 3D Scene Reconstruction at Absolute Scales by Combination of Geometric and Real-Aperture Methods , 2006, DAGM-Symposium.

[13]  Ioannis Brilakis,et al.  Innovative Stereo Vision-Based Approach to Generate Dense Depth Map of Transportation Infrastructure , 2011 .

[14]  J. M. M. Montiel,et al.  Sensor Influence in the Performance of Simultaneous Mobile Robot Localization and Map Building , 1999, ISER.

[15]  Fei Dai,et al.  Comparison of Image-Based and Time-of-Flight-Based Technologies for Three-Dimensional Reconstruction of Infrastructure , 2013 .

[16]  Nora El-Gohary,et al.  Civil Engineering Grand Challenges: Opportunities for Data Sensing, Information Analysis, and Knowledge Discovery , 2014, J. Comput. Civ. Eng..

[17]  José Miguel Salles Dias,et al.  Semi-Automatic 3D Reconstruction of Urban Areas Using Epipolar Geometry and Template Matching , 2006, Comput. Aided Civ. Infrastructure Eng..

[18]  Steven Mills,et al.  Correcting Scale Drift by Object Recognition in Single-Camera SLAM , 2013, IEEE Transactions on Cybernetics.

[19]  Josechu J. Guerrero,et al.  Full scaled 3D visual odometry from a single wearable omnidirectional camera , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Roland Siegwart,et al.  Closed-form solution for absolute scale velocity determination combining inertial measurements and a single feature correspondence , 2011, 2011 IEEE International Conference on Robotics and Automation.

[21]  Mohammad R. Jahanshahi,et al.  An innovative methodology for detection and quantification of cracks through incorporation of depth perception , 2011, Machine Vision and Applications.

[22]  Mani Golparvar-Fard,et al.  Development and Use of the NIST Intelligent and Automated Construction Job Site Testbed | NIST , 2011 .

[23]  Michel Dhome,et al.  Fast Odometry Integration in Local Bundle Adjustment-Based Visual SLAM , 2010, 2010 20th International Conference on Pattern Recognition.

[24]  Hyun Myung,et al.  Structured light 2D range finder for simultaneous localization and map-building (SLAM) in home environments , 2004, Micro-Nanomechatronics and Human Science, 2004 and The Fourth Symposium Micro-Nanomechatronics for Information-Based Society, 2004..

[25]  Ioannis Brilakis,et al.  Progressive 3D reconstruction of infrastructure with videogrammetry , 2011 .

[26]  Edwin Olson,et al.  AprilTag: A robust and flexible visual fiducial system , 2011, 2011 IEEE International Conference on Robotics and Automation.

[27]  Seokho Chi,et al.  Automated Object Identification Using Optical Video Cameras on Construction Sites , 2011, Comput. Aided Civ. Infrastructure Eng..

[28]  Leigh Herbert Coaker.  Reflector-less total station measurements and their accuracy, precision and reliability , 2009 .

[29]  George Pavlidis,et al.  Methods for 3D digitization of Cultural Heritage , 2007 .

[30]  Mani Golparvar-Fard,et al.  Grand Challenges in Data and Information Visualization for the Architecture, Engineering, Construction, and Facility Management Industries , 2013 .