Refining building facade models with images

Laser data and optical data have a complementary nature to 3D features’ extraction. Building reconstruction by fusion of the two data sources can reduce the complexity of approaches from either side. In this paper we present a model refinement method, which uses the strong lines extracted from close-range images to improve building models reconstructed from terrestrial laser point clouds. First, model edges are projected from model space to image space. Then significant line features are extracted from an image with Canny edge detector and Hough transformation. Each model edge is then compared with its neighboring image lines to determine the best match. Finally the model edges are updated according to their corresponding image lines. The refinement process not only fixes certain geometry errors of the original models, but also adapts the models to the image data, so that more accurate texturing is achieved.

[1]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Roberto Cipolla,et al.  Combining single view recognition and multiple view stereo for architectural scenes , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[3]  F. A. Heuvel,et al.  CALIBRATION OF FISHEYE CAMERA SYSTEMS AND THE REDUCTION OF CHROMATIC ABERRATION , 2006 .

[4]  Jan-Michael Frahm,et al.  Detailed Real-Time Urban 3D Reconstruction from Video , 2007, International Journal of Computer Vision.

[5]  Ieee Xplore,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Information for Authors , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  C. Brenner Building reconstruction from images and laser scanning , 2005 .

[7]  Konrad Schindler,et al.  A model-based method for building reconstruction , 2003, First IEEE International Workshop on Higher-Level Knowledge in 3D Modeling and Motion Analysis, 2003. HLK 2003..

[8]  Christian Früh,et al.  Data Processing Algorithms for Generating Textured 3D Building Facade Meshes from Laser Scans and Camera Images , 2005, International Journal of Computer Vision.

[9]  H. Maas,et al.  GEOMETRIC MODELLING AND CALIBRATION OF A HIGH RESOLUTION PANORAMIC CAMERA , 2003 .

[10]  George Vosselman,et al.  Knowledge based reconstruction of building models from terrestrial laser scanning data , 2009 .

[11]  George Vosselman,et al.  Fusion of laser scanning data, maps, and aerial photographs for building reconstruction , 2002, IEEE International Geoscience and Remote Sensing Symposium.

[12]  Christian Früh,et al.  Automated texture mapping of 3D city models with oblique aerial imagery , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..