Automatic Update and Completion of Occluded Regions for Accurate 3D Urban Cartography by combining Multiple Views and Multiple Passages

Handling occlusions is one of the more difficult challenges faced today in urban landscape analysis and cartography. In this paper, we successfully address this problem by using a new method in which multiple views and multiple sessions or passages are used to complete occluded regions in a 3D cartographic map. Two 3D point clouds, from different viewing angles, obtained in each passage are first classified into two main object classes: Permanent and Temporary (which contains both Temporarily static and Mobile objects) using inference based on basic reasoning. All these Temporary objects, considered as occluding objects, are removed from the scene leaving behind two perforated 3D point clouds of the cartography. These two perforated point clouds from the same passage are then combined together to fill in some of the holes and form a unified perforated 3D point cloud of the cartography. This unified perforated 3D point cloud is then updated by similar subsequent perforated point clouds, obtained on different days and hours of the day, filling in the remaining holes and completing the missing features/regions of the urban cartography. This automatic method ensures that the resulting 3D point cloud of the cartography is most accurate containing only the exact and actual permanent features/regions. Special update and reset functions are added to increase the robustness of the method. The method is evaluated on a standard data set to demonstrate its efficacy and prowess.

[1]  Christian Früh,et al.  Automated texture mapping of 3D city models with oblique aerial imagery , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[2]  Vladimir Vezhnevets,et al.  Automatic building texture completion , 2007 .

[3]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[4]  Daniel Cohen-Or,et al.  2D-3D fusion for layer decomposition of urban facades , 2011, 2011 International Conference on Computer Vision.

[5]  Ahmad Kamal Aijazi,et al.  Classification of 3D Urban Scenes - A Voxel based Approach , 2012, ICPRAM.

[6]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  N. Haala,et al.  COMBINED FEATURE EXTRACTION FOR FAÇADE RECONSTRUCTION , 2007 .

[8]  George Hripcsak,et al.  Technical Brief: Agreement, the F-Measure, and Reliability in Information Retrieval , 2005, J. Am. Medical Informatics Assoc..

[9]  Ruigang Yang,et al.  Stereoscopic inpainting: Joint color and depth completion from stereo images , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  S. Bénitez,et al.  AUTOMATIC PRODUCTION OF OCCLUSION-FREE RECTIFIED FAÇADE TEXTURES USING VEHICLE-BASED IMAGERY , 2010 .

[11]  Jianxiong Xiao,et al.  Image-based street-side city modeling , 2009, ACM Trans. Graph..

[12]  Luc Van Gool,et al.  Automatic Occlusion Removal from Facades for 3D Urban Reconstruction , 2011, ACIVS.

[13]  Francis Schmitt,et al.  Multi-view scans alignment for 3D spherical mosaicing in large-scale unstructured environments , 2010, Comput. Vis. Image Underst..