Using Orthophoto for Building Boundary Sharpening in the Digital Surface Model

Nowadays dense stereo matching has become one of the dominant tools in 3D reconstruction of urban regions for its low cost and high flexibility in generating dense 3D points. However, state-of-the-art stereo matching algorithms usually apply a semi-global matching (SGM) strategy. This strategy normally assumes the surface geometry pieceswise planar, where a smooth penalty is imposed to deal with non-texture or repeating-texture areas. This on one hand, generates much smooth surface models, while on the other hand, may partially leads to smoothing on depth discontinuities, particularly for fence-shaped regions or densely built areas with narrow streets. To solve this problem, in this work, we propose to use the line segment information extracted from the corresponding orthophoto as a pose-processing tool to sharpen the building boundary of the Digital Surface Model (DSM) generated by SGM. Two methods which are based on graph-cut and plane fitting are proposed and compared. Experimental results on several satellite datasets with ground truth show the robustness and effectiveness of the proposed DSM sharpening method.

[1]  Aaron F. Bobick,et al.  INTILLE Large occlusion stereo , 1999 .

[2]  Aaron F. Bobick,et al.  Large Occlusion Stereo , 1999, International Journal of Computer Vision.

[3]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[4]  Kuk-Jin Yoon,et al.  Confidence-based weighted median filter for effective disparity map refinement , 2015, 2015 12th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[5]  Andreas Geiger,et al.  Efficient Large-Scale Stereo Matching , 2010, ACCV.

[6]  Hui Li,et al.  A Line-Based Adaptive-Weight Matching Algorithm Using Loopy Belief Propagation , 2015 .

[7]  Yu-Jin Zhang,et al.  An O(1) disparity refinement method for stereo matching , 2016, Pattern Recognit..

[8]  Rafael Grompone von Gioi,et al.  LSD: A Fast Line Segment Detector with a False Detection Control , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Xu Huang,et al.  Disparity Refinement in Depth Discontinuity Using Robustly Matched Straight Lines for Digital Surface Model Generation , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[10]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Li Li,et al.  CannyLines: A parameter-free line segment detector , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[12]  O. Tournaire,et al.  Extracting polygonal building footprints from digital surface models: A fully-automatic global optimization framework , 2013 .

[13]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..