A novel approach to generating DSM from high-resolution UAV images

In the past few years, unmanned aerial vehicles (UAVs) demonstrated their great potential for photogrammetric measurements in a lot of application fields because its less expensive, safer and higher resolution images. Nevertheless, their images are often affected by large rotation, big view-point change and small overlaps. In this paper, we present a novel approach for reliable Digital Surface Models (DSM) generation, which is designed to operate on high-resolution, wide-baseline UAV image sets and compute dense 3D point clouds efficiently. It is implemented as a procedure including the four steps of match, expand, filter and reconstruction, starting from a sparse set of matched difference-of-Gaussian (DoG) keypoints, forming a triangulation on it, then expanding per-pixel under local parallax continuity, using visibility constraints to filter false matches, finally generating the DSM. Experiments are conducted to demonstrate the effectiveness and accuracy of our approach and to show that state-of-the-art performance can be achieved with significant acceleration.

[1]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[2]  Radim Sára,et al.  Efficient Sampling of Disparity Space for Fast And Accurate Matching , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[4]  Aaron F. Bobick,et al.  Large Occlusion Stereo , 1999, International Journal of Computer Vision.

[5]  Qingxiong Yang,et al.  A non-local cost aggregation method for stereo matching , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Michael M. Kazhdan,et al.  Screened poisson surface reconstruction , 2013, TOGS.

[7]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[8]  Nanning Zheng,et al.  Stereo Matching Using Belief Propagation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Vladimir Kolmogorov,et al.  Computing visual correspondence with occlusions using graph cuts , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[10]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[11]  Nanning Zheng,et al.  Stereo Matching Using Belief Propagation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  P. Milano,et al.  FULLY AUTOMATIC UAV IMAGE-BASED SENSOR ORIENTATION , 2010 .

[13]  Long Quan,et al.  Match Propagation for Image-Based Modeling and Rendering , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Olga Veksler,et al.  Stereo correspondence by dynamic programming on a tree , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[16]  Tomás Pajdla,et al.  Multi-view reconstruction preserving weakly-supported surfaces , 2011, CVPR 2011.

[17]  M. Downey,et al.  SEMI-GLOBAL MATCHING : AN ALTERNATIVE TO LIDAR FOR DSM GENERATION ? , 2010 .

[18]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[19]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Pedro F. Felzenszwalb,et al.  Efficient belief propagation for early vision , 2004, CVPR 2004.

[21]  Kim Bong-Gyum,et al.  Stereo Matching using Belief Propagation with Line Grouping , 2005 .