Automated 3D recovery from very high resolution multi-view satellite images

This paper presents an automated pipeline for processing multi-view satellite images to 3D digital surface models (DSM). The proposed pipeline performs automated geo-referencing and generates high-quality densely matched point clouds. In particular, a novel approach is developed that fuses multiple depth maps derived by stereo matching to generate high-quality 3D maps. By learning critical configurations of stereo pairs from sample LiDAR data, we rank the image pairs based on the proximity of the results to the sample data. Multiple depth maps derived from individual image pairs are fused with an adaptive 3D median filter that considers the image spectral similarities. We demonstrate that the proposed adaptive median filter generally delivers better results in general as compared to normal median filter, and achieved an accuracy of improvement of 0.36 meters RMSE in the best case. Results and analysis are introduced in detail.

[1]  Jiaojiao Tian,et al.  3 D change detection – approaches and applications , 2016 .

[2]  P. Reinartz,et al.  Semiglobal Matching Results on the ISPRS Stereo Matching Benchmark , 2012 .

[3]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  M. Pierrot Deseilligny,et al.  APERO, AN OPEN SOURCE BUNDLE ADJUSMENT SOFTWARE FOR AUTOMATIC CALIBRATION AND ORIENTATION OF SET OF IMAGES , 2012 .

[5]  Vladimir Kolmogorov,et al.  Computing visual correspondence with occlusions using graph cuts , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[6]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[7]  Jianguo Liu,et al.  Precise Subpixel Disparity Measurement From Very Narrow Baseline Stereo , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Rongjun Qin,et al.  RPC STEREO PROCESSOR (RSP) – A SOFTWARE PACKAGE FOR DIGITAL SURFACE MODEL AND ORTHOPHOTO GENERATION FROM SATELLITE STEREO IMAGERY , 2016 .

[9]  H. Hirschmüller Accurate and Efficient Stereo Processing by Semi-Global Matching and Mutual Information , 2005, CVPR.

[10]  Mathias Rothermel,et al.  DENSE MULTIPLE STEREO MATCHING OF HIGHLY OVERLAPPING UAV IMAGERY , 2012 .

[11]  Emmanuel P. Baltsavias,et al.  Multiphoto geometrically constrained matching , 1991 .

[12]  Michael Eineder,et al.  High Resolution 3D Earth Observation Data Analysis for Safeguards Activities , 2014 .

[13]  E. Baltsavias,et al.  Assessing changes of forest area and shrub encroachment in a mire ecosystem using digital surface models and CIR aerial images , 2008 .

[14]  Mathias Schneider,et al.  The Fully Automatic Optical Processing System CATENA at DLR , 2013 .

[15]  M. Downey,et al.  SEMI-GLOBAL MATCHING : AN ALTERNATIVE TO LIDAR FOR DSM GENERATION ? , 2010 .

[16]  Marc Bosch,et al.  A multiple view stereo benchmark for satellite imagery , 2016, 2016 IEEE Applied Imagery Pattern Recognition Workshop (AIPR).

[17]  Fabio Remondino,et al.  State of the art in high density image matching , 2014 .

[18]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[19]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..