Object-Oriented Hierarchy Radiation Consistency for Different Temporal and Different Sensor Images

In the paper, we propose a novel object-oriented hierarchy radiation consistency method for dense matching of different temporal and different sensor data in the 3D reconstruction. For different temporal images, our illumination consistency method is proposed to solve both the illumination uniformity for a single image and the relative illumination normalization for image pairs. Especially in the relative illumination normalization step, singular value equalization and linear relationship of the invariant pixels is combined used for the initial global illumination normalization and the object-oriented refined illumination normalization in detail, respectively. For different sensor images, we propose the union group sparse method, which is based on improving the original group sparse model. The different sensor images are set to a similar smoothness level by the same threshold of singular value from the union group matrix. Our method comprehensively considered the influence factors on the dense matching of the different temporal and different sensor stereoscopic image pairs to simultaneously improve the illumination consistency and the smoothness consistency. The radiation consistency experimental results verify the effectiveness and superiority of the proposed method by comparing two other methods. Moreover, in the dense matching experiment of the mixed stereoscopic image pairs, our method has more advantages for objects in the urban area.

[1]  E. Baltsavias,et al.  POTENTIAL OF IKONOS AND QUICKBIRD IMAGERY FOR ACCURATE 3D POINT POSITIONING, ORTHOIMAGE AND DSM GENERATION , 2004 .

[2]  Karen O. Egiazarian,et al.  BM3D Frames and Variational Image Deblurring , 2011, IEEE Transactions on Image Processing.

[3]  Remondino Fabio,et al.  Radiomeric and Geometric Analysis of Worldview-2 Stereo Scenes , 2010 .

[4]  J. Muñoz,et al.  The 3D reconstruction of geological structures based on remote sensing data: example from the Anaran anticline, Lurestan province, Zagros fold and thrust belt, Iran , 2011, Journal of the Geological Society.

[5]  Allan Aasbjerg Nielsen,et al.  The Regularized Iteratively Reweighted MAD Method for Change Detection in Multi- and Hyperspectral Data , 2007, IEEE Transactions on Image Processing.

[6]  Guangming Shi,et al.  Nonlocal Image Restoration With Bilateral Variance Estimation: A Low-Rank Approach , 2013, IEEE Transactions on Image Processing.

[7]  Qiang Chen,et al.  Illumination Normalization Among Multiple Remote-Sensing Images , 2014, IEEE Geoscience and Remote Sensing Letters.

[8]  M. Yuan,et al.  Model selection and estimation in regression with grouped variables , 2006 .

[9]  José A. Sobrino,et al.  Radiometric correction effects in Landsat multi‐date/multi‐sensor change detection studies , 2006 .

[10]  Xuexia Chen,et al.  A simple and effective radiometric correction method to improve landscape change detection across sensors and across time , 2005 .

[11]  Gene H. Golub,et al.  Singular value decomposition and least squares solutions , 1970, Milestones in Matrix Computation.

[12]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[13]  Bo Du,et al.  Automatic Radiometric Normalization for Multitemporal Remote Sensing Imagery With Iterative Slow Feature Analysis , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[14]  E. Baltsavias,et al.  Radiometric and geometric evaluation of IKONOS Geo images and their use for 3D building modelling , 2001 .

[15]  M. Canty,et al.  Automatic radiometric normalization of multitemporal satellite imagery , 2004 .

[16]  J. Muñoz,et al.  3D reconstruction of geological structures based on remote sensing data: example from Anaran anticline (Lurestan province, Zagros fold and thrust belt, Iran) , 2009 .

[17]  Bo Li,et al.  Relative Radiometric Normalization for Multitemporal Remote Sensing Images by Hierarchical Regression , 2016, IEEE Geoscience and Remote Sensing Letters.

[18]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[19]  Francesca Bovolo,et al.  A Context-Sensitive Technique Robust to Registration Noise for Change Detection in VHR Multispectral Images , 2010, IEEE Transactions on Image Processing.

[20]  Dustin G. Mixon,et al.  Images as Occlusions of Textures: A Framework for Segmentation , 2014, IEEE Transactions on Image Processing.

[21]  Liangpei Zhang,et al.  Sparse-based reconstruction of missing information in remote sensing images from spectral/temporal complementary information , 2015 .

[22]  DeLiang Wang,et al.  Image segmentation using local spectral histograms and linear regression , 2012, Pattern Recognit. Lett..

[23]  RADIOMETRIC QUALITY AND DSM GENERATION ANALYSIS OF CARTOSAT-1 STEREO IMAGERY , 2008 .

[24]  Devrim Akca,et al.  Geometric and radiometric investigations of Cartosat-1 data , 2007 .

[25]  Ye Zhang,et al.  Remote sensing image segmentation using local sparse structure constrained latent low rank representation , 2016, Optical Engineering + Applications.

[26]  Manuel A. Aguilar,et al.  Generation and Quality Assessment of Stereo-Extracted DSM From GeoEye-1 and WorldView-2 Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Wen Gao,et al.  Group-Based Sparse Representation for Image Restoration , 2014, IEEE Transactions on Image Processing.