Optimal Illumination and Color Consistency for Optical Remote-Sensing Image Mosaicking

Illumination and color consistency are very important for optical remote-sensing image mosaicking. In this letter, we propose a simple but effective technique that simultaneously performs image illumination and color correction for multiview images. In this framework, we first present an uneven illumination removal algorithm based on bright channel prior, which guarantees the illumination consistency inside a single image. We then adapt a pairwise color-correction method to coarsely align the color tone between source and reference images. In this stage, we give a new single-image quality metric which combines brightness deviation, color cast, and entropy together for automatic reference-image selection. Finally, we perform a least-squares adjustment (LSA) procedure to obtain optimal illumination and color consistency among multiview images. In detail, we first perform a pairwise image matching by using SIFT algorithm; once sparse local patch correspondences obtained, the illumination and color relationship between images can be established based on a global gamma correction model; the illumination and color errors can then be minimized by LSA. Extensive experiments on both challenging synthetic and real optical remote-sensing image data sets show that it significantly outperforms the compared state-of-the-art approaches. All the source code and data sets used in this letter are made public.11https://sites.google.com/site/jiayuanli2016whu/home

[1]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[2]  Kenji Yamamoto,et al.  Color correction for multi-view video using energy minimization of view networks , 2008, Int. J. Autom. Comput..

[3]  Michael Elad,et al.  A Variational Framework for Retinex , 2002, IS&T/SPIE Electronic Imaging.

[4]  Chi-Keung Tang,et al.  Local color transfer via probabilistic segmentation by expectation-maximization , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[5]  Huanfeng Shen,et al.  A robust mosaicking procedure for high spatial resolution remote sensing images , 2015 .

[6]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[7]  Ming-Jung Seow,et al.  Homomorphic processing system and ratio rule for color image enhancement , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[8]  Gui Yun Tian,et al.  Colour correction for panoramic imaging , 2002, Proceedings Sixth International Conference on Information Visualisation.

[9]  Hany Farid,et al.  Blind inverse gamma correction , 2001, IEEE Trans. Image Process..

[10]  Pan Jun A Method of Removing the Uneven Illumination for Digital Aerial Image , 2004 .

[11]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[12]  Wei Xu,et al.  Performance evaluation of color correction approaches for automatic multi-view image and video stitching , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Qingwu Hu,et al.  Robust Feature Matching for Remote Sensing Image Registration Based on $L_{q}$ -Estimator , 2016, IEEE Geoscience and Remote Sensing Letters.

[14]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[15]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[16]  Zia-ur Rahman,et al.  Properties and performance of a center/surround retinex , 1997, IEEE Trans. Image Process..

[17]  Yong Du,et al.  Radiometric normalization, compositing, and quality control for satellite high resolution image mosaics over large areas , 2001, IEEE Trans. Geosci. Remote. Sens..

[18]  Gregory Dudek,et al.  Image stitching with dynamic elements , 2009, Image Vis. Comput..

[19]  Liangpei Zhang,et al.  A Perceptually Inspired Variational Method for the Uneven Intensity Correction of Remote Sensing Images , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Qingwu Hu,et al.  Joint Model and Observation Cues for Single-Image Shadow Detection , 2016, Remote. Sens..