A Variational Approach for Pan-Sharpening

Pan-sharpening is a process of acquiring a high resolution multispectral (MS) image by combining a low resolution MS image with a corresponding high resolution panchromatic (PAN) image. In this paper, we propose a new variational pan-sharpening method based on three basic assumptions: 1) the gradient of PAN image could be a linear combination of those of the pan-sharpened image bands; 2) the upsampled low resolution MS image could be a degraded form of the pan-sharpened image; and 3) the gradient in the spectrum direction of pan-sharpened image should be approximated to those of the upsampled low resolution MS image. An energy functional, whose minimizer is related to the best pan-sharpened result, is built based on these assumptions. We discuss the existence of minimizer of our energy and describe the numerical procedure based on the split Bregman algorithm. To verify the effectiveness of our method, we qualitatively and quantitatively compare it with some state-of-the-art schemes using QuickBird and IKONOS data. Particularly, we classify the existing quantitative measures into four categories and choose two representatives in each category for more reasonable quantitative evaluation. The results demonstrate the effectiveness and stability of our method in terms of the related evaluation benchmarks. Besides, the computation efficiency comparison with other variational methods also shows that our method is remarkable.

[1]  S. Sides,et al.  Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic , 1991 .

[2]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[3]  I. Parcharidis,et al.  Landsat TM and ERS data fusion: a statistical approach evaluation for four different methods , 2000, IGARSS 2000. IEEE 2000 International Geoscience and Remote Sensing Symposium. Taking the Pulse of the Planet: The Role of Remote Sensing in Managing the Environment. Proceedings (Cat. No.00CH37120).

[4]  K. Nikolakopoulos.  Comparison of Nine Fusion Techniques for Very High Resolution Data , 2008 .

[5]  Roger L. King,et al.  A wavelet based algorithm for pan sharpening Landsat 7 imagery , 2001, IGARSS 2001. Scanning the Present and Resolving the Future. Proceedings. IEEE 2001 International Geoscience and Remote Sensing Symposium (Cat. No.01CH37217).

[6]  Gemma Piella,et al.  Image Fusion for Enhanced Visualization: A Variational Approach , 2009, International Journal of Computer Vision.

[7]  Dani Lischinski,et al.  A Closed-Form Solution to Natural Image Matting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  L. Wald,et al.  Fusion of high spatial and spectral resolution images : The ARSIS concept and its implementation , 2000 .

[9]  W. J. Carper,et al.  The use of intensity-hue-saturation transformations for merging SPOT panchromatic and multispectral image data , 1990 .

[10]  J. Zhou,et al.  A wavelet transform method to merge Landsat TM and SPOT panchromatic data , 1998 .

[11]  Nicolas H. Younan,et al.  Quality analysis of pansharpened images , 2004, IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium.

[12]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[13]  Xue-Cheng Tai,et al.  Augmented Lagrangian Method, Dual Methods and Split Bregman Iteration for ROF Model , 2009, SSVM.

[14]  G. Aubert,et al.  Mathematical Problems in Image Processing: Partial Differential Equations and the Calculus of Variations (Applied Mathematical Sciences) , 2006 .

[15]  Guillermo Sapiro,et al.  Geometric Partial Differential Equations and Image Analysis: Introduction , 2001 .

[16]  Xavier Otazu,et al.  Multiresolution-based image fusion with additive wavelet decomposition , 1999, IEEE Trans. Geosci. Remote. Sens..

[17]  Zhou Wang,et al.  Image Quality Assessment: From Error Measurement to Structural Similarity , 2004 .

[18]  Shmuel Peleg,et al.  Multi-sensor super-resolution , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[19]  Te-Ming Tu,et al.  A new look at IHS-like image fusion methods , 2001, Inf. Fusion.

[20]  Michael Möller,et al.  A Variational Approach for Sharpening High Dimensional Images , 2012, SIAM J. Imaging Sci..

[21]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[22]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[23]  Laura Igual,et al.  A Variational Model for P+XS Image Fusion , 2006, International Journal of Computer Vision.

[24]  Chein-I. Chang.  Spectral information divergence for hyperspectral image analysis , 1999, IEEE 1999 International Geoscience and Remote Sensing Symposium. IGARSS'99 (Cat. No.99CH36293).

[25]  Tony F. Chan,et al.  Variational PDE models in image processing , 2002 .

[26]  Wenzhong Shi,et al.  Multisource Image Fusion Method Using Support Value Transform , 2007, IEEE Transactions on Image Processing.

[27]  Pierre Kornprobst,et al.  Mathematical problems in image processing - partial differential equations and the calculus of variations , 2010, Applied mathematical sciences.

[28]  Myungjin Choi,et al.  A new intensity-hue-saturation fusion approach to image fusion with a tradeoff parameter , 2006, IEEE Trans. Geosci. Remote. Sens..

[29]  Yann Gousseau,et al.  Are Natural Images of Bounded Variation? , 2001, SIAM J. Math. Anal..

[30]  Henk J. A. M. Heijmans,et al.  A new quality metric for image fusion , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[31]  L. Ambrosio,et al.  Functions of Bounded Variation and Free Discontinuity Problems , 2000 .

[32]  R. Maruthi,et al.  MULTI FOCUS IMAGE FUSION BASED ON THE INFORMATION LEVEL IN THE REGIONS OF THE IMAGES , 2007 .

[33]  M. Nikolova.  An Algorithm for Total Variation Minimization and Applications , 2004 .

[34]  Michael Möller,et al.  An Adaptive IHS Pan-Sharpening Method , 2010, IEEE Geoscience and Remote Sensing Letters.

[35]  Vladimir S. Petrovic,et al.  Subjective tests for image fusion evaluation and objective metric validation , 2007, Inf. Fusion.

[36]  Jocelyn Chanussot,et al.  Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Cedric Nishan Canagarajah,et al.  Pixel- and region-based image fusion with complex wavelets , 2007, Inf. Fusion.

[38]  Wei Liu,et al.  Image Fusion Based on PCA and Undecimated Discrete Wavelet Transform , 2006, ICONIP.

[39]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[40]  M. M. Strait,et al.  Evaluation of pan-sharpening methods , 2008 .

[41]  Shutao Li,et al.  A New Pan-Sharpening Method Using a Compressed Sensing Technique , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[42]  C. Padwick,et al.  WORLDVIEW-2 PAN-SHARPENING , 2010 .

[43]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[44]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.