Pansharpening Image Fusion Using Cross-Channel Correlation: A Framelet-Based Approach

This paper aims at developing a variational model for pansharpening image fusion. To resolve the ill-posedness of image fusion, we propose a new regularization technique that explores the cross-channel correlation of different spectral channels in wavelet tight frame (or framelet) domain. Besides using a regular cross-channel sparsity prior (Inverse Probl Imaging 7(3):777–794, 2013), the proposed model also makes efficient use of the panchromatic image as a guidance for image feature alignment. An ADMM-based iterative scheme is derived for solving the proposed model, and its performance is tested on several datasets including natural images, aerial images, and real multispectral satellite images. Numerical results suggest that the proposed approach works well on the testing datasets and outperforms some state-of-the-art algorithms in comparison.

[1]  Antoni Buades,et al.  Implementation of Nonlocal Pansharpening Image Fusion , 2014, Image Process. Line.

[2]  Michael Möller,et al.  A Variational Approach for Sharpening High Dimensional Images , 2012, SIAM J. Imaging Sci..

[3]  Aggelos K. Katsaggelos,et al.  A survey of classical methods and new trends in pansharpening of multispectral images , 2011, EURASIP J. Adv. Signal Process..

[4]  Jian-Feng Cai,et al.  A framelet-based image inpainting algorithm , 2008 .

[5]  Chi-Yi Tsai,et al.  Heterogeneity-Projection Hard-Decision Color Interpolation Using Spectral-Spatial Correlation , 2007, IEEE Transactions on Image Processing.

[6]  John van Genderen,et al.  Structuring contemporary remote sensing image fusion , 2015 .

[7]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[8]  Ramakrishna Kakarala,et al.  Adaptive demosaicing with the principal vector method , 2002, IEEE Trans. Consumer Electron..

[9]  Kim-Chuan Toh,et al.  Image Restoration with Mixed or Unknown Noises , 2014, Multiscale Model. Simul..

[10]  Laura Igual,et al.  A Variational Model for P+XS Image Fusion , 2006, International Journal of Computer Vision.

[11]  A. Ron,et al.  Affine Systems inL2(Rd): The Analysis of the Analysis Operator , 1997 .

[12]  Xue-Cheng Tai,et al.  Augmented Lagrangian Method, Dual Methods, and Split Bregman Iteration for ROF, Vectorial TV, and High Order Models , 2010, SIAM J. Imaging Sci..

[13]  Jocelyn Chanussot,et al.  Synthesis of Multispectral Images to High Spatial Resolution: A Critical Review of Fusion Methods Based on Remote Sensing Physics , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[14]  I. Daubechies,et al.  Framelets: MRA-based constructions of wavelet frames☆☆☆ , 2003 .

[15]  Zuowei Shen Affine systems in L 2 ( IR d ) : the analysis of the analysis operator , 1995 .

[16]  Jian-Feng Cai,et al.  Framelet-Based Blind Motion Deblurring From a Single Image , 2012, IEEE Transactions on Image Processing.

[17]  T. Chan,et al.  Wavelet deblurring algorithms for spatially varying blur from high-resolution image reconstruction , 2003 .

[18]  J. E. Bare,et al.  Application of the IHS color transform to the processing of multisensor data and image enhancement , 1982 .

[19]  M. Hestenes Multiplier and gradient methods , 1969 .

[20]  Antoni Buades,et al.  A Nonlocal Variational Model for Pansharpening Image Fusion , 2014, SIAM J. Imaging Sci..

[21]  Bin Dong,et al.  MRA-based wavelet frames and applications , 2013 .

[22]  Zuowei Shen,et al.  Wavelet frame based color image demosaicing , 2013 .

[23]  A. Ron,et al.  Frames and Stable Bases for Shift-Invariant Subspaces of L2(ℝd) , 1995, Canadian Journal of Mathematics.

[24]  S. Mallat A wavelet tour of signal processing , 1998 .

[25]  Lei Zhang,et al.  Color demosaicking via directional linear minimum mean square-error estimation , 2005, IEEE Transactions on Image Processing.

[26]  CHENG TAI,et al.  WAVELET FRAMES BASED MULTI-PHASE IMAGE SEGMENTATION , 2013 .

[27]  Jian-Feng Cai,et al.  Split Bregman Methods and Frame Based Image Restoration , 2009, Multiscale Model. Simul..

[28]  Zuowei Shen,et al.  Wavelet Frame Based Multiphase Image Segmentation , 2013, SIAM J. Imaging Sci..

[29]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[30]  M. J. D. Powell,et al.  A method for nonlinear constraints in minimization problems , 1969 .

[31]  Lei Zhang,et al.  Color demosaicking by local directional interpolation and nonlocal adaptive thresholding , 2011, J. Electronic Imaging.