Multiband image fusion using total generalized variation regularization

Multiband image fusion has become a thriving area of research in a number of different fields, such as space robotics, and remote sensing, etc. Many multiband image fusion methods have been proposed for hyperspectral sharpening with panchromatic images, hyperspectral sharpening with multispectral images and panchromatic images, etc. Despite the different motivations, we observe that many existing methods possibly lead to over-smooth regions. In this work, we consider a new problem formulation of two image fusion problems. A novel fusion model with total generalized variation regularization term is proposed, where the fusion process is performed on hybrid gradient domains. The optimization framework of alternating direction multiplier of method is used to solve the resulting problem. In an extensive evaluation, our method outperforms some state-of-the-art methods.

[1]  Jocelyn Chanussot,et al.  A Convex Formulation for Hyperspectral Image Superresolution via Subspace-Based Regularization , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Todd Wittman,et al.  A variational approach to hyperspectral image fusion , 2009, Defense + Commercial Sensing.

[3]  Antonio J. Plaza,et al.  Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  Zhongliang Jing,et al.  Visible and infrared image fusion using ℓ0-generalized total variation model , 2017, Science China Information Sciences.

[5]  Zhongliang Jing,et al.  Non-Cooperative Target Tracking, Fusion and Control , 2018, Information Fusion and Data Science.

[6]  K. C. Ho,et al.  Endmember Variability in Hyperspectral Analysis: Addressing Spectral Variability During Spectral Unmixing , 2014, IEEE Signal Processing Magazine.

[7]  Karl Kunisch,et al.  Total Generalized Variation , 2010, SIAM J. Imaging Sci..

[8]  Lawrence Ong,et al.  The Earth Observing One (EO-1) Satellite Mission: Over a Decade in Space , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[9]  Gang Xiao,et al.  Application to Environmental Surveillance: Dynamic Image Estimation Fusion and Optimal Remote Sensing with Fuzzy Integral , 2015 .

[10]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[11]  Deren Han,et al.  Convergence of ADMM for multi-block nonconvex separable optimization models , 2017 .

[12]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[13]  Subhasis Chaudhuri,et al.  Hyperspectral Image Fusion , 2013, Springer New York.

[14]  José M. Bioucas-Dias,et al.  Alternating direction algorithms for constrained sparse regression: Application to hyperspectral unmixing , 2010, 2010 2nd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[15]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[16]  Simon J. Godsill,et al.  R-FUSE: Robust Fast Fusion of Multiband Images Based on Solving a Sylvester Equation , 2016, IEEE Signal Processing Letters.

[17]  Junfeng Yang,et al.  PanNet: A Deep Network Architecture for Pan-Sharpening , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[18]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.

[19]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[20]  J. Chanussot,et al.  Hyperspectral Remote Sensing Data Analysis and Future Challenges , 2013, IEEE Geoscience and Remote Sensing Magazine.

[21]  Changchang Xi Constructions of derived equivalences for algebras and rings , 2017 .

[22]  A. Goetz,et al.  Atmospheric correction algorithms for hyperspectral remote sensing data of land and ocean , 2009 .

[23]  Andrea Garzelli,et al.  Optimal MMSE Pan Sharpening of Very High Resolution Multispectral Images , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Zhe Zhu,et al.  Object-based cloud and cloud shadow detection in Landsat imagery , 2012 .

[25]  Chulhee Lee,et al.  Fast and Efficient Panchromatic Sharpening , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Bruno Aiazzi,et al.  Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$Pan Data , 2007, IEEE Transactions on Geoscience and Remote Sensing.