Panchromatic and multispectral images fusion using sparse representation

In this paper, we propose a new pansharpening method based on sparse representation theory to fuse panchromatic and multispectral images. In the proposed method, the high-resolution multispectral image is reconstructed by adding some details to the multispectral image. The details are achieved directly by a proper dictionary which is constructed using a high pass version of the panchromatic image, so-called ‘detail dictionary’, and proper sparse coefficients. The required atoms for generating the details are chosen by two objective functions. One of these functions chooses atoms having high spatial information and the other one selects atoms with high spectral information. Then, the details are made from a linear combination of these atoms. We use both sets of the atoms to increase the spatial details and decrease the spectral distortion. In order to investigate the efficiency of the proposed method, two datasets from Pleiades and WorldView-2 satellites are used. Based on the experimental results, it is found that the proposed method performs better than the state-of-the-art methods in maintaining of spectral information as well as increasing spatial details objectively and visually.

[1]  Mona Ghassemian,et al.  Multi-sensor image fusion using multirate filter banks , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[2]  Hassan Ghassemian,et al.  A review of remote sensing image fusion methods , 2016, Inf. Fusion.

[3]  V. K. Shettigara,et al.  A generalized component substitution technique for spatial enhancement of multispectral images using , 1992 .

[4]  Mark J. Shensa,et al.  The discrete wavelet transform: wedding the a trous and Mallat algorithms , 1992, IEEE Trans. Signal Process..

[5]  Jocelyn Chanussot,et al.  A Critical Comparison Among Pansharpening Algorithms , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[6]  B. Silverman,et al.  The Stationary Wavelet Transform and some Statistical Applications , 1995 .

[7]  Te-Ming Tu,et al.  A new look at IHS-like image fusion methods , 2001, Inf. Fusion.

[8]  H. Ghassemian,et al.  A multi-objective component-substitution-based pansharpening , 2017, 2017 3rd International Conference on Pattern Recognition and Image Analysis (IPRIA).

[9]  Hassan Ghassemian A retina based multi-resolution image-fusion , 2001, IGARSS 2001. Scanning the Present and Resolving the Future. Proceedings. IEEE 2001 International Geoscience and Remote Sensing Symposium (Cat. No.01CH37217).

[10]  Hassan Ghassemian,et al.  Combining the spectral PCA and spatial PCA fusion methods by an optimal filter , 2016, Inf. Fusion.

[11]  Sabalan Daneshvar,et al.  MRI and PET image fusion by combining IHS and retina-inspired models , 2010, Inf. Fusion.

[12]  Hassan Ghassemian,et al.  Remote-sensing image fusion based on curvelets and ICA , 2015 .

[13]  S. Sides,et al.  Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic , 1991 .

[14]  Xavier Otazu,et al.  Multiresolution-based image fusion with additive wavelet decomposition , 1999, IEEE Trans. Geosci. Remote. Sens..

[15]  Sabalan Daneshvar,et al.  MRI and PET images fusion based on human retina model , 2007 .

[16]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[17]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  L. Wald,et al.  Fusion of high spatial and spectral resolution images : The ARSIS concept and its implementation , 2000 .

[19]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[20]  Hassan Ghassemian,et al.  Fusion of MS and PAN Images Preserving Spectral Quality , 2015, IEEE Geoscience and Remote Sensing Letters.

[21]  H. Ghassemian,et al.  Remote sensing image fusion using combining IHS and Curvelet transform , 2012, 6th International Symposium on Telecommunications (IST).

[22]  Bruno Aiazzi,et al.  Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$Pan Data , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Yunhong Wang,et al.  Pan-sharpening based on weighted red black wavelets , 2014, IET Image Process..

[24]  Michael Möller,et al.  An Adaptive IHS Pan-Sharpening Method , 2010, IEEE Geoscience and Remote Sensing Letters.

[25]  W. J. Carper,et al.  The use of intensity-hue-saturation transformations for merging SPOT panchromatic and multispectral image data , 1990 .

[26]  Hassan Ghassemian,et al.  Fusion of remote sensing images based on dictionary learning , 2017, 2017 Iranian Conference on Electrical Engineering (ICEE).