On the use of the SOS metaheuristic algorithm in hybrid image fusion methods to achieve optimum spectral fidelity

ABSTRACT Image fusion aims to spatially enhance a low-resolution multispectral (MS) image by utilizing a high-resolution panchromatic (Pan) band. Various image fusion methodologies have been proposed with the aim to improve the spatial detail quality without deteriorating the colour content of the input MS image. Previous studies revealed the fact that there is no such thing as ‘the best image fusion method’ since all fusion methods cause either spectral distortion or spatial detail loss to some extent, which motivates the researchers to develop more advanced methods to keep the colour content while increasing the spatial detail quality. This study proposed to use the Symbiotic Organisms Search (SOS) metaheuristic algorithm in hybrid image fusion methods to achieve the optimum colour quality in the fused images. The SOS algorithm was used in two hybrid fusion approaches, one including the Intensity-Hue-Saturation (IHS) and Discrete Wavelet Transform (DWT) methods and the other one including the IHS and Discrete Wavelet Frame Transform (DWFT) methods. The results of the proposed methods were qualitatively and quantitatively compared in three test sites against those of eighteen widely-used image fusion methods. It was concluded that the proposed methods led to superior colour quality with both singlesensor and multisensor input images, regardless of the spatial resolution difference between the input images. The proposed methods were also found to be very successful in sharpening the images, despite the fact that their main purpose was to keep the colour content as much as possible.

[1]  Christine Pohl,et al.  Multisensor image fusion in remote sensing: concepts, methods and applications , 1998 .

[2]  Thierry Ranchin,et al.  Liu 'Smoothing filter-based intensity modulation: A spectral preserve image fusion technique for improving spatial details' , 2002 .

[3]  C. Padwick,et al.  WORLDVIEW-2 PAN-SHARPENING , 2010 .

[4]  W. A. Hallada,et al.  Image sharpening for mixed spatial and spectral resolution satellite systems , 1983 .

[5]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[6]  Xavier Otazu,et al.  Multiresolution-based image fusion with additive wavelet decomposition , 1999, IEEE Trans. Geosci. Remote. Sens..

[7]  Luciano Alparone,et al.  MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery , 2006 .

[8]  Wei Huang,et al.  Fusion of satellite images in urban area: Assessing the quality of resulting images , 2010, 2010 18th International Conference on Geoinformatics.

[9]  Yaonan Wang,et al.  Using the discrete wavelet frame transform to merge Landsat TM and SPOT panchromatic images , 2002, Inf. Fusion.

[10]  Min-Yuan Cheng,et al.  Symbiotic Organisms Search: A new metaheuristic optimization algorithm , 2014 .

[11]  Oguz Gungor.  Multi sensor multi resolution image fusion , 2008 .

[12]  Jocelyn Chanussot,et al.  Contrast and Error-Based Fusion Schemes for Multispectral Image Pansharpening , 2014, IEEE Geoscience and Remote Sensing Letters.

[13]  Zhou Wang,et al.  Multi-scale structural similarity for image quality assessment , 2003 .

[14]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[15]  Chiman Kwan,et al.  Blind Quality Assessment of Fused WorldView-3 Images by Using the Combinations of Pansharpening and Hypersharpening Paradigms , 2017, IEEE Geoscience and Remote Sensing Letters.

[16]  J. E. Bare,et al.  Application of the IHS color transform to the processing of multisensor data and image enhancement , 1982 .

[17]  S. Klonus,et al.  Image Fusion Using the Ehlers Spectral Characteristics Preservation Algorithm , 2007 .

[18]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[19]  F. Nencini,et al.  Fusion of Panchromatic and Multispectral Images by Genetic Algorithms , 2006, 2006 IEEE International Symposium on Geoscience and Remote Sensing.

[20]  Jiao Jiao,et al.  Fusion of Panchromatic and Multispectral Images via Morphological Operator and Improved PCNN in Mixed Multiscale Domain , 2018, 2018 10th IAPR Workshop on Pattern Recognition in Remote Sensing (PRRS).

[21]  Xavier Otazu,et al.  Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Fabrice Muller,et al.  Adaptive intensity matching filters: a new tool for multi-resolution data fusion , 1998 .

[23]  T. Ranchin,et al.  Liu 'Smoothing filter-based intensity modulation: A spectral preserve image fusion technique for improving spatial details' , 2002 .

[24]  Zhou Wang,et al.  Information Content Weighting for Perceptual Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[25]  Bin Chen,et al.  Nearest-neighbor diffusion-based pan-sharpening algorithm for spectral images , 2014, Optical Engineering.

[26]  Min-Yuan Cheng,et al.  A novel Multiple Objective Symbiotic Organisms Search (MOSOS) for time-cost-labor utilization tradeoff problem , 2016, Knowl. Based Syst..

[27]  Lucien Wald,et al.  Quality of high resolution synthesised images: Is there a simple criterion ? , 2000 .

[28]  Mohiy Hadhoud,et al.  Image Super-Resolution and Applications , 2012 .

[29]  P. Chavez,et al.  Extracting spectral contrast in landsat thematic mapper image data using selective principal component analysis , 1989 .

[30]  Manfred Ehlers.  Spectral characteristics preserving image fusion based on Fourier domain filtering , 2004, SPIE Remote Sensing.

[31]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[32]  Christine Pohl,et al.  Remote Sensing Image Fusion: A Practical Guide , 2016 .

[33]  M. M. Strait,et al.  Evaluation of pan-sharpening methods , 2008 .

[34]  Peyman Kabiri,et al.  New intensity-hue-saturation pan-sharpening method based on texture analysis and genetic algorithm-adaption , 2014 .

[35]  Maryam Imani.  Band Dependent Spatial Details Injection Based on Collaborative Representation for Pansharpening , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[36]  Oguz Gungor,et al.  Genetic algorithm-based synthetic variable ratio image fusion , 2019 .

[37]  Hassan Ghassemian,et al.  A review of remote sensing image fusion methods , 2016, Inf. Fusion.

[38]  Jocelyn Chanussot,et al.  Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[39]  J. Zhou,et al.  A wavelet transform method to merge Landsat TM and SPOT panchromatic data , 1998 .

[40]  Yun Zhang,et al.  An IHS and wavelet integrated approach to improve pan-sharpening visual quality of natural colour IKONOS and QuickBird images , 2005, Inf. Fusion.

[41]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[42]  J. G. Liu,et al.  Smoothing Filter-based Intensity Modulation : a spectral preserve image fusion technique for improving spatial details , 2001 .

[43]  J. Schott,et al.  Resolution enhancement of multispectral image data to improve classification accuracy , 1993 .

[44]  Oguz Gungor,et al.  Determining the optimum image fusion method for better interpretation of the surface of the Earth , 2016 .

[45]  Oguz Gungor,et al.  Fusion of very high-resolution UAV images with criteria-based image fusion algorithm , 2015, Arabian Journal of Geosciences.

[46]  Andrea Garzelli,et al.  Interband structure modeling for Pan-sharpening of very high-resolution multispectral images , 2005, Inf. Fusion.

[47]  Yun Zhang,et al.  Understanding image fusion , 2004 .

[48]  L. Wald,et al.  Fusion of high spatial and spectral resolution images : The ARSIS concept and its implementation , 2000 .

[49]  Mehdi Mokhtarzade,et al.  A NOVEL IHS-GA FUSION METHOD BASED ON ENHANCEMENT VEGETATED AREA , 2015 .

[50]  Y. Zhang,et al.  A new merging method and its spectral and spatial effects , 1999 .

[51]  Andrea Garzelli,et al.  PAN‐sharpening of very high resolution multispectral images using genetic algorithms , 2006 .

[52]  Manfred Ehlers,et al.  Performance of evaluation methods in image fusion , 2009, 2009 12th International Conference on Information Fusion.

[53]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.