Quality assessment of pan-sharpening methods in high-resolution satellite images using radiometric and geometric index

This paper focuses on quality assessment of fusion of multispectral (MS) images with high-resolution panchromatic (Pan) images. Since most existing quality assessments take the entire image into account simultaneously and generate some uncertainties, a novel and rather objective quality index has been proposed for image fusion. The index is comprised of geometric and radiometric parts. Both geometric and radiometric measurements are calculated using morphological algorithm applied on an edge image to create a mask which is used to separate high-frequency regions from low-frequency ones. The accuracy assessment is made using common existing criteria on geometric and radiometric segments, and then a weighted sum is calculated to generate radiometric and geometric index (RG index). Several commonly used fusion algorithms such as IHS, modified IHS, PCA, Gram-Schmidt, Brovey Transform, Ehlers, High-Pass Modulation, Schowengerdt and UNB were applied on a very high-resolution GeoEye-1 and WorldView-2 images. In order to perform quality assessment, methods of Spectral Angle Mapper, Structural SIMilarity, correlation coefficients and universal quality index for which the normalization were possible (for comparison purposes) were used. The utilized RG index showed that by separating spectral and spatial component quality measurement, the quality assessment is made on fused images in a more distinct, explicit, accurate and objective manner.

[1]  Te-Ming Tu,et al.  A new look at IHS-like image fusion methods , 2001, Inf. Fusion.

[2]  Re Gonzalez,et al.  R.C. Eddins, Digital image processing using MATLAB, vol. Gatesmark Publishing Knoxville , 2009 .

[3]  Rafael C. González,et al.  Digital image processing using MATLAB , 2006 .

[4]  J. Nichol,et al.  Satellite remote sensing for detailed landslide inventories using change detection and image fusion , 2005 .

[5]  Biswajeet Pradhan,et al.  Fusion of Airborne LiDAR With Multispectral SPOT 5 Image for Enhancement of Feature Extraction Using Dempster–Shafer Theory , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[7]  Alexander Toet,et al.  Perceptual evaluation of different image fusion schemes , 2003 .

[8]  Peijun Du,et al.  Information fusion techniques for change detection from multi-temporal remote sensing images , 2013, Inf. Fusion.

[9]  Mazlan Hashim,et al.  Comparative analysis of product-level fusion, support vector machine, and artificial neural network approaches for land cover mapping , 2015, Arabian Journal of Geosciences.

[10]  F. Samadzadegan,et al.  An object-level strategy for pan-sharpening quality assessment of high-resolution satellite imagery , 2014 .

[11]  Mazlan Hashim,et al.  Using advanced image fusion techniques to increase the usability of Razaksat data for map updating in the tropics , 2013 .

[12]  Qingquan Li,et al.  A comparative analysis of image fusion methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Robert A. Schowengerdt,et al.  Remote sensing, models, and methods for image processing , 1997 .

[14]  Gh. S. El-Tawel,et al.  An integrated scheme to improve pan-sharpening visual quality of satellite images , 2015 .

[15]  Luciano Alparone,et al.  A global quality measurement of pan-sharpened multispectral imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[16]  Christine Pohl,et al.  Multisensor image fusion in remote sensing: concepts, methods and applications , 1998 .

[17]  Manfred Ehlers,et al.  Multisensor image fusion techniques in remote sensing , 1991 .

[18]  Te-Ming Tu,et al.  A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[19]  Luciano Alparone,et al.  Landsat ETM+ and SAR image fusion based on generalized intensity Modulation , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Yun Zhang,et al.  METHODS FOR IMAGE FUSION QUALITY ASSESSMENT - A REVIEW, COMPARISON AND ANALYSIS , 2008 .

[21]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[22]  Jocelyn Chanussot,et al.  Pansharpening Quality Assessment Using the Modulation Transfer Functions of Instruments , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Mahdi Hasanlou,et al.  CLASSIFIER FUSION OF HIGH-RESOLUTION OPTICAL AND SYNTHETIC APERTURE RADAR (SAR) SATELLITE IMAGERY FOR CLASSIFICATION IN URBAN AREA , 2014 .

[24]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Yuri Zhang,et al.  A new automatic approach for effectively fusing Landsat 7 as well as IKONOS images , 2002, IEEE International Geoscience and Remote Sensing Symposium.

[26]  Aniruddha Ghosh,et al.  Assessment of pan-sharpened very high-resolution WorldView-2 images , 2013 .