Integration of Satellite Data with High Resolution Ratio: Improvement of Spectral Quality with Preserving Spatial Details

Commonly used image fusion techniques generally produce good results for images obtained from the same sensor, with a standard ratio of spatial resolution (1:4). However, an atypical high ratio of resolution reduces the effectiveness of fusion methods resulting in a decrease in the spectral or spatial quality of the sharpened image. An important issue is the development of a method that allows for maintaining simultaneous high spatial and spectral quality. The authors propose to strengthen the pan-sharpening methods through prior modification of the panchromatic image. Local statistics of the differences between the original panchromatic image and the intensity of the multispectral image are used to detect spatial details. The Euler’s number and the distance of each pixel from the nearest pixel classified as a spatial detail determine the weight of the information collected from each integrated image. The research was carried out for several pan-sharpening methods and for data sets with different levels of spectral matching. The proposed solution allows for a greater improvement in the quality of spectral fusion, while being able to identify the same spatial details for most pan-sharpening methods and is mainly dedicated to Intensity-Hue-Saturation based methods for which the following improvements in spectral quality were achieved: about 30% for the urbanized area and about 15% for the non-urbanized area.

[1]  Aggelos K. Katsaggelos,et al.  A survey of classical methods and new trends in pansharpening of multispectral images , 2011, EURASIP J. Adv. Signal Process..

[2]  Veronika Kopacková,et al.  Testing a Modified PCA-Based Sharpening Approach for Image Fusion , 2016, Remote. Sens..

[3]  Naoto Yokoya,et al.  Hyperspectral Pansharpening: A Review , 2015, IEEE Geoscience and Remote Sensing Magazine.

[4]  Stefano Baronti,et al.  On the Use of the Expanded Image in Quality Assessment of Pansharpened Images , 2018, IEEE Geoscience and Remote Sensing Letters.

[5]  S. Mikrut Classical Photogrammetry and Uav - Selected Ascpects , 2016 .

[6]  W. Hargrove,et al.  Photogrammetric Engineering & Remote Sensing , 2022 .

[7]  Yun Zhang,et al.  A review and comparison of commercially available pan-sharpening techniques for high resolution satellite image fusion , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[8]  Luciano Alparone,et al.  A global quality measurement of pan-sharpened multispectral imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[9]  Anna Fryskowska,et al.  SOME ASPECTS OF SATELLITE IMAGERY INTEGRATION FROM EROS B AND LANDSAT 8 , 2016 .

[10]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[11]  Ilan Schvartzman,et al.  Combining TerraSAR-X and Landsat Images for Emergency Response in Urban Environments , 2018, Remote. Sens..

[12]  Antonio Soriano,et al.  Fusion of Scores in a Detection Context Based on Alpha Integration , 2015, Neural Computation.

[13]  Guoman Huang,et al.  A Parallel Computing Paradigm for Pan-Sharpening Algorithms of Remotely Sensed Images on a Multi-Core Computer , 2014, Remote. Sens..

[14]  Johannes R. Sveinsson,et al.  A New Pansharpening Algorithm Based on Total Variation , 2014, IEEE Geoscience and Remote Sensing Letters.

[15]  Mingliang Xu,et al.  High quality multi-spectral and panchromatic image fusion technologies based on Curvelet transform , 2015, Neurocomputing.

[16]  Jocelyn Chanussot,et al.  A Critical Comparison Among Pansharpening Algorithms , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[17]  E. Ghoneim,et al.  DEM‐optical‐radar data integration for palaeohydrological mapping in the northern Darfur, Sudan: implication for groundwater exploration , 2007 .

[18]  Gintautas Palubinskas,et al.  Model-based view at multi-resolution image fusion methods and quality assessment measures , 2016 .

[19]  M. Noviello,et al.  Combined application of pansharpening and enhancement methods to improve archaeological cropmark visibility and identification in QuickBird imagery: two case studies from Apulia, Southern Italy , 2013 .

[20]  Javier Mateos,et al.  Multispectral Image Pansharpening Based on the Contourlet Transform , 2010 .

[21]  Damian Wierzbicki,et al.  Image data fusion for flood plain mapping , 2014 .

[22]  Leiguang Wang,et al.  Guided Image Filtering-Based Pan-Sharpening Method: A Case Study of GaoFen-2 Imagery , 2017, ISPRS Int. J. Geo Inf..

[23]  Te-Ming Tu,et al.  Adjustable intensity-hue-saturation and Brovey transform fusion technique for IKONOS/ QuickBird imagery , 2005 .

[24]  Firouz Abdullah Al-Wassai,et al.  The IHS Transformations Based Image Fusion , 2011, ArXiv.

[25]  D. Holcomb,et al.  Optimizing the High-Pass Filter Addition Technique for Image Fusion , 2007 .

[26]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[27]  Jocelyn Chanussot,et al.  Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Agnieszka Jenerowicz,et al.  The pan-sharpening of satellite and UAV imagery for agricultural applications , 2016, Remote Sensing.

[29]  Andrzej Stateczny,et al.  Fusion of data from AIS and tracking radar for the needs of ECDIS , 2013, 2013 Signal Processing Symposium (SPS).

[30]  Davide Cozzolino,et al.  Pansharpening by Convolutional Neural Networks , 2016, Remote. Sens..

[31]  Joanne C. White,et al.  A new data fusion model for high spatial- and temporal-resolution mapping of forest disturbance based on Landsat and MODIS , 2009 .

[32]  Michael Möller,et al.  An Adaptive IHS Pan-Sharpening Method , 2010, IEEE Geoscience and Remote Sensing Letters.

[33]  Bruno Aiazzi,et al.  Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$Pan Data , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[34]  W. J. Carper,et al.  The use of intensity-hue-saturation transformations for merging SPOT panchromatic and multispectral image data , 1990 .

[35]  J. Zhou,et al.  A wavelet transform method to merge Landsat TM and SPOT panchromatic data , 1998 .

[36]  Yun Zhang,et al.  An IHS and wavelet integrated approach to improve pan-sharpening visual quality of natural colour IKONOS and QuickBird images , 2005, Inf. Fusion.

[37]  Corina da Costa Freitas,et al.  Optical and radar data integration for land use and land cover mapping in the Brazilian Amazon , 2013 .

[38]  Ryutaro Tateishi,et al.  A hybrid pansharpening approach and multiscale object-based image analysis for mapping diseased pine and oak trees , 2013 .

[39]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[40]  Mingyi He,et al.  A Novel Pansharpening Algorithm for WorldView-2 Satellite Images , .

[41]  Yunsong Li,et al.  Structure Tensor-Based Algorithm for Hyperspectral and Panchromatic Images Fusion , 2018, Remote. Sens..

[42]  Karim Faez,et al.  A new pan-sharpening method using multiobjective particle swarm optimization and the shiftable contourlet transform , 2011 .

[43]  Hongyi Liu,et al.  A New Pan-Sharpening Method With Deep Neural Networks , 2015, IEEE Geoscience and Remote Sensing Letters.

[44]  D. Amarsaikhan,et al.  Fusing high-resolution SAR and optical imagery for improved urban land cover study and classification , 2010 .

[45]  A. Azizi,et al.  QUALITY ASSESSMENT OF IMAGE FUSION TECHNIQUES FOR MULTISENSOR HIGH RESOLUTION SATELLITE IMAGES (CASE STUDY: IRS-P5 AND IRS-P6 SATELLITE IMAGES) , 2010 .

[46]  Koushlendra Kumar Singh,et al.  A novel approach for enhancement of geometric and contrast resolution properties of low contrast images , 2018, IEEE/CAA Journal of Automatica Sinica.

[47]  Christine Pohl,et al.  Multisensor image fusion in remote sensing: concepts, methods and applications , 1998 .

[48]  Manfred Ehlers,et al.  Multi-sensor image fusion for pansharpening in remote sensing , 2010 .

[49]  J. Andrew Bagnell,et al.  Terrain Classification from Aerial Data to Support Ground Vehicle Navigation , 2006 .

[50]  Seppo Nevalainen,et al.  Detection of dead or defoliated spruces using digital aerial data , 2002 .

[51]  J. G. Liu,et al.  Smoothing Filter-based Intensity Modulation : a spectral preserve image fusion technique for improving spatial details , 2001 .

[52]  Te-Ming Tu,et al.  A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[53]  T. Gillespie,et al.  Assessment and prediction of natural hazards from satellite imagery , 2007, Progress in physical geography.

[54]  Manfred Ehlers Multi-image Fusion in Remote Sensing: Spatial Enhancement vs. Spectral Characteristics Preservation , 2008, ISVC.

[55]  Luciano Alparone,et al.  Image fusion—the ARSIS concept and some successful implementation schemes , 2003 .

[56]  Peijun Du,et al.  Information fusion techniques for change detection from multi-temporal remote sensing images , 2013, Inf. Fusion.

[57]  Jocelyn Chanussot,et al.  Synthesis of Multispectral Images to High Spatial Resolution: A Critical Review of Fusion Methods Based on Remote Sensing Physics , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[58]  W. Cohen,et al.  Integration of lidar and Landsat ETM+ data for estimating and mapping forest canopy height , 2002 .

[59]  Shutao Li,et al.  Hybrid Multiresolution Method for Multisensor Multimodal Image Fusion , 2010, IEEE Sensors Journal.

[60]  L. Alparone,et al.  Enhanced Gram-Schmidt Spectral Sharpening Based on Multivariate Regression of MS and Pan Data , 2006, 2006 IEEE International Symposium on Geoscience and Remote Sensing.

[61]  Thomas Maurer HOW TO PAN-SHARPEN IMAGES USING THE GRAM-SCHMIDT PAN-SHARPEN METHOD – A RECIPE , 2013 .

[62]  Michal Kedzierski,et al.  A Method of Panchromatic Image Modification for Satellite Imagery Data Fusion , 2017, Remote. Sens..

[63]  Bin Xie,et al.  Revealing Implicit Assumptions of the Component Substitution Pansharpening Methods , 2017, Remote. Sens..

[64]  Hankui K. Zhang,et al.  Finer resolution observation and monitoring of global land cover: first mapping results with Landsat TM and ETM+ data , 2013 .