Iterative-based visualization-oriented fusion scheme for hyperspectral images

This article investigates a novel visualization-based fusion of hyperspectral image bands using an iterative approach. Given a multi-objective function and the pixel-based hyperspectral image fusion method, the optimization process is described as finding the optimal fusion parameters to improve the fusion performance. Accordingly, an iterative-based approach is adopted. In the first step, the fusion process is developed using the pixel-based fusion technique. In the second step, the fused image is produced, and the fusion quality is assessed for multi-objective function construction. For multi-objective formulation, we focus three desired properties of the fused image such as entropy, variance, and smoothness. In the last step, fusion parameters are updated iteratively by examining the objective function. Here, the self-adaptive learning particle swarm optimizer is used to refine the fusion parameters iteratively. Different hyperspectral images, such as Cuprite mining, AVIRIS Indian pines scene, are employed in the evaluation. Quantitative analysis of fused images is carried out through some efficient fusion metrics such as correlation coefficient, entropy, Q-average, ERGAS, SAM, and SID. Experimental results show that the proposed approach outperforms existing methods in terms of both objective function criteria and visual effect.

[1]  Aggelos K. Katsaggelos,et al.  A survey of classical methods and new trends in pansharpening of multispectral images , 2011, EURASIP J. Adv. Signal Process..

[2]  E. M. Winter,et al.  Resolution enhancement of hyperspectral data , 2002, Proceedings, IEEE Aerospace Conference.

[3]  Rafael García,et al.  Fusion of multispectral and panchromatic images using improved IHS and PCA mergers based on wavelet decomposition , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Russell C. Hardie,et al.  Hyperspectral resolution enhancement using high-resolution multispectral imagery with arbitrary response functions , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Yu Wang,et al.  Self-adaptive learning based particle swarm optimization , 2011, Inf. Sci..

[6]  Gonzalo Seco-Granados,et al.  A Reduced Complexity Approach to IAA Beamforming for Efficient DOA Estimation of Coherent Sources , 2011, EURASIP J. Adv. Signal Process..

[7]  Guangyi Chen,et al.  Enhancing Spatial Resolution of Hyperspectral Imagery Using Sensor's Intrinsic Keystone Distortion , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Subhasis Chaudhuri,et al.  A Bayesian approach to visualization-oriented hyperspectral image fusion , 2013, Inf. Fusion.

[9]  Antonio J. Plaza,et al.  Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[10]  Dehong Liu,et al.  Dictionary learning based pan-sharpening , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[11]  Jiangtao Peng,et al.  Sparse matrix transform-based linear discriminant analysis for hyperspectral image classification , 2016, Signal Image Video Process..

[12]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[13]  Naoto Yokoya,et al.  Coupled Nonnegative Matrix Factorization Unmixing for Hyperspectral and Multispectral Data Fusion , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[14]  B. Ugur Töreyin,et al.  Sparse coding of hyperspectral imagery using online learning , 2015, Signal Image Video Process..

[15]  Chein-I Chang,et al.  Hyperspectral Data Exploitation , 2007 .

[16]  B. K. Shreyamsha Kumar,et al.  Image fusion based on pixel significance using cross bilateral filter , 2013, Signal, Image and Video Processing.

[17]  Chein-I. Chang Hyperspectral Data Exploitation: Theory and Applications , 2007 .

[18]  Jianglin Ma,et al.  Superresolution Enhancement of Hyperspectral CHRIS/Proba Images With a Thin-Plate Spline Nonrigid Transform Model , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Shutao Li,et al.  A New Pan-Sharpening Method Using a Compressed Sensing Technique , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Yifan Zhang,et al.  Noise-Resistant Wavelet-Based Bayesian Fusion of Multispectral and Hyperspectral Images , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Russell C. Hardie,et al.  MAP estimation for hyperspectral image resolution enhancement using an auxiliary sensor , 2004, IEEE Transactions on Image Processing.