A novel approach to quantitative evaluation of hyperspectral image fusion techniques

In recent years, several image fusion techniques have been proposed to cater to various objectives. An appropriate visualization of the data is one of the key objectives of image fusion, particularly in case of hyperspectral images where the number of bands are far more than those can be displayed on standard tristimulus display. While a few techniques that address the issue of visualization of hyperspectral data can be seen in the literature, the evaluation of performances of these different techniques is still an open problem. In this paper, we first introduce a notion called fusion consistency and we suggest that the fusion techniques should satisfy the consistency criterion under appropriate measures that evaluate the fusion performance. We also propose several modifications for a number of existing measures that can quantify the progression of fusion operation efficiently for the fusion of a large number of image bands. We use these observations to validate suitability of any given technique for fusion of hyperspectral images.

[1]  Robert A. Schowengerdt,et al.  Remote Sensing, Third Edition: Models and Methods for Image Processing , 2006 .

[2]  Henk J. A. M. Heijmans,et al.  A new quality metric for image fusion , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[3]  Jocelyn Chanussot,et al.  Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Steven K. Rogers,et al.  Perceptual-based image fusion for hyperspectral data , 1997, IEEE Trans. Geosci. Remote. Sens..

[5]  Yi Shen,et al.  A quantitative method for evaluating the performances of hyperspectral image fusion , 2003, IEEE Trans. Instrum. Meas..

[6]  G. Qu,et al.  Information measure for performance of image fusion , 2002 .

[7]  Dieter Oertel,et al.  Unmixing-based multisensor multiresolution image fusion , 1999, IEEE Trans. Geosci. Remote. Sens..

[8]  Altan Mesut,et al.  A comparative analysis of image fusion methods , 2012, 2012 20th Signal Processing and Communications Applications Conference (SIU).

[9]  Wesley E. Snyder,et al.  Band selection using independent component analysis for hyperspectral image processing , 2003, 32nd Applied Imagery Pattern Recognition Workshop, 2003. Proceedings..

[10]  Qingquan Li,et al.  A comparative analysis of image fusion methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Subhasis Chaudhuri,et al.  A fast approach for fusion of hyperspectral images through redundancy elimination , 2010, ICVGIP '10.

[12]  Robert A. Schowengerdt,et al.  Remote sensing, models, and methods for image processing , 1997 .

[13]  Cedric Nishan Canagarajah,et al.  Pixel- and region-based image fusion with complex wavelets , 2007, Inf. Fusion.

[14]  Bicheng Li,et al.  A remote sensing image fusion method based on PCA transform and wavelet packet transform , 2003, International Conference on Neural Networks and Signal Processing, 2003. Proceedings of the 2003.

[15]  Josée Lévesque,et al.  A demonstration of hyperspectral image exploitation for military applications , 2007, 2007 10th International Conference on Information Fusion.

[16]  Qian Du,et al.  Color Display for Hyperspectral Imagery , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Maya R. Gupta,et al.  Linear Fusion of Image Sets for Display , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Stavri G. Nikolov,et al.  Image fusion: Advances in the state of the art , 2007, Inf. Fusion.

[19]  Lawrence B. Wolff,et al.  Multispectral image visualization through first-order fusion , 2002, IEEE Trans. Image Process..

[20]  Christine Pohl,et al.  Multisensor image fusion in remote sensing: concepts, methods and applications , 1998 .

[21]  Chein-I Chang,et al.  Automatic spectral target recognition in hyperspectral imagery , 2003 .

[22]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[23]  Hai-Hui Wang,et al.  Multispectral image fusion approach based on GHM multiwavelet transform , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[24]  J. Scott Tyo,et al.  Principal-components-based display strategy for spectral imagery , 2003, IEEE Trans. Geosci. Remote. Sens..

[25]  Hee Young Yoo,et al.  Anomaly Detection from Hyperspectral Imagery using Transform-based Feature Selection and Local Spatial Auto-correlation Index , 2012 .

[26]  Lucien Wald,et al.  Some terms of reference in data fusion , 1999, IEEE Trans. Geosci. Remote. Sens..

[27]  Jianhua Lin,et al.  Divergence measures based on the Shannon entropy , 1991, IEEE Trans. Inf. Theory.

[28]  Begüm Demir,et al.  A Low-Complexity Approach for the Color Display of Hyperspectral Remote-Sensing Images Using One-Bit-Transform-Based Band Selection , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Rick S. Blum,et al.  Theoretical analysis of an information-based quality measure for image fusion , 2008, Inf. Fusion.

[30]  Hector Erives,et al.  Implementation of a 3-D Hyperspectral Instrument for Skin Imaging Applications , 2009, IEEE Transactions on Instrumentation and Measurement.

[31]  Maya R. Gupta,et al.  Design goals and solutions for display of hyperspectral images , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[32]  T. Kailath.  The Divergence and Bhattacharyya Distance Measures in Signal Selection , 1967 .

[33]  Pramod K. Varshney,et al.  Evaluation of ICA based fusion of hyperspectral images for color display , 2007, 2007 10th International Conference on Information Fusion.

[34]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[35]  Subhasis Chaudhuri,et al.  Visualization of Hyperspectral Images Using Bilateral Filtering , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[36]  B. Guo,et al.  Hyperspectral image fusion using spectrally weighted kernels , 2005, 2005 7th International Conference on Information Fusion.

[37]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[38]  C. Ramesh,et al.  Fusion performance measures and a lifting wavelet transform based algorithm for image fusion , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[39]  George A. Lampropoulos,et al.  Fusion of hyperspectral data using segmented PCT for color representation and classification , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Peter Wonka,et al.  Interactive Hyperspectral Image Visualization Using Convex Optimization , 2009, IEEE Transactions on Geoscience and Remote Sensing.