Application of Pansharpening Algorithms for the Fusion of Raman and Conventional Brightfield Microscopy Images

This contribution investigates the application of established pansharpening algorithms for the fusion of hyperspectral images from Raman microspectroscopy and panchromatic images from conventional brightfield microscopy. Seven different methods based on multiresolution analysis and component substitution were applied and evaluated through visual assessment and quantitative quality measures at full and reduced resolution. The results indicate that, among the considered concepts, multiresolution methods are the more promising approaches for a physically and chemically meaningful fusion of the considered modalities. Here, pansharpening based on high-pass filtering led to the best results.

[1]  G. McConnell,et al.  A simple but precise method for quantitative measurement of the quality of the laser focus in a scanning optical microscope , 2015, Journal of microscopy.

[2]  Jocelyn Chanussot,et al.  A Critical Comparison Among Pansharpening Algorithms , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Te-Ming Tu,et al.  A new look at IHS-like image fusion methods , 2001, Inf. Fusion.

[4]  G Franchi,et al.  Enhanced EDX images by fusion of multimodal SEM images using pansharpening techniques , 2018, Journal of microscopy.

[5]  Mark H Ellisman,et al.  Correlative Microscopy Combining Secondary Ion Mass Spectrometry and Electron Microscopy: Comparison of Intensity-Hue-Saturation and Laplacian Pyramid Methods for Image Fusion. , 2017, Analytical chemistry.

[6]  Luciano Alparone,et al.  MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery , 2006 .

[7]  Bruno Aiazzi,et al.  Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$Pan Data , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[8]  J. G. Liu,et al.  Smoothing Filter-based Intensity Modulation: A spectral preserve image fusion technique for improving spatial details , 2000 .

[9]  Hua Tian,et al.  Application of pan‐sharpening to SIMS imaging , 2014 .

[10]  Jocelyn Chanussot,et al.  Synthesis of Multispectral Images to High Spatial Resolution: A Critical Review of Fusion Methods Based on Remote Sensing Physics , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Alan R. Gillespie,et al.  Color enhancement of highly correlated images. II. Channel ratio and “chromaticity” transformation techniques , 1987 .

[12]  S. Sides,et al.  Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic , 1991 .

[13]  J. G. Liu,et al.  Smoothing Filter-based Intensity Modulation : a spectral preserve image fusion technique for improving spatial details , 2001 .

[14]  P. Chavez,et al.  Extracting spectral contrast in landsat thematic mapper image data using selective principal component analysis , 1989 .