Hyperspectral-Multispectral Image Fusion with Weighted LASSO

Spectral imaging enables spatially-resolved identification of materials in remote sensing, biomedicine, and astronomy. However, acquisition times require balancing spectral and spatial resolution with signal-to-noise. Hyperspectral imaging provides superior material specificity, while multispectral images are faster to collect at greater fidelity. We propose an approach for fusing hyperspectral and multispectral images to provide high-quality hyperspectral output. The proposed optimization leverages the least absolute shrinkage and selection operator (LASSO) to perform variable selection and regularization. Computational time is reduced by applying the alternating direction method of multipliers (ADMM), as well as initializing the fusion image by estimating it using maximum a posteriori (MAP) based on Hardie's method. We demonstrate that the proposed sparse fusion and reconstruction provides quantitatively superior results when compared to existing methods on publicly available images. Finally, we show how the proposed method can be practically applied in biomedical infrared spectroscopic microscopy.

[1]  Zhu Han,et al.  Prediction of High Resolution Spatial-Temporal Air Pollutant Map from Big Data Sources , 2015, BigCom.

[2]  相原 龍,et al.  Alternating Direction Method of Multipliersを用いた声質変換のためのパラレル辞書学習 , 2015 .

[3]  Benjamin Bird,et al.  Introducing Discrete Frequency Infrared Technology for High-Throughput Biofluid Screening , 2016, Scientific Reports.

[4]  Jocelyn Chanussot,et al.  A Pansharpening Method Based on the Sparse Representation of Injected Details , 2015, IEEE Geoscience and Remote Sensing Letters.

[5]  P. Lasch,et al.  Hyperspectral infrared nanoimaging of organic samples based on Fourier transform infrared nanospectroscopy , 2017, Nature Communications.

[6]  Hassan Ghassemian,et al.  A review of remote sensing image fusion methods , 2016, Inf. Fusion.

[7]  Stephen P. Boyd,et al.  Block splitting for distributed optimization , 2013, Mathematical Programming Computation.

[8]  Shutao Li,et al.  Fusing Hyperspectral and Multispectral Images via Coupled Sparse Tensor Factorization , 2018, IEEE Transactions on Image Processing.

[9]  Herbert Stepp,et al.  5-Aminolevulinic Acid-derived Tumor Fluorescence: The Diagnostic Accuracy of Visible Fluorescence Qualities as Corroborated by Spectrometry and Histology and Postoperative Imaging , 2013, Neurosurgery.

[10]  Richard Bamler,et al.  A Sparse Image Fusion Algorithm With Application to Pan-Sharpening , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Mizi Fan,et al.  Fourier Transform Infrared Spectroscopy for Natural Fibres , 2012 .

[12]  Cyril Petibois,et al.  Clinical application of FTIR imaging: new reasons for hope. , 2010, Trends in biotechnology.

[13]  Jocelyn Chanussot,et al.  A Convex Formulation for Hyperspectral Image Superresolution via Subspace-Based Regularization , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[14]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[15]  Hongyi Liu,et al.  A New Pan-Sharpening Method With Deep Neural Networks , 2015, IEEE Geoscience and Remote Sensing Letters.

[16]  Jocelyn Chanussot,et al.  Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Guolan Lu,et al.  Medical hyperspectral imaging: a review , 2014, Journal of biomedical optics.

[18]  Chia-Hsiang Lin,et al.  A Convex Optimization-Based Coupled Nonnegative Matrix Factorization Algorithm for Hyperspectral and Multispectral Data Fusion , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Yifan Zhang,et al.  Noise-Resistant Wavelet-Based Bayesian Fusion of Multispectral and Hyperspectral Images , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Vincent Baeten,et al.  Hyperspectral Imaging Applications in Agriculture and Agro-Food Product Quality and Safety Control: A Review , 2013 .

[21]  Zhu Han,et al.  Signal Processing and Networking for Big Data Applications , 2017 .

[22]  Trac D. Tran,et al.  Hyperspectral Image Classification Using Dictionary-Based Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Jürgen Popp,et al.  Application of Vibrational Spectroscopy and Imaging to Point-of-Care Medicine: A Review , 2018, Applied spectroscopy.

[24]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[25]  Anant Madabhushi,et al.  Automated grading of breast cancer histopathology using spectral clustering with textural and architectural image features , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[26]  Rohit Bhargava,et al.  Towards Translation of Discrete Frequency Infrared Spectroscopic Imaging for Digital Histopathology of Clinical Biopsy Samples. , 2016, Analytical chemistry.

[27]  Arindam Banerjee,et al.  Bregman Alternating Direction Method of Multipliers , 2013, NIPS.

[28]  Russell C. Hardie,et al.  MAP estimation for hyperspectral image resolution enhancement using an auxiliary sensor , 2004, IEEE Transactions on Image Processing.

[29]  Antonio J. Plaza,et al.  Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[30]  Qiang Gao,et al.  The visible to the near infrared narrow band acousto-optic tunable filter and the hyperspectral microscopic imaging on biomedicine study , 2014 .

[31]  Vishal K. Varma,et al.  Infrared spectroscopic imaging: Label-free biochemical analysis of stroma and tissue fibrosis. , 2017, The international journal of biochemistry & cell biology.

[32]  D. Manolakis,et al.  Hyperspectral Imaging Remote Sensing: Physics, Sensors, and Algorithms , 2016 .

[33]  Zhu Han,et al.  Bridge the Gap Between ADMM and Stackelberg Game: Incentive Mechanism Design for Big Data Networks , 2017, IEEE Signal Processing Letters.

[34]  Jean-Yves Tourneret,et al.  Hyperspectral and Multispectral Image Fusion Based on a Sparse Representation , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Martin Schostak,et al.  Expression and prognostic relevance of annexin A3 in prostate cancer. , 2008, European urology.

[36]  S. Rehman,et al.  Fourier Transform Infrared (FTIR) Spectroscopy of Biological Tissues , 2008 .