A new matching image preprocessing for image data fusion

Abstract Hyperspectral images collected with different spectroscopic techniques can be combined to benefit from complementary information and to improve the general description of chemical systems. The simultaneous analysis of images collected by different spectroscopic platforms can only be carried out when images are spatially matched with each other (i.e., different pixel sizes should be balanced and translation/rotation/scaling transformations should be done if required). The main goal of this work is the proposal of a general methodology to match image spatial properties that uses all pixels acquired in the images and, therefore, avoids the step of selecting analogous reference pixels to be compared. The effect of working with different kinds of image starting information on the robustness of the retrieved optimal translation and rotation parameters has also been assessed. The study has been tested in two different representative situations, namely: a) imaged sample with a clear contour b) imaged sample without defined contour. A final study on the effect of proper image matching is performed by applying Multivariate Curve Resolution-Alternating Least Squares (MCR-ALS) to the multiset formed by the appended images from different spectroscopic platforms before and after matching.

[1]  P. Eilers Parametric time warping. , 2004, Analytical chemistry.

[2]  P. Eilers A perfect smoother. , 2003, Analytical chemistry.

[3]  Bart Nicolai,et al.  Non-destructive measurement of bitter pit in apple fruit using NIR hyperspectral imaging , 2006 .

[4]  J Popp,et al.  Combining multiset resolution and segmentation for hyperspectral image analysis of biological tissues. , 2015, Analytica chimica acta.

[5]  S. Piqueras,et al.  Monitoring polymorphic transformations by using in situ Raman hyperspectral imaging and image multiset analysis. , 2014, Analytica chimica acta.

[6]  Simple-to-use interactive self-modeling mixture analysis of FTIR microscopy data , 1993 .

[7]  S. Piqueras,et al.  Chemometric Tools for Image Analysis , 2014 .

[8]  Romà Tauler,et al.  A graphical user-friendly interface for MCR-ALS: a new tool for multivariate curve resolution in MATLAB , 2005 .

[9]  C. Gendrin,et al.  Pharmaceutical applications of vibrational chemical imaging and chemometrics: a review. , 2008, Journal of pharmaceutical and biomedical analysis.

[10]  M. Schmitt,et al.  Deeper understanding of biological tissue: quantitative correlation of MALDI-TOF and Raman imaging. , 2013, Analytical chemistry.

[11]  Romà Tauler,et al.  Multivariate Curve Resolution (MCR) from 2000: Progress in Concepts and Applications , 2006 .

[12]  Romà Tauler,et al.  Spectroscopic imaging and chemometrics: a powerful combination for global and local sample analysis , 2004 .

[13]  José Manuel Amigo,et al.  Nir-chemical imaging study of acetylsalicylic acid in commercial tablets. , 2009, Talanta.

[14]  C. Krafft,et al.  Biomedical applications of Raman and infrared spectroscopy to diagnose tissues , 2006 .

[15]  Romà Tauler,et al.  Relevant aspects of quantification and sample heterogeneity in hyperspectral image resolution , 2012 .

[16]  Cyril Ruckebusch,et al.  Multivariate Curve Resolution Methods in Imaging Spectroscopy: Influence of Extraction Methods and Instrumental Perturbations , 2003, J. Chem. Inf. Comput. Sci..

[17]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[18]  B. Kowalski,et al.  Selectivity, local rank, three‐way data analysis and ambiguity in multivariate curve resolution , 1995 .

[19]  A. de Juan,et al.  Two-Way Data Analysis: Multivariate Curve Resolution – Iterative Resolution Methods , 2009 .

[20]  R Tauler,et al.  Resolution and segmentation of hyperspectral biomedical images by multivariate curve resolution-alternating least squares. , 2011, Analytica chimica acta.

[21]  R. Tauler Multivariate curve resolution applied to second order data , 1995 .

[22]  R Tauler,et al.  Chemometric strategies to unmix information and increase the spatial description of hyperspectral images: a single-cell case study. , 2013, Analytical chemistry.

[23]  Aoife A. Gowen,et al.  Multivariate Chemical Image Fusion of Vibrational Spectroscopic Imaging Modalities , 2016, Molecules.

[24]  Romà Tauler,et al.  MCR-BANDS: A user friendly MATLAB program for the evaluation of rotation ambiguities in Multivariate Curve Resolution , 2010 .