Multimodal image fusion with SIMS: Preprocessing with image registration.

In order to utilize complementary imaging techniques to supply higher resolution data for fusion with secondary ion mass spectrometry (SIMS) chemical images, there are a number of aspects that, if not given proper consideration, could produce results which are easy to misinterpret. One of the most critical aspects is that the two input images must be of the same exact analysis area. With the desire to explore new higher resolution data sources that exists outside of the mass spectrometer, this requirement becomes even more important. To ensure that two input images are of the same region, an implementation of the insight segmentation and registration toolkit (ITK) was developed to act as a preprocessing step before performing image fusion. This implementation of ITK allows for several degrees of movement between two input images to be accounted for, including translation, rotation, and scale transforms. First, the implementation was confirmed to accurately register two multimodal images by supplying a known transform. Once validated, two model systems, a copper mesh grid and a group of RAW 264.7 cells, were used to demonstrate the use of the ITK implementation to register a SIMS image with a microscopy image for the purpose of performing image fusion.

[1]  Hua Tian,et al.  Application of pan‐sharpening to SIMS imaging , 2014 .

[2]  Michael J Ackerman,et al.  Engineering and algorithm design for an image processing Api: a technical report on ITK--the Insight Toolkit. , 2002, Studies in health technology and informatics.

[3]  Liangpei Zhang,et al.  Quality Assessment of Panchromatic and Multispectral Image Fusion for the ZY-3 Satellite: From an Information Extraction Perspective , 2014, IEEE Geoscience and Remote Sensing Letters.

[4]  Max A. Viergever,et al.  Mutual-information-based registration of medical images: a survey , 2003, IEEE Transactions on Medical Imaging.

[5]  K. P. Soman,et al.  Implementation and Comparative Study of Image Fusion Algorithms , 2010 .

[6]  Qingquan Li,et al.  A comparative analysis of image fusion methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Mary Ellen Miller,et al.  Image fusion combining SEM and ToF‐SIMS images , 2015 .

[8]  Siamak Khorram,et al.  A feature-based image registration algorithm using improved chain-code representation combined with invariant moments , 1999, IEEE Trans. Geosci. Remote. Sens..

[9]  Nicholas Winograd,et al.  Improving Secondary Ion Mass Spectrometry Image Quality with Image Fusion , 2014, Journal of The American Society for Mass Spectrometry.

[10]  Kiyun Yu,et al.  A New Adaptive Component-Substitution-Based Satellite Image Fusion by Using Partial Replacement , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Rick S. Blum,et al.  A categorization of multiscale-decomposition-based image fusion schemes with a performance study for a digital camera application , 1999, Proc. IEEE.

[12]  Shutao Li,et al.  Remote Sensing Image Fusion via Sparse Representations Over Learned Dictionaries , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Christine Pohl,et al.  Multisensor image fusion in remote sensing: concepts, methods and applications , 1998 .

[14]  Miguel A. Luengo-Oroz,et al.  Wavelet-based image fusion in multi-view three-dimensional microscopy , 2012, Bioinform..

[15]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[16]  Jeffrey A. Fessler,et al.  Intensity-based image registration using robust correlation coefficients , 2004, IEEE Transactions on Medical Imaging.

[17]  Gonzalo Pajares,et al.  A wavelet-based image fusion tutorial , 2004, Pattern Recognit..

[18]  John S. Fletcher,et al.  A comparison of PCA and MAF for ToF‐SIMS image interpretation , 2009, Surface and Interface Analysis.

[19]  Max A. Viergever,et al.  elastix: A Toolbox for Intensity-Based Medical Image Registration , 2010, IEEE Transactions on Medical Imaging.

[20]  David R. Haynor,et al.  PET-CT image registration in the chest using free-form deformations , 2003, IEEE Transactions on Medical Imaging.

[21]  Bonnie J. Tyler Interpretation of TOF-SIMS images: multivariate and univariate approaches to image de-noising, image segmentation and compound identification , 2003 .

[22]  Jun Sugiyama,et al.  Tracking of a bronchoscope using epipolar geometry analysis and intensity-based image registration of real and virtual endoscopic images , 2002, Medical Image Anal..

[23]  David G. Castner,et al.  Multivariate analysis strategies for processing ToF-SIMS images of biomaterials. , 2007, Biomaterials.

[24]  N. Winograd,et al.  Performance characteristics of a chemical imaging time-of-flight mass spectrometer. , 1998, Rapid communications in mass spectrometry : RCM.

[25]  Luciano Alparone,et al.  Remote sensing image fusion using the curvelet transform , 2007, Inf. Fusion.

[26]  Yongmin Kim,et al.  Denoising and multivariate analysis of time‐of‐flight SIMS images , 2003 .