Integration of 3D multimodal imaging data of a head and neck cancer and advanced feature recognition.

In the last years, matrix-assisted laser desorption/ionization mass spectrometry imaging (MALDI MSI) became an imaging technique which has the potential to characterize complex tumor tissue. The combination with other modalities and with standard histology techniques was achieved by the use of image registration methods and enhances analysis possibilities. We analyzed an oral squamous cell carcinoma with up to 162 consecutive sections with MALDI MSI, hematoxylin and eosin (H&E) staining and immunohistochemistry (IHC) against CD31. Spatial segmentation maps of the MALDI MSI data were generated by similarity-based clustering of spectra. Next, the maps were overlaid with the H&E microscopy images and the results were interpreted by an experienced pathologist. Image registration was used to fuse both modalities and to build a three-dimensional (3D) model. To visualize structures below resolution of MALDI MSI, IHC was carried out for CD31 and results were embedded additionally. The integration of 3D MALDI MSI data with H&E and IHC images allows a correlation between histological and molecular information leading to a better understanding of the functional heterogeneity of tumors. This article is part of a Special Issue entitled: MALDI Imaging, edited by Dr. Corinna Henkel and Prof. Peter Hoffmann.

[1]  Stefan Heldmann,et al.  International Journal of Computer Vision c ○ 2006 Springer Science + Business Media, LLC. Manufactured in the United States. DOI: 10.1007/s11263-006-9780-x Image Registration of Sectioned Brains , 2004 .

[2]  Eldad Haber,et al.  Intensity Gradient Based Registration and Fusion of Multi-modal Images , 2006, MICCAI.

[3]  A. Walch,et al.  In situ drug and metabolite analysis [corrected] in biological and clinical research by MALDI MS imaging. , 2014, Bioanalysis.

[4]  J. F. Bradshaw,et al.  The principal axes transformation--a method for image registration. , 1990, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[5]  Theodore Alexandrov,et al.  Spatial segmentation of imaging mass spectrometry data with edge-preserving image denoising and clustering. , 2010, Journal of proteome research.

[6]  Orlando Guntinas-Lichius,et al.  MALDI-imaging segmentation is a powerful tool for spatial functional proteomic analysis of human larynx carcinoma , 2012, Journal of Cancer Research and Clinical Oncology.

[7]  C. Broit Optimal registration of deformed images , 1981 .

[8]  Stefan Heldmann,et al.  MRI-compatible pipeline for three-dimensional MALDI imaging mass spectrometry using PAXgene fixation. , 2013, Journal of proteomics.

[9]  D. Trede,et al.  The challenge of on-tissue digestion for MALDI MSI— a comparison of different protocols to improve imaging experiments , 2015, Analytical and Bioanalytical Chemistry.

[10]  Philip Gremillet,et al.  Dedicated image analysis techniques for three-dimensional reconstruction from serial sections in electron microscopy , 1991, Machine Vision and Applications.

[11]  R. Langer,et al.  High‐resolution MALDI‐FT‐ICR MS imaging for the analysis of metabolites from formalin‐fixed, paraffin‐embedded clinical tissue samples , 2015, The Journal of pathology.

[12]  Jan Modersitzki,et al.  Numerical Methods for Image Registration , 2004 .

[13]  Stefan Heldmann,et al.  2D and 3D MALDI-imaging: conceptual strategies for visualization and data mining. , 2014, Biochimica et biophysica acta.

[14]  Bernhard Spengler,et al.  Mass spectrometry imaging with high resolution in mass and space , 2013, Histochemistry and Cell Biology.

[15]  C. Henkel,et al.  Tissue MALDI Mass Spectrometry Imaging (MALDI MSI) of Peptides. , 2016, Methods in molecular biology.

[16]  Jan Modersitzki,et al.  FAIR: Flexible Algorithms for Image Registration , 2009 .

[17]  Jürgen Popp,et al.  Multimodal nonlinear microscopy of head and neck carcinoma — toward surgery assisting frozen section analysis , 2016, Head & neck.

[18]  D. Trede,et al.  Histomolecular interpretation of pleomorphic adenomas of the salivary gland by matrix‐assisted laser desorption ionization imaging and spatial segmentation , 2015, Head & neck.

[19]  Stefan Heldmann,et al.  Patch-Based Nonlinear Image Registration for Gigapixel Whole Slide Images , 2016, IEEE Transactions on Biomedical Engineering.

[20]  Theodore Alexandrov,et al.  Efficient spatial segmentation of large imaging mass spectrometry datasets with spatially aware clustering , 2011, Bioinform..

[21]  Brendan Prideaux,et al.  Mass spectrometry imaging for drug distribution studies. , 2012, Journal of proteomics.

[22]  Sören-Oliver Deininger,et al.  MALDI imaging combined with hierarchical clustering as a new tool for the interpretation of complex human cancers. , 2008, Journal of proteome research.

[23]  Jürgen Popp,et al.  Multimodal nonlinear microscopic investigations on head and neck squamous cell carcinoma: Toward intraoperative imaging , 2013, Head & neck.

[24]  R. Bajcsy,et al.  A computerized system for the elastic matching of deformed radiographic images to idealized atlas images. , 1983, Journal of computer assisted tomography.

[25]  Jens Limpert,et al.  Expanding multimodal microscopy by high spectral resolution coherent anti-Stokes Raman scattering imaging for clinical disease diagnostics. , 2013, Analytical chemistry.

[26]  Michael Becker,et al.  Revisiting Rat Spermatogenesis with MALDI Imaging at 20-μm Resolution* , 2010, Molecular & Cellular Proteomics.

[27]  R. Casadonte,et al.  Proteomic analysis of formalin-fixed paraffin-embedded tissue by MALDI imaging mass spectrometry , 2011, Nature Protocols.

[28]  Stefan Heldmann,et al.  Exploring three-dimensional matrix-assisted laser desorption/ionization imaging mass spectrometry data: three-dimensional spatial segmentation of mouse kidney. , 2012, Analytical chemistry.

[29]  D. Trede,et al.  Spatial Segmentation of MALDI FT-ICR MSI Data: A Powerful Tool to Explore the Head and Neck Tumor In Situ Lipidome , 2014, Journal of The American Society for Mass Spectrometry.

[30]  Ron M. A. Heeren,et al.  Mass Spectrometry Imaging of Drug Related Crystal-Like Structures in Formalin-Fixed Frozen and Paraffin-Embedded Rabbit Kidney Tissue Sections , 2015, Journal of The American Society for Mass Spectrometry.

[31]  M. Schmitt,et al.  Deeper understanding of biological tissue: quantitative correlation of MALDI-TOF and Raman imaging. , 2013, Analytical chemistry.

[32]  Max A. Viergever,et al.  Mutual-information-based registration of medical images: a survey , 2003, IEEE Transactions on Medical Imaging.

[33]  F. von Eggeling,et al.  Microdissecting the proteome , 2007, Proteomics.

[34]  F. von Eggeling,et al.  Biomarker Discovery and Identification in Laser Microdissected Head and Neck Squamous Cell Carcinoma with ProteinChip® Technology, Two-dimensional Gel Electrophoresis, Tandem Mass Spectrometry, and Immunohistochemistry* , 2003, Molecular & Cellular Proteomics.

[35]  Franziska Hoffmann,et al.  Benchmark datasets for 3D MALDI- and DESI-imaging mass spectrometry , 2015, GigaScience.

[36]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[37]  Arthur W. Toga,et al.  A 3D digital map of rat brain , 1995, Brain Research Bulletin.

[38]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[39]  F. Eggeling,et al.  Localization of sporadic neuroendocrine tumors by gene expression analysis of their metastases , 2011, Clinical & Experimental Metastasis.

[40]  Torsten Rohlfing,et al.  Image Similarity and Tissue Overlaps as Surrogates for Image Registration Accuracy: Widely Used but Unreliable , 2012, IEEE Transactions on Medical Imaging.

[41]  L. Cazares,et al.  MALDI tissue imaging: from biomarker discovery to clinical applications , 2011, Analytical and bioanalytical chemistry.

[42]  O. Franco,et al.  Head and neck cancer , 2010, Cancer.

[43]  Sandra Rauser,et al.  MALDI imaging mass spectrometry for direct tissue analysis: a new frontier for molecular histology , 2008, Histochemistry and Cell Biology.

[44]  Theodore Alexandrov,et al.  Serial 3D imaging mass spectrometry at its tipping point. , 2015, Analytical chemistry.

[45]  Roy A Jensen,et al.  Proteomics in diagnostic pathology: profiling and imaging proteins directly in tissue sections. , 2004, The American journal of pathology.