Extracting morphologies from third harmonic generation images of structurally normal human brain tissue

Motivation: The morphologies contained in 3D third harmonic generation (THG) images of human brain tissue can report on the pathological state of the tissue. However, the complexity of THG brain images makes the usage of modern image processing tools, especially those of image filtering, segmentation and validation, to extract this information challenging. Results: We developed a salient edge‐enhancing model of anisotropic diffusion for image filtering, based on higher order statistics. We split the intrinsic 3‐phase segmentation problem into two 2‐phase segmentation problems, each of which we solved with a dedicated model, active contour weighted by prior extreme. We applied the novel proposed algorithms to THG images of structurally normal ex‐vivo human brain tissue, revealing key tissue components—brain cells, microvessels and neuropil, enabling statistical characterization of these components. Comprehensive comparison to manually delineated ground truth validated the proposed algorithms. Quantitative comparison to second harmonic generation/auto‐fluorescence images, acquired simultaneously from the same tissue area, confirmed the correctness of the main THG features detected. Availability and Implementation: The software and test datasets are available from the authors. Contact: z.zhang@vu.nl Supplementary information: Supplementary data are available at Bioinformatics online.

[1]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[2]  Max A. Viergever,et al.  Vessel enhancing diffusion: A scale space representation of vessel structures , 2006, Medical Image Anal..

[3]  Chi‐Kuang Sun,et al.  In Vivo Virtual Biopsy of Human Skin by Using Noninvasive Higher Harmonic Generation Microscopy , 2010, IEEE Journal of Selected Topics in Quantum Electronics.

[4]  Nicolas Chenouard,et al.  Icy: an open bioimage informatics platform for extended reproducible research , 2012, Nature Methods.

[5]  D. Kaplan,et al.  Non-invasive monitoring of cell metabolism and lipid production in 3D engineered human adipose tissues using label-free multiphoton microscopy. , 2013, Biomaterials.

[6]  Carlos Ortiz-de-Solorzano,et al.  Segmentation and Shape Tracking of Whole Fluorescent Cells Based on the Chan–Vese Model , 2013, IEEE Transactions on Medical Imaging.

[7]  Chunming Li,et al.  A Level Set Method for Image Segmentation in the Presence of Intensity Inhomogeneities With Application to MRI , 2011, IEEE Transactions on Image Processing.

[8]  Chris Xu,et al.  Multiphoton gradient index endoscopy for evaluation of diseased human prostatic tissue ex vivo , 2014, Journal of biomedical optics.

[9]  Chi‐Kuang Sun,et al.  Noninvasive harmonics optical microscopy for long-term observation of embryonic nervous system development in vivo. , 2006, Journal of biomedical optics.

[10]  Wonjun Kim,et al.  Active Contours Driven by the Salient Edge Energy Model , 2013, IEEE Transactions on Image Processing.

[11]  Christophe Zimmer,et al.  Segmenting and tracking fluorescent cells in dynamic 3-D microscopy with coupled active surfaces , 2005, IEEE Transactions on Image Processing.

[12]  J. C. Baayen,et al.  Third harmonic generation imaging for fast, label-free pathology of human brain tumors , 2016, Biomedical optics express.

[13]  김정연,et al.  서브블록 히스토그램 등화기법을 이용한 개선된 콘트래스트 강화 알고리즘 ( An Advanced Contrast Enhancement Using Partially Overlapped Sub-Block Histogram Equalization ) , 1999 .

[14]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Pierre Soille,et al.  Morphological Image Analysis: Principles and Applications , 2003 .

[16]  Chunming Li,et al.  Active contours driven by local Gaussian distribution fitting energy , 2009, Signal Process..

[17]  Weimin Huang,et al.  The $L_{0}$ Regularized Mumford–Shah Model for Bias Correction and Segmentation of Medical Images , 2015, IEEE Transactions on Image Processing.

[18]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[19]  David Zhang,et al.  Reinitialization-Free Level Set Evolution via Reaction Diffusion , 2011, IEEE Transactions on Image Processing.

[20]  X. Xie,et al.  Rapid, Label-Free Detection of Brain Tumors with Stimulated Raman Scattering Microscopy , 2013, Science Translational Medicine.

[21]  A. Fabre,et al.  Imaging lipid bodies in cells and tissues using third-harmonic generation microscopy , 2005, Nature Methods.

[22]  W. Zipfel,et al.  Strategies for high-resolution imaging of epithelial ovarian cancer by laparoscopic nonlinear microscopy. , 2010, Translational oncology.

[23]  A. Zvyagin.  Multiphoton endoscopy , 2007 .

[24]  W. Webb,et al.  Multiphoton microscopy: a potential "optical biopsy" tool for real-time evaluation of lung tumors without the need for exogenous contrast agents. , 2014, Archives of pathology & laboratory medicine.

[25]  Gwo Giun Lee,et al.  Automatic Cell Segmentation and Nuclear-to-Cytoplasmic Ratio Analysis for Third Harmonic Generated Microscopy Medical Images , 2013, IEEE Transactions on Biomedical Circuits and Systems.

[26]  Boguslaw Obara,et al.  Coherence enhancing diffusion filtering based on the Phase Congruency Tensor , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[27]  Andrés Santos,et al.  Methodology for Reconstructing Early Zebrafish Development From In Vivo Multiphoton Microscopy , 2012, IEEE Transactions on Image Processing.

[28]  W. Webb,et al.  Multiphoton microscopy and microspectroscopy for diagnostics of inflammatory and neoplastic lung. , 2012, Journal of biomedical optics.

[29]  Wiro J. Niessen,et al.  Advanced Level-Set-Based Cell Tracking in Time-Lapse Fluorescence Microscopy , 2010, IEEE Transactions on Medical Imaging.

[30]  Daniel P. Huttenlocher,et al.  Distance Transforms of Sampled Functions , 2012, Theory Comput..

[31]  Tony J Collins,et al.  ImageJ for microscopy. , 2007, BioTechniques.

[32]  P. Bourgine,et al.  Cell Lineage Reconstruction of Early Zebrafish Embryos Using Label-Free Nonlinear Microscopy , 2010, Science.

[33]  Chunming Li,et al.  Distance Regularized Level Set Evolution and Its Application to Image Segmentation , 2010, IEEE Transactions on Image Processing.

[34]  Georgios B. Giannakis,et al.  Object and Texture Classification Using Higher Order Statistics , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  J. C. Lodder,et al.  Label-free live brain imaging and targeted patching with third-harmonic generation microscopy , 2011, Proceedings of the National Academy of Sciences.

[36]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[37]  Jean-Christophe Olivo-Marin,et al.  Extracting 3D cell parameters from dense tissue environments: application to the development of the mouse heart , 2013, Bioinform..

[38]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[39]  Vittorio Murino,et al.  Noisy texture classification: A higher-order statistics approach , 1998, Pattern Recognit..

[40]  Gradient Watershed Transform Based Automated Cell Segmentation for THG Microscopy Medical Images to Detect Skin Cancer , 2014 .

[41]  Raymond H. Chan,et al.  A Two-Stage Image Segmentation Method Using a Convex Variant of the Mumford-Shah Model and Thresholding , 2013, SIAM J. Imaging Sci..