Image segmentation for integrated multiphoton microscopy and reflectance confocal microscopy imaging of human skin in vivo.

BACKGROUND Non-invasive cellular imaging of the skin in vivo can be achieved in reflectance confocal microscopy (RCM) and multiphoton microscopy (MPM) modalities to yield complementary images of the skin based on different optical properties. One of the challenges of in vivo microscopy is the delineation (i.e., segmentation) of cellular and subcellular architectural features. METHODS In this work we present a method for combining watershed and level-set models for segmentation of multimodality images obtained by an integrated MPM and RCM imaging system from human skin in vivo. RESULTS Firstly, a segmentation model based on watershed is introduced for obtaining the accurate structure of cell borders from the RCM image. Secondly,, a global region based energy level-set model is constructed for extracting the nucleus of each cell from the MPM image. Thirdly, a local region-based Lagrange Continuous level-set approach is used for segmenting cytoplasm from the MPM image. CONCLUSIONS Experimental results demonstrated that cell borders from RCM image and boundaries of cytoplasm and nucleus from MPM image can be obtained by our segmentation method with better accuracy and effectiveness. We are planning to use this method to perform quantitative analysis of MPM and RCM images of in vivo human skin to study the variations of cellular parameters such as cell size, nucleus size and other mophormetric features with skin pathologies.

[1]  Srdjan Stankovic,et al.  Computed tomography image analyzer: 3D reconstruction and segmentation applying active contour models - 'snakes' , 2000, Int. J. Medical Informatics.

[2]  Chen-Yuan Dong,et al.  Multiphoton microscopy in dermatological imaging. , 2009, Journal of dermatological science.

[3]  W. Webb,et al.  Live tissue intrinsic emission microscopy using multiphoton-excited native fluorescence and second harmonic generation , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Stephen T. C. Wong,et al.  Repulsive force based snake model to segment and track neuronal axons in 3D microscopy image stacks , 2006, NeuroImage.

[5]  Xiaobo Zhou,et al.  A Novel Cell Segmentation Method and Cell Phase Identification Using Markov Model , 2009, IEEE Transactions on Information Technology in Biomedicine.

[6]  Binsheng Zhao,et al.  Marker-controlled watershed for lymphoma segmentation in sequential CT images. , 2006, Medical physics.

[7]  Peng Zhang,et al.  The Application of the Snake Model in Carcinoma Cell Image Segment , 2008, ICIC.

[8]  Cedric Nishan Canagarajah,et al.  Image segmentation using a texture gradient based watershed transform , 2003, IEEE Trans. Image Process..

[9]  Allen R. Tannenbaum,et al.  Localizing Region-Based Active Contours , 2008, IEEE Transactions on Image Processing.

[10]  Chunming Li,et al.  Minimization of Region-Scalable Fitting Energy for Image Segmentation , 2008, IEEE Transactions on Image Processing.

[11]  Karsten König,et al.  Clinical multiphoton tomography , 2008, Journal of biophotonics.

[12]  S. Oliveira,et al.  A spectral clustering algorithm for manufacturing cell formation , 2009, Comput. Ind. Eng..

[13]  Zhen Liu,et al.  Medical Image Segmentation Based on a Hybrid Region-Based Active Contour Model , 2014, Comput. Math. Methods Medicine.

[14]  R. Webb,et al.  In vivo confocal scanning laser microscopy of human skin: melanin provides strong contrast. , 1995, The Journal of investigative dermatology.

[15]  Michael Unser,et al.  Variational B-Spline Level-Set: A Linear Filtering Approach for Fast Deformable Model Evolution , 2009, IEEE Transactions on Image Processing.

[16]  Noor Azuan Abu Osman,et al.  Dual photon excitation microscopy and image threshold segmentation in live cell imaging during compression testing. , 2013, Journal of biomechanics.

[17]  Haishan Zeng,et al.  Perfectly registered multiphoton and reflectance confocal video rate imaging of in vivo human skin , 2013, Journal of biophotonics.