Understanding the phase contrast optics to restore artifact-free microscopy images for segmentation

Phase contrast, a noninvasive microscopy imaging technique, is widely used to capture time-lapse images to monitor the behavior of transparent cells without staining or altering them. Due to the optical principle, phase contrast microscopy images contain artifacts such as the halo and shade-off that hinder image segmentation, a critical step in automated microscopy image analysis. Rather than treating phase contrast microscopy images as general natural images and applying generic image processing techniques on them, we propose to study the optical properties of the phase contrast microscope to model its image formation process. The phase contrast imaging system can be approximated by a linear imaging model. Based on this model and input image properties, we formulate a regularized quadratic cost function to restore artifact-free phase contrast images that directly correspond to the specimen's optical path length. With artifacts removed, high quality segmentation can be achieved by simply thresholding the restored images. The imaging model and restoration method are quantitatively evaluated on microscopy image sequences with thousands of cells captured over several days. We also demonstrate that accurate restoration lays the foundation for high performance in cell detection and tracking.

[1]  Margrit Betke,et al.  Tracking of cell populations to understand their spatio-temporal behavior in response to physical stimuli , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[2]  Takeo Kanade,et al.  Understanding the Optics to Aid Microscopy Image Segmentation , 2010, MICCAI.

[3]  Takeo Kanade,et al.  Cell segmentation in microscopy imagery using a bag of local Bayesian classifiers , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[4]  Takeo Kanade,et al.  Restoring artifact-free microscopy image sequences , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[5]  Milan Sonka,et al.  Cell Segmentation, Tracking, and Mitosis Detection Using Temporal Context , 2005, MICCAI.

[6]  I. Smal,et al.  Tracking in cell and developmental biology. , 2009, Seminars in cell & developmental biology.

[7]  Kenong Wu,et al.  Live cell image segmentation , 1995, IEEE Transactions on Biomedical Engineering.

[8]  J. Rittscher Characterization of biological processes through automated image analysis. , 2010, Annual review of biomedical engineering.

[9]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[10]  Takeo Kanade,et al.  Cell population tracking and lineage construction with spatiotemporal context , 2008, Medical Image Anal..

[11]  Takeo Kanade,et al.  Mitosis sequence detection using hidden conditional random fields , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[12]  Vincent Lepetit,et al.  General constraints for batch Multiple-Target Tracking applied to large-scale videomicroscopy , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  F. Zernike How I discovered phase contrast. , 1955, Science.

[14]  James S. Duncan,et al.  Medical Image Analysis , 1999, IEEE Pulse.

[15]  Takeo Kanade,et al.  Reliably Tracking Partially Overlapping Neural Stem Cells in DIC Microscopy Image Sequences , 2009 .

[16]  Daniel D. Lee,et al.  Multiplicative Updates for Nonnegative Quadratic Programming , 2007, Neural Computation.

[17]  Stephen P. Boyd,et al.  An Interior-Point Method for Large-Scale $\ell_1$-Regularized Least Squares , 2007, IEEE Journal of Selected Topics in Signal Processing.

[18]  Frédo Durand,et al.  Understanding and evaluating blind deconvolution algorithms , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.

[20]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[21]  A. Papoulis Linear systems, Fourier transforms, and optics , 1981, Proceedings of the IEEE.

[22]  D. Malacara-Hernández,et al.  PRINCIPLES OF OPTICS , 2011 .

[23]  Takeo Kanade,et al.  Cell image analysis: Algorithms, system and applications , 2011, 2011 IEEE Workshop on Applications of Computer Vision (WACV).

[24]  Takeo Kanade,et al.  Nonnegative Mixed-Norm Preconditioning for Microscopy Image Segmentation , 2009, IPMI.