Understanding the Optics to Aid Microscopy Image Segmentation

Image segmentation is essential for many automated microscopy image analysis systems. Rather than treating microscopy images as general natural images and rushing into the image processing warehouse for solutions, we propose to study a microscope's optical properties to model its image formation process first using phase contrast microscopy as an exemplar. It turns out that the phase contrast imaging system can be relatively well explained by a linear imaging model. Using this model, we formulate a quadratic optimization function with sparseness and smoothness regularizations to restore the "authentic" phase contrast images that directly correspond to specimen's optical path length without phase contrast artifacts such as halo and shade-off. With artifacts removed, high quality segmentation can be achieved by simply thresholding the restored images. The imaging model and restoration method are quantitatively evaluated on two sequences with thousands of cells captured over several days.

[1]  F. Zernike How I discovered phase contrast. , 1955, Science.

[2]  Takeo Kanade,et al.  Nonnegative Mixed-Norm Preconditioning for Microscopy Image Segmentation , 2009, IPMI.

[3]  Dani Lischinski,et al.  A Closed-Form Solution to Natural Image Matting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.

[5]  W. Welford Principles of optics (5th Edition): M. Born, E. Wolf Pergamon Press, Oxford, 1975, pp xxviii + 808, £9.50 , 1975 .

[6]  E. H. Linfoot Principles of Optics , 1961 .

[7]  Vincent Lepetit,et al.  General constraints for batch Multiple-Target Tracking applied to large-scale videomicroscopy , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Stephen P. Boyd,et al.  An Interior-Point Method for Large-Scale $\ell_1$-Regularized Least Squares , 2007, IEEE Journal of Selected Topics in Signal Processing.

[9]  Margrit Betke,et al.  Tracking of cell populations to understand their spatio-temporal behavior in response to physical stimuli , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[10]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Takeo Kanade,et al.  Cell population tracking and lineage construction with spatiotemporal context , 2008, Medical Image Anal..

[12]  Daniel D. Lee,et al.  Multiplicative Updates for Nonnegative Quadratic Programming , 2007, Neural Computation.

[13]  R. Smith,et al.  Linear Systems, Fourier Transforms and Optics , 1979 .

[14]  Milan Sonka,et al.  Cell Segmentation, Tracking, and Mitosis Detection Using Temporal Context , 2005, MICCAI.

[15]  Guido Gerig,et al.  Medical Image Computing and Computer-Assisted Intervention - MICCAI 2005, 8th International Conference, Palm Springs, CA, USA, October 26-29, 2005, Proceedings, Part I , 2005, MICCAI.

[16]  Kenong Wu,et al.  Live cell image segmentation , 1995, IEEE Transactions on Biomedical Engineering.