Interactive Cell Segmentation Based on Active and Semi-Supervised Learning

Automatic cell segmentation can hardly be flawless due to the complexity of image data particularly when time-lapse experiments last for a long time without biomarkers. To address this issue, we propose an interactive cell segmentation method by classifying feature-homogeneous superpixels into specific classes, which is guided by human interventions. Specifically, we propose to actively select the most informative superpixels by minimizing the expected prediction error which is upper bounded by the transductive Rademacher complexity, and then query for human annotations. After propagating the user-specified labels to the remaining unlabeled superpixels via an affinity graph, the error-prone superpixels are selected automatically and request for human verification on them; once erroneous segmentation is detected and subsequently corrected, the information is propagated efficiently over a gradually-augmented graph to un-labeled superpixels such that the analogous errors are fixed meanwhile. The correction propagation step is efficiently conducted by introducing a verification propagation matrix rather than rebuilding the affinity graph and re-performing the label propagation from the beginning. We repeat this procedure until most superpixels are classified into a specific category with high confidence. Experimental results performed on three types of cell populations validate that our interactive cell segmentation algorithm quickly reaches high quality results with minimal human interventions and is significantly more efficient than alternative methods, since the most informative samples are selected for human annotation/verification early.

[1]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[2]  Julian Yarkony,et al.  Cell Detection and Segmentation Using Correlation Clustering , 2014, MICCAI.

[3]  Peter L. Bartlett,et al.  Rademacher and Gaussian Complexities: Risk Bounds and Structural Results , 2003, J. Mach. Learn. Res..

[4]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[5]  Leo Grady,et al.  Segmentation from a box , 2011, 2011 International Conference on Computer Vision.

[6]  Takeo Kanade,et al.  Cell segmentation in phase contrast microscopy images via semi-supervised classification over optics-related features , 2013, Medical Image Anal..

[7]  Takeo Kanade,et al.  Cell segmentation via spectral analysis on phase retardation features , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[8]  Guillermo Sapiro,et al.  A Geodesic Framework for Fast Interactive Image and Video Segmentation and Matting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[9]  Jianxin Wu,et al.  Finding Coherent Motions and Semantic Regions in Crowd Scenes: A Diffusion and Clustering Approach , 2014, ECCV.

[10]  Yuting Su,et al.  Sparse coding induced transfer learning for HEp-2 cell classification. , 2014, Bio-medical materials and engineering.

[11]  Wei Liu,et al.  Robust multi-class transductive learning with graphs , 2009, CVPR.

[12]  Xiaobo Zhou,et al.  Cell Segmentation Using Front Vector Flow Guided Active Contours , 2009, MICCAI.

[13]  Margrit Betke,et al.  Tracking of cell populations to understand their spatio-temporal behavior in response to physical stimuli , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[14]  Jiawei Han,et al.  A Variance Minimization Criterion to Active Learning on Graphs , 2012, AISTATS.

[15]  A. Mogilner,et al.  Analysis of actin dynamics at the leading edge of crawling cells: implications for the shape of keratocyte lamellipodia , 2003, European Biophysics Journal.

[16]  Takeo Kanade,et al.  Interactive cell segmentation based on correction propagation , 2014, 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI).

[17]  Zoubin Ghahramani,et al.  Combining active learning and semi-supervised learning using Gaussian fields and harmonic functions , 2003, ICML 2003.

[18]  Ullrich Köthe,et al.  Seeded watershed cut uncertainty estimators for guided interactive segmentation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Takeo Kanade,et al.  Understanding the phase contrast optics to restore artifact-free microscopy images for segmentation , 2012, Medical Image Anal..

[20]  Takeo Kanade,et al.  Nonnegative Mixed-Norm Preconditioning for Microscopy Image Segmentation , 2009, IPMI.

[21]  Takeo Kanade,et al.  A Semi-Markov Model for Mitosis Segmentation in Time-Lapse Phase Contrast Microscopy Image Sequences of Stem Cell Populations , 2012, IEEE Transactions on Medical Imaging.

[22]  G. Sohie,et al.  Generalization of the matrix inversion lemma , 1986, Proceedings of the IEEE.

[23]  Alper Yilmaz,et al.  Image Segmentation as Learning on Hypergraphs , 2008, 2008 Seventh International Conference on Machine Learning and Applications.

[24]  Zhaozheng Yin,et al.  Co-restoring Multimodal Microscopy Images , 2015, MICCAI.

[25]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[26]  Paul Fieguth,et al.  Watershed deconvolution for cell segmentation , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[27]  Camille Couprie,et al.  Power Watershed: A Unifying Graph-Based Optimization Framework , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Wenxian Yang,et al.  User-Friendly Interactive Image Segmentation Through Unified Combinatorial User Inputs , 2010, IEEE Transactions on Image Processing.

[29]  Andrew Zisserman,et al.  Detecting overlapping instances in microscopy images using extremal region trees , 2016, Medical Image Anal..

[30]  Yuting Su,et al.  Sequential sparse representation for mitotic event recognition , 2013 .

[31]  Jens Rittscher,et al.  Spatio-temporal cell cycle phase analysis using level sets and fast marching methods , 2009, Medical Image Anal..

[32]  Qiang Ji,et al.  A Bayesian Network Model for Automatic and Interactive Image Segmentation , 2011, IEEE Transactions on Image Processing.

[33]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[34]  Takeo Kanade,et al.  Phase Contrast Image Restoration via Dictionary Representation of Diffraction Patterns , 2012, MICCAI.

[35]  Xiaobo Zhou,et al.  Segmentation of Drosophila RNAI Fluorescence Images Using Level Sets , 2006, 2006 International Conference on Image Processing.

[36]  J. Lafferty,et al.  Combining active learning and semi-supervised learning using Gaussian fields and harmonic functions , 2003, ICML 2003.

[37]  Ran El-Yaniv,et al.  Transductive Rademacher Complexity and Its Applications , 2007, COLT.

[38]  I. Sbalzarini,et al.  High‐resolution cell outline segmentation and tracking from phase‐contrast microscopy images , 2012, Journal of microscopy.

[39]  Brian L. Price,et al.  Geodesic graph cut for interactive image segmentation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[40]  BoykovYuri,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006 .

[41]  Camille Couprie,et al.  Power watersheds: A new image segmentation framework extending graph cuts, random walker and optimal spanning forest , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[42]  Takeo Kanade,et al.  Restoring DIC Microscopy Images from Multiple Shear Directions , 2011, IPMI.

[43]  Haohan Li,et al.  Cell-Sensitive Microscopy Imaging for Cell Image Segmentation , 2014, MICCAI.

[44]  Yuting Su,et al.  Nonnegative Mixed-Norm Convex Optimization for Mitotic Cell Detection in Phase Contrast Microscopy , 2013, Comput. Math. Methods Medicine.

[45]  Haohan Li,et al.  Cell-sensitive phase contrast microscopy imaging by multiple exposures , 2015, Medical Image Anal..

[46]  Takeo Kanade,et al.  Apoptosis Detection for Adherent Cell Populations in Time-Lapse Phase-Contrast Microscopy Images , 2012, MICCAI.

[47]  Ran El-Yaniv,et al.  Transductive Rademacher Complexity and Its Applications , 2007, COLT.

[48]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Toby Sharp,et al.  Image segmentation with a bounding box prior , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[50]  Jitendra Malik,et al.  Learning a classification model for segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.