Learning-based interactive segmentation using the maximum mean cycle weight formalism

The maximum mean cycle weight (MMCW) segmentation framework is a graph-based alternative to approaches such as GraphCut or Markov Random Fields. It offers time- and space-efficient computation and guaranteed optimality. However, unlike GraphCut or Markov Random Fields, MMCW does not seek to segment the entire image, but rather to find the single best object within the image, according to an objective function encoded by edge weights. Its focus on a single, best object makes MMCW attractive to interactive segmentation settings, where the user indicates which objects are to be segmented. However, a provably correct way of performing interactive segmentation using the MMCW framework has never been established. Further, the question of how to develop a good objective function based on user-provided information has never been addressed. Here, we propose a three-component objective function specifically designed for use with interactive MMCW segmentation. Two of those components, representing object boundary and object interior information, can be learned from a modest amount of user-labelled data, but in a way unique to the MMCW framework. The third component allows us to extend the MMCW framework to the situation of interactive segmentation. Specifically, we show that an appropriate weighted combination of the three components guarantees that the object produced by MMCW segmentation will enclose user-specified pixels that can be chosen interactively. The component weights can either be computed a priori based on image characteristics, or online via an adaptive reweighting scheme. We demonstrate the success of the approach on several microscope image segmentation problems.

[1]  Richard M. Karp,et al.  A characterization of the minimum cycle mean in a digraph , 1978, Discret. Math..

[2]  Sankar K. Pal,et al.  A review on image segmentation techniques , 1993, Pattern Recognit..

[3]  Stan Z. Li,et al.  Markov Random Field Modeling in Computer Vision , 1995, Computer Science Workbench.

[4]  William A. Barrett,et al.  Interactive Segmentation with Intelligent Scissors , 1998, Graph. Model. Image Process..

[5]  Ali Dasdan,et al.  An Experimental Study of Minimum Mean Cycle Algorithms , 1998 .

[6]  Rajesh K. Gupta,et al.  Faster maximum and minimum mean cycle algorithms for system-performance analysis , 1998, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[7]  Ian H. Jermyn,et al.  Globally optimal regions and boundaries , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[8]  Jianbo Shi,et al.  Learning Segmentation by Random Walks , 2000, NIPS.

[9]  S. Osher,et al.  Level set methods: an overview and some recent results , 2001 .

[10]  Yongmin Kim,et al.  Active contour model with gradient directional information: directional snake , 2001, IEEE Trans. Circuits Syst. Video Technol..

[11]  Ian H. Jermyn,et al.  Globally Optimal Regions and Boundaries as Minimum Ratio Weight Cycles , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Nikos Paragios,et al.  Shape Priors for Level Set Representations , 2002, ECCV.

[14]  Jeffrey Mark Siskind,et al.  Image Segmentation with Ratio Cut , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Martial Hebert,et al.  Discriminative random fields: a discriminative framework for contextual interaction in classification , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[16]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Miguel Á. Carreira-Perpiñán,et al.  Multiscale conditional random fields for image labeling , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[18]  Yunmei Chen,et al.  Using Prior Shapes in Geometric Active Contours in a Variational Framework , 2002, International Journal of Computer Vision.

[19]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[20]  Vladimir Vezhnevets,et al.  “GrowCut” - Interactive Multi-Label N-D Image Segmentation By Cellular Automata , 2005 .

[21]  Zhuowen Tu,et al.  Supervised Learning of Edges and Object Boundaries , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[22]  Daniel Cremers,et al.  Introducing Curvature into Globally Optimal Image Segmentation: Minimum Ratio Cycles on Product Graphs , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[23]  Jitendra Malik,et al.  Using contours to detect and localize junctions in natural images , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Martial Hebert,et al.  Discriminative Sparse Image Models for Class-Specific Edge Detection and Image Interpretation , 2008, ECCV.

[25]  Neeraj Sharma,et al.  Automated medical image segmentation techniques , 2010, Journal of medical physics.

[26]  Srinivas C. Turaga,et al.  Machines that learn to segment images: a crucial technology for connectomics , 2010, Current Opinion in Neurobiology.

[27]  R. Gentleman,et al.  Differential genomic targeting of the transcription factor TAL1 in alternate haematopoietic lineages , 2010, The EMBO journal.

[28]  Ullrich Köthe,et al.  Probabilistic image segmentation with closedness constraints , 2011, 2011 International Conference on Computer Vision.

[29]  Theodore J. Perkins,et al.  FiloDetect: automatic detection of filopodia from fluorescence microscopy images , 2013, BMC Systems Biology.

[30]  Erik H. W. Meijering,et al.  Cell Segmentation: 50 Years Down the Road [Life Sciences] , 2012, IEEE Signal Processing Magazine.

[31]  Scott T. Acton,et al.  Seeing through clutter: Snake computation with dynamic programming for particle segmentation , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[32]  Theodore J. Perkins,et al.  Learning a cost function for microscope image segmentation , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[33]  Theodore J. Perkins,et al.  Learning to Detect Contours with Dynamic Programming Snakes , 2014, 2014 22nd International Conference on Pattern Recognition.

[34]  Junaed Sattar Snakes , Shapes and Gradient Vector Flow , 2022 .