Distribution Matching with the Bhattacharyya Similarity: A Bound Optimization Framework

We present efficient graph cut algorithms for three problems: (1) finding a region in an image, so that the histogram (or distribution) of an image feature within the region most closely matches a given model; (2) co-segmentation of image pairs and (3) interactive image segmentation with a user-provided bounding box. Each algorithm seeks the optimum of a global cost function based on the Bhattacharyya measure, a convenient alternative to other matching measures such as the Kullback-Leibler divergence. Our functionals are not directly amenable to graph cut optimization as they contain non-linear functions of fractional terms, which make the ensuing optimization problems challenging. We first derive a family of parametric bounds of the Bhattacharyya measure by introducing an auxiliary labeling. Then, we show that these bounds are auxiliary functions of the Bhattacharyya measure, a result which allows us to solve each problem efficiently via graph cuts. We show that the proposed optimization procedures converge within very few graph cut iterations. Comprehensive and various experiments, including quantitative and comparative evaluations over two databases, demonstrate the advantages of the proposed algorithms over related works in regard to optimality, computational load, accuracy and flexibility.

[1]  Vladimir Kolmogorov,et al.  Optimizing Binary MRFs via Extended Roof Duality , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Nikos Paragios,et al.  Handbook of Mathematical Models in Computer Vision , 2005 .

[3]  Siqi Chen,et al.  Level set segmentation with both shape and intensity priors , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[4]  Minsu Cho,et al.  Co-recognition of Image Pairs by Data-Driven Monte Carlo Image Exploration , 2008, ECCV.

[5]  Vladimir Kolmogorov,et al.  Minimizing Nonsubmodular Functions with Graph Cuts-A Review , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Josiane Zerubia,et al.  Detection of Object Motion Regions in Aerial Image Pairs With a Multilayer Markovian Model , 2009, IEEE Transactions on Image Processing.

[7]  Shuo Li,et al.  A Statistical Overlap Prior for Variational Image Segmentation , 2009, International Journal of Computer Vision.

[8]  Max Mignotte,et al.  A Label Field Fusion Bayesian Model and Its Penalized Maximum Rand Estimator for Image Segmentation , 2010, IEEE Transactions on Image Processing.

[9]  Jean Ponce,et al.  Discriminative clustering for image co-segmentation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Hao Jiang Linear solution to scale invariant global figure ground separation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Naoya Ohta,et al.  A statistical approach to background subtraction for surveillance systems , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[12]  BoykovYuri,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006 .

[13]  Takeshi Naemura,et al.  Image Segmentation using Dual Distribution Matching , 2012, BMVC.

[14]  Nikos Komodakis,et al.  MRF Energy Minimization and Beyond via Dual Decomposition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[16]  Arie Hordijk,et al.  Time-discretization for controlled Markov processes. I. General approximation results , 1996, Kybernetika (Praha).

[17]  Tsuhan Chen,et al.  Clothing cosegmentation for recognizing people , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Vladimir Kolmogorov,et al.  Visual correspondence using energy minimization and mutual information , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[19]  Shuo Li,et al.  Graph cut segmentation with a global constraint: Recovering region distribution via a bound of the Bhattacharyya measure , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Andrew Blake,et al.  Cosegmentation of Image Pairs by Histogram Matching - Incorporating a Global Constraint into MRFs , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[21]  Takeshi Naemura,et al.  Foreground-background segmentation using iterated distribution matching , 2011, CVPR 2011.

[22]  Neil A. Thacker,et al.  The Bhattacharyya metric as an absolute similarity measure for frequency coded data , 1998, Kybernetika.

[23]  Olivier D. Faugeras,et al.  Image Segmentation Using Active Contours: Calculus of Variations or Shape Gradients? , 2003, SIAM J. Appl. Math..

[24]  F FelzenszwalbPedro,et al.  Efficient Graph-Based Image Segmentation , 2004 .

[25]  Aaron D. Ward,et al.  Segmentation with Non-linear Regional Constraints via Line-Search Cuts , 2012, ECCV.

[26]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[27]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[28]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  VekslerOlga,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001 .

[30]  Endre Boros,et al.  Pseudo-Boolean optimization , 2002, Discret. Appl. Math..

[31]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[32]  Tao Zhang,et al.  Active contours for tracking distributions , 2004, IEEE Transactions on Image Processing.

[33]  Lena Gorelick,et al.  GrabCut in One Cut , 2013, 2013 IEEE International Conference on Computer Vision.

[34]  Olga Veksler,et al.  Graph Cuts in Vision and Graphics: Theories and Applications , 2006, Handbook of Mathematical Models in Computer Vision.

[35]  Patrick Pérez,et al.  Detection and segmentation of moving objects in highly dynamic scenes , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Yogesh Rathi,et al.  Multi-Object Tracking Through Clutter Using Graph Cuts , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[37]  Lena Gorelick,et al.  Fast Trust Region for Segmentation , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Luc Van Gool,et al.  Transductive object cutout , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  Vladimir Kolmogorov,et al.  Joint optimization of segmentation and appearance models , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[40]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[41]  Shuo Li,et al.  Graph Cuts with Invariant Object-Interaction Priors: Application to Intervertebral Disc Segmentation , 2011, IPMI.

[42]  Yingli Lu,et al.  Left Ventricle Tracking Using Overlap Priors , 2008, MICCAI.

[43]  Jiebo Luo,et al.  iCoseg: Interactive co-segmentation with intelligent scribble guidance , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[44]  Pushmeet Kohli,et al.  Simultaneous Segmentation and Pose Estimation of Humans Using Dynamic Graph Cuts , 2008, International Journal of Computer Vision.

[45]  Shuo Li,et al.  Embedding Overlap Priors in Variational Left Ventricle Tracking , 2009, IEEE Transactions on Medical Imaging.

[46]  Carsten Rother,et al.  FusionFlow: Discrete-continuous optimization for optical flow estimation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[47]  Vladimir Kolmogorov,et al.  Cosegmentation Revisited: Models and Optimization , 2010, ECCV.

[48]  Toby Sharp,et al.  Image segmentation with a bounding box prior , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[49]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[50]  Shuo Li,et al.  Detection of Left Ventricular Motion Abnormality Via Information Measures and Bayesian Filtering , 2010, IEEE Transactions on Information Technology in Biomedicine.

[51]  Vikas Singh,et al.  An efficient algorithm for Co-segmentation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[52]  Amar Mitiche,et al.  Variational and Level Set Methods in Image Segmentation , 2010 .

[53]  Vikas Singh,et al.  Half-integrality based algorithms for cosegmentation of images , 2009, CVPR.

[54]  Marie-Pierre Jolly,et al.  Interactive Graph Cuts for Optimal Boundary and Region Segmentation of Objects in N-D Images , 2001, ICCV.

[55]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[56]  Alexei A. Efros,et al.  Using Multiple Segmentations to Discover Objects and their Extent in Image Collections , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[57]  Ehud Rivlin,et al.  On Scene Segmentation and Histograms-Based Curve Evolution , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[58]  Yogesh Rathi,et al.  Image Segmentation Using Active Contours Driven by the Bhattacharyya Gradient Flow , 2007, IEEE Transactions on Image Processing.