Video Object Segmentation with a Potts Model

This paper presents a probabilistic graphical model, a Potts model with external fields, to solve a challenging video object segmentation problem. The video image is represented with a weighted graph. A dynamic Potts model with external fields is used to store the probability distribution of the image pixels. The external fields are important for weighting terms in mixture distributions and thus allow more flexible and robust image segmentation. An online expectation-maximization (EM) algorithm is developed to estimate the parameters of the model. Experimental results on different video clips show the proposed approach is capable of retrieving different objects such as cars, planes, animals and human beings effectively.

[1]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Zhuowen Tu,et al.  Image Segmentation by Data-Driven Markov Chain Monte Carlo , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Judea Pearl,et al.  Reverend Bayes on Inference Engines: A Distributed Hierarchical Approach , 1982, AAAI.

[4]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Gilles Celeux,et al.  EM procedures using mean field-like approximations for Markov model-based image segmentation , 2003, Pattern Recognit..

[6]  Wang,et al.  Nonuniversal critical dynamics in Monte Carlo simulations. , 1987, Physical review letters.

[7]  Alan L. Yuille,et al.  Region Competition: Unifying Snakes, Region Growing, and Bayes/MDL for Multiband Image Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  R. B. Potts.  Some generalized order-disorder transformations , 1952, Mathematical Proceedings of the Cambridge Philosophical Society.

[9]  W. Freeman,et al.  Generalized Belief Propagation , 2000, NIPS.

[10]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[11]  Ben Taskar,et al.  Discriminative learning of Markov random fields for segmentation of 3D scan data , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[12]  William T. Freeman,et al.  Constructing free-energy approximations and generalized belief propagation algorithms , 2005, IEEE Transactions on Information Theory.

[13]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Paul W. Fieguth,et al.  Hierarchical Region Mean-Based Image Segmentation , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[16]  A Fast and Robust Cluster Update Algorithm for Image Segmentation in Spin-Lattice Models Without AnnealingVisual Latencies Revisited , 1998, Neural Computation.

[17]  F. Y. Wu.  The Potts model , 1982 .

[18]  Florentin Wörgötter,et al.  A Fast And Robust Cluster Update Algorithm For Image Segmentation In Spin-Lattice Models Without Annealing - Visual Latencies Revisited , 1998, Neural Comput..

[19]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[20]  Michael I. Jordan,et al.  Probabilistic models of text and images , 2004 .

[21]  Adrian Barbu,et al.  Generalizing Swendsen-Wang to sampling arbitrary posterior probabilities , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.