An evolving MoG for online image sequence segmentation

When segmenting image sequences, it is important to ensure the coherency of the produced segments across successive frames. In this paper, we present a method for evolving a Mixture of Gaussian (MoG) to produce such coherent segments. Using a MoG allows us to select the number of components automatically and in a principled way. The parameters of the evolving MoG can vary smoothly to track online the continuous evolution of the feature's distribution. In addition, the complexity of the MoG can vary to cope with incoming or disappearing objects in the sequence. The method is tested on several video sequences and the results are compared to another method, which shows the advantage of the ability to change the number of components automatically for tracking changes in the scene.

[1]  Jitendra Malik,et al.  Motion segmentation and tracking using normalized cuts , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[2]  Daniel DeMenthon,et al.  A Survey of Spatio-Temporal Grouping Techniques , 2002 .

[3]  Pietro Perona,et al.  Non-Parametric Probabilistic Image Segmentation , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[4]  Hayit Greenspan,et al.  Context-based segmentation of image sequences , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Pushmeet Kohli,et al.  Dynamic Graph Cuts for Efficient Inference in Markov Random Fields , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Yulia Hicks,et al.  Applying incremental learning to parallel image segmentation , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[7]  Zhiwu Lu,et al.  Unsupervised learning of finite mixtures using entropy regularization and its application to image segmentation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Dimitris N. Metaxas,et al.  ]Video object segmentation by hypergraph cut , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Anil K. Jain,et al.  Unsupervised Learning of Finite Mixture Models , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Nuno Vasconcelos,et al.  Learning Mixture Hierarchies , 1998, NIPS.