A Fully Bayesian Infinite Generative Model for Dynamic Texture Segmentation

Generative dynamic texture models (GDTMs) are widely used for dynamic texture (DT) segmentation in the video sequences. GDTMs represent DTs as a set of linear dynamical systems (LDSs). A major limitation of these models concerns the automatic selection of a proper number of DTs. Dirichlet process mixture (DPM) models which have appeared recently as the cornerstone of the non-parametric Bayesian statistics, is an optimistic candidate toward resolving this issue. Under this motivation to resolve the aforementioned drawback, we propose a novel non-parametric fully Bayesian approach for DT segmentation, formulated on the basis of a joint DPM and GDTM construction. This interaction causes the algorithm to overcome the problem of automatic segmentation properly. We derive the Variational Bayesian Expectation-Maximization (VBEM) inference for the proposed model. Moreover, in the E-step of inference, we apply Rauch-Tung-Striebel smoother (RTSS) algorithm on Variational Bayesian LDSs. Ultimately, experiments on different video sequences are performed. Experiment results indicate that the proposed algorithm outperforms the previous methods in efficiency and accuracy noticeably.

[1]  René Vidal,et al.  Segmenting Dynamic Textures with Ising Descriptors, ARX Models and Level Sets , 2006, WDV.

[2]  Odemir Martinez Bruno,et al.  Dynamic texture segmentation based on deterministic partially self-avoiding walks , 2013, Comput. Vis. Image Underst..

[3]  B. Julesz.  Textons, the elements of texture perception, and their interactions , 1981, Nature.

[4]  Vibha Vyas,et al.  Dynamic Texture Segmentation Using Texture Descriptors and Optical Flow Techniques , 2014, FICTA.

[5]  Payam Saisan,et al.  Dynamic texture recognition , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[6]  T. Ferguson.  A Bayesian Analysis of Some Nonparametric Problems , 1973 .

[7]  Nuno Vasconcelos,et al.  Variational layered dynamic textures , 2009, CVPR.

[8]  Matti Pietikäinen,et al.  Unsupervised dynamic texture segmentation using local spatiotemporal descriptors , 2008, 2008 19th International Conference on Pattern Recognition.

[9]  Dmitry Chetverikov,et al.  Dynamic Texture Detection Based on Motion Analysis , 2009, International Journal of Computer Vision.

[10]  Carl E. Rasmussen,et al.  Factorial Hidden Markov Models , 1997 .

[11]  Sotirios Chatzis,et al.  The infinite Hidden Markov random field model , 2009, ICCV.

[12]  Matthew J. Beal.  Variational algorithms for approximate Bayesian inference , 2003 .

[13]  Stefano Soatto,et al.  Dynamic Texture Modeling , 2022 .

[14]  S. Negahdaripour,et al.  Relaxing the Brightness Constancy Assumption in Computing Optical Flow , 1987 .

[15]  Antoni B. Chan,et al.  Joint Motion Segmentation and Background Estimation in Dynamic Scenes , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  J. Sethuraman.  A CONSTRUCTIVE DEFINITION OF DIRICHLET PRIORS , 1991 .

[17]  René Vidal,et al.  A Unified Approach to Segmentation and Categorization of Dynamic Textures , 2010, ACCV.

[18]  Nuno Vasconcelos,et al.  Probabilistic kernels for the classification of auto-regressive visual processes , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[19]  Gui-Song Xia,et al.  Dynamic texture recognition by aggregating spatial and temporal features via ensemble SVMs , 2016, Neurocomputing.

[20]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Carl E. Rasmussen,et al.  Bayesian Monte Carlo , 2002, NIPS.

[22]  D. Blackwell,et al.  Ferguson Distributions Via Polya Urn Schemes , 1973 .

[23]  Oksam Chae,et al.  Spatiotemporal Directional Number Transitional Graph for Dynamic Texture Recognition , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  René Vidal,et al.  Optical flow estimation & segmentation of multiple moving dynamic textures , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[25]  Zhenhua Guo,et al.  Dynamic background estimation and complementary learning for pixel-wise foreground/background segmentation , 2016, Pattern Recognit..

[26]  Dmitry Chetverikov,et al.  A Brief Survey of Dynamic Texture Description and Recognition , 2005, CORES.

[27]  Yinhui Zhang,et al.  Unsupervised segmentation of highly dynamic scenes through global optimization of multiscale cues , 2015, Pattern Recognit..

[28]  Stefano Soatto,et al.  Editable dynamic textures , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[29]  Mark J. Huiskes,et al.  DynTex: A comprehensive database of dynamic textures , 2010, Pattern Recognit. Lett..

[30]  Dmitry Chetverikov,et al.  Detecting Regions of Dynamic Texture , 2007, SSVM.

[31]  Nuno Vasconcelos,et al.  Modeling, Clustering, and Segmenting Video with Mixtures of Dynamic Textures , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Michael I. Jordan,et al.  Variational inference for Dirichlet process mixtures , 2006 .

[33]  Matti Pietikäinen,et al.  Automatic Dynamic Texture Segmentation Using Local Descriptors and Optical Flow , 2013, IEEE Transactions on Image Processing.

[34]  Nuno Vasconcelos,et al.  Layered Dynamic Textures , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Zoubin Ghahramani,et al.  The variational Kalman smoother , 2001 .