Human Action Recognition Using Accelerated Variational Learning of Infinite Dirichlet Mixture Models

Exploiting Dirichlet process mixture models (also known as infinite mixture models) to model visual and textual data is now standard weapon in the arsenal of machine learning. This paper proposes a new accelerated variational inference approach to learn Dirichlet process mixture models with Dirichlet distributions. The choice of using Dirichlet distribution as the basic distribution is mainly due to its flexibility for modeling proportional data. Indeed, this kind of data is naturally generated by several applications involving the representation of texts, images and videos using the bag-of-words (or "visual words" in the case of images and videos) approach. The potential of the developed learning framework is shown using a challenging real application namely human action recognition in videos.

[1]  Nizar Bouguila,et al.  Variational learning for Dirichlet process mixtures of Dirichlet distributions and applications , 2012, Multimedia Tools and Applications.

[2]  Nizar Bouguila,et al.  Unsupervised learning of a finite mixture model based on the Dirichlet distribution and its application , 2004, IEEE Transactions on Image Processing.

[3]  Nizar Bouguila,et al.  MML-Based Approach for Finite Dirichlet Mixture Estimation and Selection , 2005, MLDM.

[4]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.

[5]  Carl E. Rasmussen,et al.  The Infinite Gaussian Mixture Model , 1999, NIPS.

[6]  Ivan Laptev,et al.  On Space-Time Interest Points , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[7]  R. M. Korwar,et al.  Contributions to the Theory of Dirichlet Processes , 1973 .

[8]  Nizar Bouguila,et al.  Infinite Dirichlet Mixture Model and Its Application via Variational Bayes , 2011, 2011 10th International Conference on Machine Learning and Applications and Workshops.

[9]  Thomas Serre,et al.  HMDB: A large video database for human motion recognition , 2011, 2011 International Conference on Computer Vision.

[10]  Nizar Bouguila,et al.  Variational Learning for Finite Dirichlet Mixture Models and Applications , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[11]  Nizar Bouguila,et al.  Bayesian Learning of Generalized Gaussian Mixture Models on Biomedical Images , 2010, ANNPR.

[12]  P. Deb.  Finite Mixture Models , 2008 .

[13]  Nizar Bouguila,et al.  Online variational finite Dirichlet mixture model and its applications , 2012, 2012 11th International Conference on Information Science, Signal Processing and their Applications (ISSPA).

[14]  Nizar Bouguila,et al.  A probabilistic approach for shadows modeling and detection , 2005, IEEE International Conference on Image Processing 2005.

[15]  N. Bouguila,et al.  A Dirichlet process mixture of dirichlet distributions for classification and prediction , 2008, 2008 IEEE Workshop on Machine Learning for Signal Processing.

[16]  Thomas Hofmann,et al.  Unsupervised Learning by Probabilistic Latent Semantic Analysis , 2004, Machine Learning.

[17]  Adrian Corduneanu,et al.  Variational Bayesian Model Selection for Mixture Distributions , 2001 .

[18]  Hoon Kim,et al.  Monte Carlo Statistical Methods , 2000, Technometrics.

[19]  Cordelia Schmid,et al.  Learning realistic human actions from movies , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  D. Ziou,et al.  A powerful finite mixture model based on the generalized Dirichlet distribution: unsupervised learning and applications , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[21]  J. Sethuraman.  A CONSTRUCTIVE DEFINITION OF DIRICHLET PRIORS , 1991 .

[22]  Nizar Bouguila,et al.  A Variational Statistical Framework for Object Detection , 2011, ICONIP.

[23]  Nizar Bouguila,et al.  On Fitting Finite Dirichlet Mixture Using ECM and MML , 2005, ICAPR.

[24]  Hagai Attias,et al.  A Variational Bayesian Framework for Graphical Models , 1999 .

[25]  Michael I. Jordan,et al.  Variational inference for Dirichlet process mixtures , 2006 .

[26]  Max Welling,et al.  Accelerated Variational Dirichlet Process Mixtures , 2006, NIPS.

[27]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.