An Expectation-Maximization algorithm for the Wishart mixture model: Application to movement clustering

This article presents an Expectation-Maximization algorithm for the Wishart mixture model in which realizations are matrices. Given a set of matrices, an iterative algorithm for estimating the parameters of such a mixture model is proposed. The obtained estimates can be interpreted in terms of mean matrices and scale factors. By applying the maximum a posteriori rule, we get an algorithm for the clustering of a set of matrices. This mixture model is then modified in order to deal with a set of samples. Unfortunately, the samples may be of different sizes. We propose to tackle this problem by considering the cross-product matrix as a signature for each sample. This set of cross-product matrices may be fitted with the proposed Wishart pseudo-mixture model in which the scale parameters of the distribution are not estimated but fixed. Again, we easily get a clustering algorithm from final parameter estimates. The different estimators are studied empirically through an analysis of their bias and variance and are validated onto an artificial dataset. Finally, we apply the Wishart pseudo-mixture model for analyzing motion-captured movements. Given the successive 3D positions of markers over the time, a cross-product matrix is constructed for each movement and put into the proposed classifier. We observe that the recognition rates are higher with our proposed approach than those with other geometric methods. Limits and constraints of the provided models are finally discussed.

[1]  Alejandro C. Frery,et al.  Analyzing Polarimetric Imagery with G 0 p Mixture Models and SEM Algorithm , 2007 .

[2]  Richard A. Harshman,et al.  Foundations of the PARAFAC procedure: Models and conditions for an "explanatory" multi-model factor analysis , 1970 .

[3]  Thomas L. Ainsworth,et al.  Unsupervised classification using polarimetric decomposition and the complex Wishart classifier , 1999, IEEE Trans. Geosci. Remote. Sens..

[4]  J. W. Silverstein The Smallest Eigenvalue of a Large Dimensional Wishart Matrix , 1985 .

[5]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[6]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[7]  Chi Song Wong,et al.  Wishart distributions associated with matrix quadratic forms , 2003 .

[8]  Gérard Govaert,et al.  Gaussian parsimonious clustering models , 1995, Pattern Recognit..

[9]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2003, ICTAI.

[10]  Donald B. Rubin,et al.  Max-imum Likelihood from Incomplete Data , 1972 .

[11]  P. Jehenson,et al.  Discriminant factor analysis of 31p nmr spectroscopic data in myopathies , 1990, Magnetic resonance in medicine.

[12]  Daniel B. Rowe,et al.  Multivariate Bayesian Statistics: Models for Source Separation and Signal Unmixing , 2002 .

[13]  Yicheng Zhang,et al.  On the Anti-Wishart distribution , 2001, cond-mat/0112497.

[14]  Kaare Brandt Petersen,et al.  The Matrix Cookbook , 2006 .

[15]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[16]  Jean-Yves Lafaye,et al.  Discriminant factor anaysis for movement recognition: application to dance , 2006 .

[17]  G. Bogat,et al.  Testing the assumption of multivariate normality. , 2004 .

[18]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[19]  Robert Sabatier,et al.  The ACT (STATIS method) , 1994 .

[20]  I. Jolliffe Principal Component Analysis , 2002 .

[21]  Michael I. Jordan Learning in Graphical Models , 1999, NATO ASI Series.

[22]  Laurent Ferro-Famil,et al.  Unsupervised classification of multifrequency and fully polarimetric SAR images based on the H/A/Alpha-Wishart classifier , 2001, IEEE Trans. Geosci. Remote. Sens..

[23]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Eric Pottier,et al.  Unsupervised classification of complex scenes using polarimetric inteferometric SAR data , 2004 .

[25]  Knut Conradsen,et al.  Evaluation of the Wishart test statistics for polarimetric SAR data , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).