Independent factor discriminant analysis

In the general classification context the recourse to the so-called Bayes decision rule requires to estimate the class conditional probability density functions. A mixture model for the observed variables which is derived by assuming that the data have been generated by an independent factor model is proposed. Independent factor analysis is in fact a generative latent variable model whose structure closely resembles the one of the ordinary factor model, but it assumes that the latent variables are mutually independent and not necessarily Gaussian. The method therefore provides a dimension reduction together with a semiparametric estimate of the class conditional probability density functions. This density approximation is plugged into the classic Bayes rule and its performance is evaluated both on real and simulated data.

[1]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[2]  R. Tibshirani,et al.  Flexible Discriminant Analysis by Optimal Scoring , 1994 .

[3]  Geoffrey J. McLachlan,et al.  Extension of the mixture of factor analyzers model to incorporate the multivariate t-distribution , 2007, Comput. Stat. Data Anal..

[4]  David J. Hand,et al.  Discrimination and Classification , 1982 .

[5]  R. Tibshirani,et al.  Penalized Discriminant Analysis , 1995 .

[6]  C. Viroli,et al.  Finding Relevant Linear Manifolds in Classification by Gaussian Mixtures , 2008 .

[7]  Tony Jebara,et al.  Probability Product Kernels , 2004, J. Mach. Learn. Res..

[8]  Cinzia Viroli,et al.  Choosing the number of factors in independent factor analysis model , 2005, Advances in Methodology and Statistics.

[9]  Hagai Attias,et al.  Independent Factor Analysis , 1999, Neural Computation.

[10]  Marco Alfò,et al.  Advances in Mixture Models , 2007, Comput. Stat. Data Anal..

[11]  Eric Moulines,et al.  Maximum likelihood for blind separation and deconvolution of noisy signals using mixture models , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[12]  Geoffrey J. McLachlan,et al.  A mixture model-based approach to the clustering of microarray expression data , 2002, Bioinform..

[13]  Geoffrey J. McLachlan,et al.  Mixtures of Factor Analyzers , 2000, International Conference on Machine Learning.

[14]  E. Oja,et al.  Independent Component Analysis , 2013 .

[15]  R. Tibshirani,et al.  Discriminant Analysis by Gaussian Mixtures , 1996 .

[16]  Geoffrey J. McLachlan,et al.  Modelling high-dimensional data by mixtures of factor analyzers , 2003, Comput. Stat. Data Anal..

[17]  A. Raftery,et al.  Model-based Gaussian and non-Gaussian clustering , 1993 .

[18]  Jj Org Polzehl,et al.  Projection Pursuit Discriminant Analysis , 1993 .

[19]  P. Deb.  Finite Mixture Models , 2008 .

[20]  Adrian E. Raftery,et al.  Model-Based Clustering, Discriminant Analysis, and Density Estimation , 2002 .

[21]  Donald B. Rubin,et al.  Max-imum Likelihood from Incomplete Data , 1972 .

[22]  P. J. Green,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[23]  Angela Montanari,et al.  The independent factor analysis approach to latent variable modelling , 2010 .

[24]  Daniela G. Calò,et al.  Gaussian mixture model classification: A projection pursuit approach , 2007, Comput. Stat. Data Anal..

[25]  Wilfried Seidel,et al.  Editorial: recent developments in mixture models , 2003, Comput. Stat. Data Anal..

[26]  David J. Hand,et al.  Kernel Discriminant Analysis , 1983 .