Information theory based estimator of the number of sources in a sparse linear mixing model

In this paper we present an Information theoretic estimator for the number of sources mutually disjoint in a linear mixing model. The approach follows the Minimum Description Length prescription and is roughly equal to the sum of negative normalized maximum log-likelihood and the logarithm of number of sources. Preliminary numerical evidence supports this approach and compares favorably to both the Akaike (AIC) and Bayesian (BIC) Information Criteria.

[1]  Radu V. Balan,et al.  Estimator for Number of Sources Using Minimum Description Length Criterion for Blind Sparse Source Mixtures , 2007, ICA.

[2]  Justinian P. Rosca,et al.  Scalable non-square blind source separation in the presence of noise , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[3]  Justinian P. Rosca,et al.  REAL-TIME TIME-FREQUENCY BASED BLIND SOURCE SEPARATION , 2001 .

[4]  Fabian J. Theis,et al.  Sparse component analysis and blind source separation of underdetermined mixtures , 2005, IEEE Transactions on Neural Networks.

[5]  Scott Rickard,et al.  BLIND SOURCE SEPARATION BASED ON SPACE-TIME-FREQUENCY DIVERSITY , 2003 .

[6]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[7]  S. Rickard,et al.  NON-SQUARE BLIND SOURCE SEPARATION UNDER COHERENT NOISE BY BEAMFORMING AND TIME-FREQUENCY MASKING , 2002 .

[8]  Yuanqing Li,et al.  Beyond ICA: robust sparse signal representations , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[9]  R. Balan,et al.  MAP Source Separation using Belief Propagation Networks , 2006, 2006 Fortieth Asilomar Conference on Signals, Systems and Computers.

[10]  Justinian P. Rosca,et al.  Generalized sparse signal mixing model and application to noisy blind source separation , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[11]  Andrzej Cichocki,et al.  Adaptive Blind Signal and Image Processing - Learning Algorithms and Applications , 2002 .

[12]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[13]  Andrzej Cichocki,et al.  Adaptive blind signal and image processing , 2002 .

[14]  H. Akaike.  A new look at the statistical model identification , 1974 .

[15]  Justinian P. Rosca,et al.  Convolutive Demixing with Sparse Discrete Prior Models for Markov Sources , 2006, ICA.

[16]  Moeness G. Amin,et al.  Blind source separation based on time-frequency signal representations , 1998, IEEE Trans. Signal Process..

[17]  Jorma Rissanen,et al.  The Minimum Description Length Principle in Coding and Modeling , 1998, IEEE Trans. Inf. Theory.

[18]  S. Rickard,et al.  DESPRIT - histogram based blind source separation of more sources than sensors using subspace methods , 2005, IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, 2005..