Uniqueness of Non-Gaussianity-Based Dimension Reduction

Dimension reduction is a key step in preprocessing large-scale data sets. A recently proposed method named non-Gaussian component analysis searches for a projection onto the non-Gaussian part of a given multivariate recording, which is a generalization of the deflationary projection pursuit model. In this contribution, we discuss the uniqueness of the subspaces of such a projection. We prove that a necessary and sufficient condition for uniqueness is that the non-Gaussian signal subspace is of minimal dimension. Furthermore, we propose a measure for estimating this minimal dimension and illustrate it by numerical simulations. Our result guarantees that projection algorithms uniquely recover the underlying lower dimensional data signals.

[1]  Arnak S. Dalalyan,et al.  A New Algorithm for Estimating the Effective Dimension-Reduction Subspace , 2008, J. Mach. Learn. Res..

[2]  J. Rissanen A UNIVERSAL PRIOR FOR INTEGERS AND ESTIMATION BY MINIMUM DESCRIPTION LENGTH , 1983 .

[3]  José M. P. Nascimento,et al.  Signal subspace identification in hyperspectral imagery , 2012 .

[4]  Motoaki Kawanabe,et al.  Uniqueness of Non-Gaussian Subspace Analysis , 2006, ICA.

[5]  Motoaki Kawanabe,et al.  In Search of Non-Gaussian Components of a High-Dimensional Distribution , 2006, J. Mach. Learn. Res..

[6]  John F. Arnold,et al.  Reliably estimating the noise in AVIRIS hyperspectral images , 1996 .

[7]  H. Akaike A new look at the statistical model identification , 1974 .

[8]  Motoaki Kawanabe,et al.  Linear Dimension Reduction Based on the Fourth-Order Cumulant Tensor , 2005, ICANN.

[9]  Motoaki Kawanabe,et al.  Joint low-rank approximation for extracting non-Gaussian subspaces , 2007, Signal Process..

[10]  Christof Schütte,et al.  Sparse Non-Gaussian Component Analysis , 2010, IEEE Transactions on Information Theory.

[11]  Chein-I Chang,et al.  Estimation of number of spectrally distinct signal sources in hyperspectral imagery , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Motoaki Kawanabe,et al.  Estimating Non-Gaussian Subspaces by Characteristic Functions , 2006, ICA.

[13]  Motoaki Kawanabe,et al.  A new algorithm of non-Gaussian component analysis with radial kernel functions , 2007 .

[14]  Siham Ouamour,et al.  Proposal of a New Confidence Parameter Estimating the Number of Speakers -An experimental investigation- , 2010, J. Inf. Hiding Multim. Signal Process..

[15]  José M. Bioucas-Dias,et al.  Hyperspectral Subspace Identification , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Fabian J. Theis,et al.  Colored Subspace Analysis: Dimension Reduction Based on a Signal's Autocorrelation Structure , 2010, IEEE Transactions on Circuits and Systems I: Regular Papers.