Submitteed to the International Conference on Independent Component Analysis and Blind Signal Separation ( ICA 2001 ) ADAPTIVE LATERAL INHIBITION FOR NON-NEGATIVE ICA

We consider the problem of decomposing an observed input matrix (or vector sequence) into the product of a mixing matrix with a component matrix , i.e. , where (a) the elements of the mixing matrix and the component matrix are non-negative, and (b) the underlying components are considered to be observations from an independent source. This is therefore a problem of non-negative independent component analysis. Under certain reasonable conditions, it appears to be sufficient simply to ensure that the output matrix has diagonal covariance (in addition to the non-negativity constraints) to find the independent basis. Neither higher-order statistics nor temporal correlations are required. The solution is implemented as a neural network with error-correcting forward/backward weights and linear anti-Hebbian lateral inhibition, and is demonstrated on small artificial data sets including a linear version of the Bars problem.

[1]  Peter Földiák,et al.  Adaptation and decorrelation in the cortex , 1989 .

[2]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[3]  Mark D. Plumbley.  A Hebbian/anti-Hebbian network which optimizes information capacity by orthonormalizing the principal subspace , 1993 .

[4]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[5]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[6]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[7]  Eric Saund,et al.  A Multiple Cause Mixture Model for Unsupervised Learning , 1995, Neural Computation.

[8]  H. Sebastian Seung,et al.  Unsupervised Learning by Convex and Conic Coding , 1996, NIPS.

[9]  George Francis Harpur,et al.  Low Entropy Coding with Unsupervised Neural Networks , 1997 .

[10]  D Charles,et al.  Modelling multiple-cause structure using rectification constraints. , 1998, Network.

[11]  Michael W. Spratling,et al.  Pre-synaptic lateral inhibition provides a better architecture for self-organizing neural networks. , 1999, Network.

[12]  Mark D. Plumbley,et al.  Towards musical instrument separation using multiple-cause neural networks , 2000 .

[13]  Aapo Hyvärinen,et al.  A Non-Negative Sparse Coding Network Learns Contour Coding and Integration From Natural Images , 2001 .