Theories of Neural Networks Leading to Unsupervised Learning

In this paper, we derive an exact single-pixel BSS solution for two components. Furthermore, we prove the solution for n components to be unique and stable by means of the augmented Lagrange or Karush, Kuhn and Tucker methodology [S 07]. Our constant-temperature free energy can estimate the neuronal population of brain's grey matter which is responsible for the consciousness activities identified by Crick & Koch as the Claustrum accomplishing binding among firing rates (similar to C-node tuning in the beginning of an orchestra performance). Furthermore, the retinal neuronal response Mexican hat functions could be explained by finite resource sharing for replenishment.

[1]  Erkki Oja,et al.  Signal Separation by Nonlinear Hebbian Learning , 1995 .

[2]  Shun-ichi Amari,et al.  Recurrent Neural Networks For Blind Separation of Sources , 1995 .

[3]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[4]  Harold H. Szu,et al.  Implicit differential analysis for cortical models , 2007, SPIE Defense + Commercial Sensing.

[5]  Terrence J. Sejnowski,et al.  Unsupervised Learning , 2018, Encyclopedia of GIS.

[6]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[7]  Ivica Kopriva,et al.  Unsupervised learning with stochastic gradient , 2005, Neurocomputing.

[8]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[9]  T. Ens,et al.  Blind signal separation : statistical principles , 1998 .

[10]  H Szu,et al.  Landsat spectral demixing a la superresolution of blind matrix inversion by constraint MaxEnt neural nets , 1997, Defense, Security, and Sensing.

[11]  Ali Mansour,et al.  Blind Separation of Sources , 1999 .

[12]  Hairong Qi,et al.  Unsupervised learning with mini free energy , 2007, SPIE Defense + Commercial Sensing.

[13]  Harold H. Szu,et al.  Blind de-mixing with unknown sources , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[14]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[15]  H. B. Barlow,et al.  Unsupervised Learning , 1989, Neural Computation.

[16]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.