Statistical Mechanics of Unsupervised Learning

We study two different unsupervised learning strategies for a single-layer perceptron. The environment provides a set of unclassified training examples, which belong to two different classes, depending on their overlap with an N-dimensional concept vector. By means of a statistical-mechanics analysis, using the replica method, we investigate how well the perceptron infers the unknown structure from the input data.

[1]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[2]  Sompolinsky,et al.  Scaling laws in learning of classification tasks. , 1993, Physical review letters.