Concept learning in Hopfield associative memories trained with noisy examples using the Hebb rule

The notion of concept learning is introduced. Here we consider a concept as the mean of some statistical distribution, from which the examples of this concept are drawn. We study, using standard probability theory results, the ability of the Hopfield model of associative memory using the Hebb rule to learn concepts from examples in the presence of noise. We state and prove properties concerning this ability.

[1]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[2]  Bruno Cernuschi-Frías,et al.  Partial simultaneous updating in Hopfield memories , 1989, IEEE Trans. Syst. Man Cybern..

[3]  Yaser S. Abu-Mostafa,et al.  Information capacity of the Hopfield model , 1985, IEEE Trans. Inf. Theory.

[4]  Santosh S. Venkatesh,et al.  The capacity of the Hopfield associative memory , 1987, IEEE Trans. Inf. Theory.