On Appropriate Refractoriness and Weight Increment in Incremental Learning

Neural networks are able to learn more patterns with the incremental learning than with the correlative learning. The incremental learning is a method to compose an associate memory using a chaotic neural network. The capacity of the network is found to increase along with its size which is the number of the neurons in the network and to be larger than the one with correlative learning. In former work, the capacity was over the direct proportion to the network size with suitable pairs of the refractory parameter and the learning parameter. In this paper, the refractory parameter and the learning parameter are investigated through the computer simulations changing these parameters. Through the computer simulations, it turns out that the appropriate parameters lie near the origin with some relation between them.

[1]  Naohiro Ishii,et al.  On Refractory Parameter of Chaotic Neurons in Incremental Learning , 2004, KES.

[2]  Lakhmi C. Jain,et al.  Knowledge-Based Intelligent Information and Engineering Systems , 2004, Lecture Notes in Computer Science.

[3]  M. Watanabe,et al.  Automatic learning in chaotic neural network , 1994, ETFA '94. 1994 IEEE Symposium on Emerging Technologies and Factory Automation. (SEIKEN) Symposium) -Novel Disciplines for the Next Century- Proceedings.

[4]  Naohiro Ishii,et al.  Error Correction Capability in Chaotic Neural Networks , 2009, 2009 21st IEEE International Conference on Tools with Artificial Intelligence.

[5]  Kazuyuki Aihara,et al.  Automatic learning in chaotic neural networks , 1996 .

[6]  K. Aihara,et al.  Chaotic neural networks , 1990 .

[7]  Naohiro Ishii,et al.  On Influence of Refractory Parameter in Incremental Learning , 2010, Computer and Information Science.

[8]  Naohiro Ishii,et al.  On Capacity of Memory in Chaotic Neural Networks with Incremental Learning , 2008, KES.

[9]  Roger Lee,et al.  Computer and Information Science 2010 [outstanding papers from the 9th ACIS/IEEE International Conference on Computer and Information Science, Kaminoyama, Japan, August 18-20, 2010] , 2010, Computer and Information Science.