Modeling birdsong learning with a chaotic Elman network

Among passerines, Bengali finches are known to sing extremely complex courtship songs with three hierarchical structures: namely, the element, the chunk, and the syntax. In this work, we theoretically studied the mechanism of the song of Bengali finches in aides to provide a dynamic view of the development of birdsong learning. We first constructed a model of the Elman network with chaotic neurons that successfully learned the supervisor signal defined by a simple finite-state syntax. Second, we focused on the process of individual-specific increases in the complexity of song syntax. We propose a new learning algorithm to produce the intrinsic diversification of song syntax without a supervisor on the basis of the itinerant dynamics of chaotic neural networks and the Hebbian learning rule. The emergence of novel syntax modifying the acquired syntax is demonstrated.

[1]  W. Freeman,et al.  How brains make chaos in order to make sense of the world , 1987, Behavioral and Brain Sciences.

[2]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[3]  Geoffrey E. Hinton,et al.  Learning representations of back-propagation errors , 1986 .

[4]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[5]  K. Aihara,et al.  Chaotic neural networks , 1990 .

[6]  Shun-ichi Amari,et al.  Natural Gradient Works Efficiently in Learning , 1998, Neural Computation.

[7]  Kazuyuki Aihara,et al.  Functional relevance of 'excitatory' gaba actions in cortical interneurons: a dynamical systems approach. , 2004, Journal of integrative neuroscience.

[8]  N. Tinbergen On aims and methods of Ethology , 2010 .

[9]  K. Aihara,et al.  Itinerant memory dynamics and global bifurcations in chaotic neural networks. , 2003, Chaos.

[10]  Ichiro Tsuda,et al.  Dynamic link of memory--Chaotic memory map in nonequilibrium neural networks , 1992, Neural Networks.

[11]  笹原 和俊 Evolution of complexity and diversity in simulated birdsong grammars , 2005 .

[12]  K. Aihara,et al.  Hierarchical structure among invariant subspaces of chaotic neural networks , 2001 .

[13]  Alison Wray,et al.  The transition to language , 2002 .

[14]  Kazuyuki Aihara,et al.  Chaotic simulated annealing by a neural network model with transient chaos , 1995, Neural Networks.

[15]  James L. McClelland,et al.  Learning Subsequential Structure in Simple Recurrent Networks , 1988, NIPS.

[16]  Kazuyuki Aihara,et al.  Sensitive Response of a Chaotic Wandering State to Memory Fragment Inputs in a Chaotic Neural Network Model , 2004, Int. J. Bifurc. Chaos.