A Neurodynamic Account of Spontaneous Behaviour

The current article suggests that deterministic chaos self-organized in cortical dynamics could be responsible for the generation of spontaneous action sequences. Recently, various psychological observations have suggested that humans and primates can learn to extract statistical structures hidden in perceptual sequences experienced during active environmental interactions. Although it has been suggested that such statistical structures involve chunking or compositional primitives, their neuronal implementations in brains have not yet been clarified. Therefore, to reconstruct the phenomena, synthetic neuro-robotics experiments were conducted by using a neural network model, which is characterized by a generative model with intentional states and its multiple timescales dynamics. The experimental results showed that the robot successfully learned to imitate tutored behavioral sequence patterns by extracting the underlying transition probability among primitive actions. An analysis revealed that a set of primitive action patterns was embedded in the fast dynamics part, and the chaotic dynamics of spontaneously sequencing these action primitive patterns was structured in the slow dynamics part, provided that the timescale was adequately set for each part. It was also shown that self-organization of this type of functional hierarchy ensured robust action generation by the robot in its interactions with a noisy environment. This article discusses the correspondence of the synthetic experiments with the known hierarchy of the prefrontal cortex, the supplementary motor area, and the primary motor cortex for action generation. We speculate that deterministic dynamical structures organized in the prefrontal cortex could be essential because they can account for the generation of both intentional behaviors of fixed action sequences and spontaneous behaviors of pseudo-stochastic action sequences by the same mechanism.

[1]  W. Freeman,et al.  How brains make chaos in order to make sense of the world , 1987, Behavioral and Brain Sciences.

[2]  Jun Tani,et al.  Learning Multiple Goal-Directed Actions Through Self-Organization of a Dynamic Neural Network Model: A Humanoid Robot Experiment , 2008, Adapt. Behav..

[3]  S. Schaal,et al.  Segmentation of endpoint trajectories does not imply segmented control , 1999, Experimental Brain Research.

[4]  A P Georgopoulos,et al.  On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[5]  Jun Tani,et al.  Self-organization of distributedly represented multiple behavior schemata in a mirror system: reviews of robot experiments using RNNPB , 2004, Neural Networks.

[6]  Jun Tanji,et al.  Role for supplementary motor area cells in planning several movements ahead , 1994, Nature.

[7]  J. Tanji,et al.  Neuronal activity in the primate prefrontal cortex in the process of motor selection based on two behavioral rules. , 2000, Journal of neurophysiology.

[8]  A. Borst Seeing smells: imaging olfactory learning in bees , 1999, Nature Neuroscience.

[9]  Karl J. Friston,et al.  Action understanding and active inference , 2011, Biological Cybernetics.

[10]  M. Jeannerod The representing brain: Neural correlates of motor intention and imagery , 1994, Behavioral and Brain Sciences.

[11]  Kae Nakamura,et al.  Neuronal activity in medial frontal cortex during learning of sequential procedures. , 1998, Journal of neurophysiology.

[12]  O Hikosaka,et al.  Neural Representation of a Rhythm Depends on Its Interval Ratio , 1999, The Journal of Neuroscience.

[13]  B. Libet Unconscious cerebral initiative and the role of conscious will in voluntary action , 1985, Behavioral and Brain Sciences.

[14]  Karl J. Friston,et al.  A Hierarchy of Time-Scales and the Brain , 2008, PLoS Comput. Biol..

[15]  Dare A. Baldwin,et al.  Segmenting dynamic human action via statistical structure , 2008, Cognition.

[16]  M. Goldsmith,et al.  Statistical Learning by 8-Month-Old Infants , 1996 .

[17]  I. Tsuda Chaotic itinerancy as a dynamical basis of hermeneutics in brain and mind , 1991 .

[18]  M. Brass,et al.  Unconscious determinants of free decisions in the human brain , 2008, Nature Neuroscience.

[19]  H. Grabert,et al.  Projection Operator Techniques in Nonequilibrium Statistical Mechanics , 1982 .

[20]  M. Poo,et al.  Propagation of activity-dependent synaptic depression in simple neural networks , 1997, Nature.

[21]  M. Graziano,et al.  Complex Movements Evoked by Microstimulation of Precentral Cortex , 2002, Neuron.

[22]  Elizabeth K. Johnson,et al.  Statistical learning of tone sequences by human infants and adults , 1999, Cognition.

[23]  Jun Tani,et al.  Learning to generate articulated behavior through the bottom-up and the top-down interaction processes , 2003, Neural Networks.

[24]  P. Mazur On the theory of brownian motion , 1959 .

[25]  Kae Nakamura,et al.  Emergence of rhythm during motor learning , 2004, Trends in Cognitive Sciences.

[26]  J. Tanji,et al.  Interval time coding by neurons in the presupplementary and supplementary motor areas , 2009, Nature Neuroscience.

[27]  Jun Tani,et al.  An Interpretation of the "Self" From the Dynamical Systems Perspective: A Constructivist Approach , 1998 .

[28]  Karl J. Friston,et al.  ATTRACTORS IN SONG , 2009 .

[29]  P. Alperson,et al.  On Musical Improvisation , 1984 .

[30]  M. Kawato,et al.  Formation and control of optimal trajectory in human multijoint arm movement , 1989, Biological Cybernetics.

[31]  G. Rizzolatti,et al.  The organization of the cortical motor system: new concepts. , 1998, Electroencephalography and clinical neurophysiology.

[32]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[33]  Geoffrey E. Hinton,et al.  Adaptive Mixtures of Local Experts , 1991, Neural Computation.

[34]  M. Rushworth,et al.  Organization of action sequences and the role of the pre-SMA. , 2004, Journal of neurophysiology.

[35]  E. Gibson,et al.  An Ecological Approach to Perceptual Learning and Development , 2000 .

[36]  Stefano Nolfi,et al.  Learning to perceive the world as articulated: an approach for hierarchical learning in sensory-motor systems , 1998, Neural Networks.

[37]  Claudius Gros,et al.  Cognitive Computation with Autonomously Active Neural Networks: An Emerging Field , 2009, Cognitive Computation.

[38]  Ronald J. Williams,et al.  A Learning Algorithm for Continually Running Fully Recurrent Neural Networks , 1989, Neural Computation.

[39]  Jun Tani,et al.  A model for learning to segment temporal sequences, utilizing a mixture of RNN experts together with adaptive variance , 2007, Neural Networks.

[40]  Scott P. Johnson,et al.  Visual statistical learning in infancy: evidence for a domain general learning mechanism , 2002, Cognition.

[41]  David Hume,et al.  An enquiry concerning human understanding and other writings , 2007 .

[42]  Ralf Der,et al.  Predictive information and explorative behavior of autonomous robots , 2008 .

[43]  R. Mazo On the theory of brownian motion , 1973 .

[44]  Jun Tani,et al.  Learning to imitate stochastic time series in a compositional way by chaos , 2008, Neural Networks.

[45]  Jun Tani,et al.  Emergence of Functional Hierarchy in a Multiple Timescale Neural Network Model: A Humanoid Robot Experiment , 2008, PLoS Comput. Biol..

[46]  D. Lemons,et al.  Paul Langevin’s 1908 paper “On the Theory of Brownian Motion” [“Sur la théorie du mouvement brownien,” C. R. Acad. Sci. (Paris) 146, 530–533 (1908)] , 1997 .

[47]  K. Harris Stability of the fittest: organizing learning through retroaxonal signals , 2008, Trends in Neurosciences.

[48]  M Ito,et al.  Neurophysiological aspects of the cerebellar motor control system. , 1970, International journal of neurology.

[49]  Don C. Locke Elbow Room: The Varieties of Free Will Worth Wanting , 1986 .

[50]  Mu-ming Poo,et al.  Rapid BDNF-induced retrograde synaptic modification in a developing retinotectal system , 2004, Nature.

[51]  J. Tanji,et al.  Neuronal activity in the supplementary and presupplementary motor areas for temporal organization of multiple movements. , 2000, Journal of neurophysiology.

[52]  Paul B. Johnson,et al.  Premotor and parietal cortex: corticocortical connectivity and combinatorial computations. , 1997, Annual review of neuroscience.

[53]  Michael I. Jordan,et al.  An internal model for sensorimotor integration. , 1995, Science.

[54]  B. Feige,et al.  The Role of Higher-Order Motor Areas in Voluntary Movement as Revealed by High-Resolution EEG and fMRI , 1999, NeuroImage.

[55]  M. D’Esposito,et al.  Is the rostro-caudal axis of the frontal lobe hierarchical? , 2009, Nature Reviews Neuroscience.

[56]  J. McCarthy Situations, Actions, and Causal Laws , 1963 .

[57]  P. Goldman-Rakic,et al.  Common cortical and subcortical targets of the dorsolateral prefrontal and posterior parietal cortices in the rhesus monkey: evidence for a distributed neural network subserving spatially guided behavior , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[58]  R. Byrne Imitation as behaviour parsing. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[59]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[60]  Michael A. Arbib,et al.  Perceptual Structures and Distributed Motor Control , 1981 .