The Time-Organized Map Algorithm: Extending the Self-Organizing Map to Spatiotemporal Signals

The new time-organized map (TOM) is presented for a better understanding of the self-organization and geometric structure of cortical signal representations. The algorithm extends the common self-organizing map (SOM) from the processing of purely spatial signals to the processing of spatiotemporal signals. The main additional idea of the TOM compared with the SOM is the functionally reasonable transfer of temporal signal distances into spatial signal distances in topographic neural representations. This is achieved by neural dynamics of propagating waves, allowing current and former signals to interact spatiotemporally in the neural network. Within a biologically plausible framework, the TOM algorithm (1) reveals how dynamic neural networks can self-organize to embed spatial signals in temporal context in order to realize functional meaningful invariances, (2) predicts time-organized representational structures in cortical areas representing signals with systematic temporal relation, and (3) suggests that the strength with which signals interact in the cortex determines the type of signal topology realized in topographic maps (e.g., spatially or temporally defined signal topology). Moreover, the TOM algorithm supports the explanation of topographic reorganizations based on time-to-space transformations (Wiemer, Spengler, Joublin, Stagge, & Wacquant, 2000).

[1]  Werner von Seelen,et al.  Self-organizing maps for visual feature representation based on natural binocular stimuli , 2000, Biological Cybernetics.

[2]  D. Hubel Eye, brain, and vision , 1988 .

[3]  Teuvo Kohonen,et al.  Self-Organizing Maps, Second Edition , 1997, Springer Series in Information Sciences.

[4]  Charles P. Taylor,et al.  Na+ currents that fail to inactivate , 1993, Trends in Neurosciences.

[5]  Jukka Heikkonen,et al.  Time Series Predicition using Recurrent SOM with Local Linear Models , 1997 .

[6]  Theo Geisel,et al.  A Cortical Interpretation of ASSOMs , 1998 .

[7]  M G Rosa,et al.  Visuotopic organisation of striate cortex in the marmoset monkey (Callithrix jacchus) , 1996, The Journal of comparative neurology.

[8]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[9]  A. Dale,et al.  Functional analysis of primary visual cortex (V1) in humans. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[10]  K M Gothard,et al.  Dynamics of Mismatch Correction in the Hippocampal Ensemble Code for Space: Interaction between Path Integration and Environmental Cues , 1996, The Journal of Neuroscience.

[11]  N. Logothetis,et al.  Psychophysical and physiological evidence for viewer-centered object representations in the primate. , 1995, Cerebral cortex.

[12]  C. Malsburg Self-organization of orientation sensitive cells in the striate cortex , 2004, Kybernetik.

[13]  L. Sachs Angewandte Statistik : Anwendung statistischer Methoden , 1984 .

[14]  Teuvo Kohonen,et al.  Where the abstract feature maps of the brain might come from , 1999, Trends in Neurosciences.

[15]  F. Spengler,et al.  Cortical plasticity underlying tactile stimulus learning , 2001 .

[16]  A. Verri,et al.  First-order analysis of optical flow in monkey brain. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[17]  Zhen-Ping Lo,et al.  On the rate of convergence in topology preserving neural networks , 1991, Biological Cybernetics.

[18]  C WiemerJan The time-organized map algorithm , 2003 .

[19]  Christoph E Schreiner,et al.  Order and disorder in auditory cortical maps , 1995, Current Opinion in Neurobiology.

[20]  K. Obermayer,et al.  Statistical-mechanical analysis of self-organization and pattern formation during the development of visual maps. , 1992, Physical review. A, Atomic, molecular, and optical physics.

[21]  H. Ritter,et al.  Self-organizing maps for internal representations , 1990, Psychological research.

[22]  C. Malsburg,et al.  How patterned neural connections can be set up by self-organization , 1976, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[23]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[24]  S. Thorpe,et al.  Speed of processing in the human visual system , 1996, Nature.

[25]  H H Bülthoff,et al.  How are three-dimensional objects represented in the brain? , 1994, Cerebral cortex.

[26]  E. Rolls High-level vision: Object recognition and visual cognition, Shimon Ullman. MIT Press, Bradford (1996), ISBN 0 262 21013 4 , 1997 .

[27]  E. DeYoe,et al.  Mapping striate and extrastriate visual areas in human cerebral cortex. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[28]  Theo Geisel,et al.  Analyzing phase transitions in high-dimensional self-organizing maps , 1996, Biological Cybernetics.

[29]  V. Bringuier,et al.  Horizontal propagation of visual activity in the synaptic integration field of area 17 neurons. , 1999, Science.

[30]  KEIICHI HORIO,et al.  Feedback Self-Organizing Map and its Application to Spatio-Temporal Pattern Classification , 2001, Int. J. Comput. Intell. Appl..

[31]  Xiaoqin Wang,et al.  Remodelling of hand representation in adult cortex determined by timing of tactile stimulation , 1995, Nature.

[32]  András Lörincz,et al.  Topology Learning Solved by Extended Objects: A Neural Network Model , 1994, Neural Computation.

[33]  H. Mallot An overall description of retinotopic mapping in the cat's visual cortex areas 17, 18, and 19 , 1985, Biological Cybernetics.

[34]  Suzanna Becker,et al.  Implicit Learning in 3D Object Recognition: The Importance of Temporal Context , 1999, Neural Computation.

[35]  Christoph Kayser,et al.  Learning the invariance properties of complex cells from their responses to natural stimuli , 2002, The European journal of neuroscience.

[36]  Thomas Martinetz,et al.  Topology representing networks , 1994, Neural Networks.

[37]  Markus Lappe,et al.  Motion anisotropies and heading detection , 1995, Biological Cybernetics.

[38]  D. Buonomano,et al.  Cortical plasticity: from synapses to maps. , 1998, Annual review of neuroscience.

[39]  A. Dale,et al.  The representation of the ipsilateral visual field in human cerebral cortex. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[40]  John G. Taylor,et al.  Nitric oxide in cortical map formation , 1996, Journal of Chemical Neuroanatomy.

[41]  E. Seidemann,et al.  Dynamics of Depolarization and Hyperpolarization in the Frontal Cortex and Saccade Goal , 2002, Science.

[42]  K. Zilles,et al.  Structural divisions and functional fields in the human cerebral cortex 1 Published on the World Wide Web on 20 February 1998. 1 , 1998, Brain Research Reviews.

[43]  R Gattass,et al.  Visual topography of V1 in the Cebus monkey , 1987, The Journal of comparative neurology.

[44]  E. Miller,et al.  Task-specific neural activity in the primate prefrontal cortex. , 2000, Journal of neurophysiology.

[45]  S. Ullman High-Level Vision: Object Recognition and Visual Cognition , 1996 .

[46]  Thomas Voegtlin,et al.  Context quantization and contextual self-organizing maps , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[47]  D. Kleinfeld,et al.  Visual stimuli induce waves of electrical activity in turtle cortex. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[48]  Keiji Tanaka Mechanisms of visual object recognition: monkey and human studies , 1997, Current Opinion in Neurobiology.

[49]  Daphna Weinshall,et al.  A self-organizing multiple-view representation of 3D objects , 2004, Biological Cybernetics.

[50]  Frank Joublin,et al.  A Model of Cortical Plasticity: Integration and Segregation based on Temporal Input Patterns , 1998 .

[51]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[52]  Peter Földiák,et al.  Learning Invariance from Transformation Sequences , 1991, Neural Comput..

[53]  R. Hetherington The Perception of the Visual World , 1952 .

[54]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[55]  O. Garaschuk,et al.  Developmental profile and synaptic origin of early network oscillations in the CA1 region of rat neonatal hippocampus , 1998, The Journal of physiology.

[56]  H. Bülthoff,et al.  Learning to recognize objects , 1999, Trends in Cognitive Sciences.

[57]  Jari Kangas,et al.  Time-delayed self-organizing maps , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[58]  Eric L. Schwartz,et al.  Computational anatomy and functional architecture of striate cortex: A spatial mapping approach to perceptual coding , 1980, Vision Research.

[59]  John G. Taylor,et al.  The temporal Kohönen map , 1993, Neural Networks.

[60]  Werner von Seelen,et al.  Topography from time-to-space transformations , 2002, Neurocomputing.

[61]  Jan C. Wiemer,et al.  Learning topography in neural networks: towards a better understanding of cortical topography , 2000 .

[62]  M. Tanifuji,et al.  Horizontal Propagation of Excitation in Rat Visual Cortical Slices Revealed by Optical Imaging , 1994 .

[63]  Keiji Tanaka,et al.  Optical Imaging of Functional Organization in the Monkey Inferotemporal Cortex , 1996, Science.

[64]  James A. Reggia,et al.  Temporally Asymmetric Learning Supports Sequence Processing in Multi-Winner Self-Organizing Maps , 2004, Neural Computation.

[65]  Frank Joublin,et al.  Learning cortical topography from spatiotemporal stimuli , 2000, Biological Cybernetics.