Elman topology with sigma-pi units: An application to the modeling of verbal hallucinations in schizophrenia

The development of neural network models has greatly enhanced the comprehension of cognitive phenomena. Here, we show that models using multiplicative processing of inputs are both powerful and simple to train and understand. We believe they are valuable tools for cognitive explorations. Our model can be viewed as a subclass of networks built on sigma-pi units and we show how to derive the Kronecker product representation from the classical sigma-pi unit. We also show how the connectivity requirements of the Kronecker product can be relaxed considering statistical arguments. We use the multiplicative network to implement what we call an Elman topology, that is, a simple recurrent network (SRN) that supports aspects of language processing. As an application, we model the appearance of hallucinated voices after network damage, and show that we can reproduce results previously obtained with SRNs concerning the pathology of schizophrenia.

[1]  S. Grossberg,et al.  Towards a theory of the laminar architecture of cerebral cortex: computational clues from the visual system. , 2003, Cerebral cortex.

[2]  T. Poggio.  A theory of how the brain might work. , 1990, Cold Spring Harbor symposia on quantitative biology.

[3]  Eduardo Mizraji,et al.  A cognitive architecture that solves a problem stated by Minsky , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[4]  T. Gelder,et al.  Mind as Motion: Explorations in the Dynamics of Cognition , 1995 .

[5]  A. D. de Crespigny,et al.  Compromised white matter tract integrity in schizophrenia inferred from diffusion tensor imaging. , 1999, Archives of general psychiatry.

[6]  R. Murray,et al.  Functional anatomy of auditory verbal imagery in schizophrenic patients with auditory hallucinations. , 2000, The American journal of psychiatry.

[7]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[8]  S.-I. Amari,et al.  Neural theory of association and concept-formation , 1977, Biological Cybernetics.

[9]  S. Grossberg.  Adaptive Resonance Theory , 2006 .

[10]  Sukhwinder S Shergill,et al.  Auditory hallucinations: a review of psychological treatments , 1998, Schizophrenia Research.

[11]  E. Mizraji.  Vector logics: the matrix-vector representation of logical calculus , 1992 .

[12]  R. Hoffman.  Computer simulations of neural information processing and the schizophrenia-mania dichotomy. , 1987, Archives of general psychiatry.

[13]  N Sartorius,et al.  WHO international pilot study of schizophrenia. , 1972, Psychological medicine.

[14]  Robert F. Port,et al.  MIND IN MOTION: , 2019, Dune.

[15]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[16]  R. Hoffman,et al.  Synaptic elimination, neurodevelopment, and the mechanism of hallucinated "voices" in schizophrenia. , 1997, The American journal of psychiatry.

[17]  Yoh-Han Pao,et al.  Adaptive pattern recognition and neural networks , 1989 .

[18]  T. Poggio,et al.  Biophysics of Computation: Neurons, Synapses and Membranes , 1984 .

[19]  Michael Schmitt,et al.  On the Complexity of Computing and Learning with Multiplicative Neural Networks , 2002, Neural Computation.

[20]  Sandiway Fong,et al.  Natural Language Grammatical Inference with Recurrent Neural Networks , 2000, IEEE Trans. Knowl. Data Eng..

[21]  S. Grossberg,et al.  The resonant dynamics of speech perception: interword integration and duration-dependent backward effects. , 2000, Psychological review.

[22]  Akira Sawa,et al.  Schizophrenia: Diverse Approaches to a Complex Disease , 2002, Science.

[23]  L. Cooper,et al.  A theory for the development of feature detecting cells in visual cortex , 1975, Biological Cybernetics.

[24]  Christof Koch,et al.  The role of single neurons in information processing , 2000, Nature Neuroscience.

[25]  Nick Chater,et al.  Toward a connectionist model of recursion in human linguistic performance , 1999, Cogn. Sci..

[26]  J. Cohen,et al.  Context, cortex, and dopamine: a connectionist approach to behavior and biology in schizophrenia. , 1992, Psychological review.

[27]  T. Kohonen,et al.  Self-organizing semantic maps , 1989, Biological Cybernetics.

[28]  R. Hoffman,et al.  Reduced corticocortical connectivity can induce speech perception pathology and hallucinated ‘voices’ , 1998, Schizophrenia Research.

[29]  R. Andersen,et al.  Multimodal representation of space in the posterior parietal cortex and its use in planning movements. , 1997, Annual review of neuroscience.

[30]  Richard Bellman,et al.  Introduction to matrix analysis (2nd ed.) , 1997 .

[31]  Geoffrey E. Hinton,et al.  A general framework for parallel distributed processing , 1986 .

[32]  G. Laurent,et al.  Elementary Computation of Object Approach by a Wide-Field Visual Neuron , 1995, Science.

[33]  S. Skare,et al.  Abnormal brain white matter in schizophrenia: a diffusion tensor imaging study , 2001, Neuroreport.

[34]  Bartlett W. Mel.  Synaptic integration in an excitable dendritic tree. , 1993, Journal of neurophysiology.

[35]  Richard Stuart Neville,et al.  Transformations of sigma-pi nets: obtaining reflected functions by reflecting weight matrices , 2002, Neural Networks.

[36]  Eytan Ruppin,et al.  Disorders of Brain, Behavior, and Cognition: The Neurocomputational Perspective , 1999 .

[37]  Jeffrey L. Elman,et al.  Language as a dynamical system , 1996 .

[38]  Leon N. Cooper,et al.  MEMORIES AND MEMORY: A PHYSICIST'S APPROACH TO THE BRAIN , 2000 .

[39]  B. Batlogg,et al.  Auditory Spatial Receptive Fields Created by Multiplication , 2022 .

[40]  M. Spitzer,et al.  A cognitive neuroscience view of schizophrenic thought disorder. , 1997, Schizophrenia bulletin.

[41]  F. Ratliff,et al.  The response of the Limulus retina to moving stimuli: a prediction by Fourier synthesis , 1978, The Journal of general physiology.

[42]  Eric L. Schwartz,et al.  Computing with the Leaky Integrate-and-Fire Neuron: Logarithmic Computation and Multiplication , 1997, Neural Computation.

[43]  M S Buchsbaum,et al.  MRI white matter diffusion anisotropy and PET metabolic rate in schizophrenia , 1998, Neuroreport.

[44]  Richard Bellman,et al.  Introduction to Matrix Analysis , 1972 .

[45]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[46]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[47]  Bartlett W. Mel.  NMDA-Based Pattern Discrimination in a Modeled Cortical Neuron , 1992, Neural Computation.

[48]  E Mizraji,et al.  Context-dependent associations in linear distributed memories. , 1989, Bulletin of mathematical biology.

[49]  D. Hubl,et al.  Pathways that make voices: white matter changes in auditory hallucinations. , 2004, Archives of general psychiatry.

[50]  William Bialek,et al.  Coding and computation with neural spike trains , 1990 .

[51]  Philipp Slusallek,et al.  Introduction to real-time ray tracing , 2005, SIGGRAPH Courses.

[52]  Joel L. Davis,et al.  Single neuron computation , 1992 .

[53]  S. Grossberg.  Neural models of normal and abnormal behavior: what do schizophrenia, parkinsonism, attention deficit disorder, and depression have in common? , 1999, Progress in brain research.

[54]  Hava T. Siegelmann,et al.  On the Computational Power of Neural Nets , 1995, J. Comput. Syst. Sci..

[55]  T. Poggio,et al.  Multiplying with synapses and neurons , 1992 .

[56]  J. Foong,et al.  Neuropathological abnormalities of the corpus callosum in schizophrenia: a diffusion tensor imaging study , 2000, Journal of neurology, neurosurgery, and psychiatry.

[57]  R. Hoffman,et al.  Schizophrenia as a disorder of developmentally reduced synaptic connectivity. , 2000, Archives of general psychiatry.

[58]  David Servan-Schreiber,et al.  A Neural Network Simulation of Hallucinated Voices and Associated Speech Perception Impairments in Schizophrenic Patients , 1995, Journal of Cognitive Neuroscience.

[59]  Guido Bugmann,et al.  Multiplying with neurons: Compensation for irregular input spike trains by using time-dependent synaptic efficiencies , 2004, Biological Cybernetics.

[60]  E Mizraji,et al.  Memories in context. , 1999, Bio Systems.

[61]  E. Mizraji,et al.  Multiplicative contexts in associative memories. , 1994, Bio Systems.

[62]  T. Crow.  Schizophrenia as the price that Homo sapiens pays for language: a resolution of the central paradox in the origin of the species , 2000, Brain Research Reviews.

[63]  T. Sejnowski,et al.  The predictive brain: temporal coincidence and temporal order in synaptic learning mechanisms. , 1994, Learning & memory.

[64]  M Konishi,et al.  Auditory Spatial Receptive Fields Created by Multiplication , 2001, Science.