Parallel distributed processing and neural networks: origins, methodology and cognitive functions.

Parallel Distributed Processing (PDP), a computational methodology with origins in Associationism, is used to provide empirical information regarding neurobiological systems. Recently, supercomputers have enabled neuroscientists to model brain behavior-relationships. An overview of supercomputer architecture demonstrates the advantages of parallel over serial processing. Histological data provide physical evidence of the parallel distributed nature of certain aspects of the human brain, as do corresponding computer simulations. Whereas sensory networks follow more sequential neural network pathways, in vivo brain imaging studies of attention and rudimentary language tasks appear to involve multiple cortical and subcortical areas. Controversy remains as to whether associative models or Artificial Intelligence symbolic models better reflect neural networks of cognitive functions; however, considerable interest has shifted towards associative models.

[1]  James L. McGaugh,et al.  Brain Organization and Memory: Cells, Systems, and Circuits , 1992 .

[2]  Mark E Nelson,et al.  Brain maps and parallel computers , 1990, Trends in Neurosciences.

[3]  Geoffrey E. Hinton,et al.  Connectionist Architectures for Artificial Intelligence , 1990, Computer.

[4]  J. Byrne,et al.  Long-term synaptic changes produced by a cellular analog of classical conditioning in Aplysia. , 1990, Science.

[5]  T. Sejnowski,et al.  Neural network model of visual cortex for determining surface curvature from images of shaded surfaces , 1990, Proceedings of the Royal Society of London. B. Biological Sciences.

[6]  M Corbetta,et al.  Attentional modulation of neural processing of shape, color, and velocity in humans. , 1990, Science.

[7]  T. Goldberg,et al.  Regional cerebral blood flow and cognitive function in Huntington's disease and schizophrenia. A comparison of patients matched for performance on a prefrontal-type task. , 1990, Archives of neurology.

[8]  M. J. Baum,et al.  Prenatal and neonatal testosterone exposure interact to affect differentiation of sexual behavior and partner preference in female ferrets. , 1990, Behavioral neuroscience.

[9]  David E. Rumelhart,et al.  Brain style computation: learning and generalization , 1990 .

[10]  James M. Bower,et al.  Reverse engineering the nervous system: an anatomical, physiological, and computer based approach , 1990 .

[11]  A. Damasio.  Time-locked multiregional retroactivation: A systems-level proposal for the neural substrates of recall and recognition , 1989, Cognition.

[12]  E. Valentine.  Neural nets: from Hartley and Hebb to Hinton , 1989 .

[13]  Matthew A. Wilson,et al.  The simulation of large-scale neural networks , 1989 .

[14]  W. Freeman.  Second Commentary: On the proper treatment of connectionism by Paul Smolensky (1988) - Neuromachismo Rekindled , 1989 .

[15]  D. Levine.  Neural network principles for theoretical psychology , 1989 .

[16]  Daniel S. Levine,et al.  Modeling some effects of frontal lobe damage--Novelty and perseveration , 1989, Neural Networks.

[17]  Richard Durbin,et al.  The computing neuron , 1989 .

[18]  M. Posner,et al.  Localization of cognitive operations in the human brain. , 1988, Science.

[19]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[20]  G. Bower,et al.  Evaluating an adaptive network model of human learning , 1988 .

[21]  P. Smolensky.  On the proper treatment of connectionism , 1988, Behavioral and Brain Sciences.

[22]  M. Posner,et al.  Positron emission tomographic studies of the cortical anatomy of single-word processing , 1988, Nature.

[23]  M D Ginsberg,et al.  Increases in both cerebral glucose utilization and blood flow during execution of a somatosensory task , 1988, Annals of neurology.

[24]  F Fazekas,et al.  Cerebral metabolism and patterned visual Stimulation , 1988, Neurology.

[25]  S. Strother,et al.  The metabolic pathology of the AIDS dementia complex , 1987, Annals of neurology.

[26]  K. C. Bowler,et al.  Exploiting highly concurrent computers for physics , 1987 .

[27]  S. Strother,et al.  Scaled Subprofile Model: A Statistical Approach to the Analysis of Functional Patterns in Positron Emission Tomographic Data , 1987, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[28]  Michael I. Posner,et al.  Structures and Functions of Selective Attention. , 1987 .

[29]  B. Reisberg,et al.  Abnormal Temporal Lobe Response in Alzheimer's Disease during Cognitive Processing as Measured by 11C-2-Deoxy-D-Glucose and PET , 1987, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[30]  W. Schneider.  Connectionism: Is it a paradigm shift for psychology? , 1987 .

[31]  R Linsker,et al.  From basic network principles to neural architecture: emergence of orientation columns. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[32]  H. Kendler.  Historical foundations of modern psychology , 1986 .

[33]  K. Coburn.  Separate channels mediate prestimulus facilitation and suppression of rabbit nictitating membrane reflex. , 1986, Behavioral neuroscience.

[34]  P. Churchland,et al.  Computational neuroscience , 1986, Behavioral and Brain Sciences.

[35]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[36]  David Zipser,et al.  Feature Discovery by Competive Learning , 1986, Cogn. Sci..

[37]  J. Fuster,et al.  Occipital and inferotemporal responses to visual signals in the monkey , 1985, Experimental Neurology.

[38]  Joaquin M. Fuster,et al.  The elgiloy microelectrode: Fabrication techniques and characteristics , 1985, Journal of Neuroscience Methods.

[39]  James L. McClelland,et al.  Distributed memory and the representation of general and specific information. , 1985, Journal of experimental psychology. General.

[40]  S. Pinker,et al.  Visual cognition: An introduction , 1984, Cognition.

[41]  H. Buckingham.  Early development of association theory in psychology as a forerunner to connection theory , 1984, Brain and Cognition.

[42]  J C Mazziotta,et al.  Tomographic mapping of human cerebral metabolism , 1982, Neurology.

[43]  T. Poggio,et al.  Retinal ganglion cells: a functional interpretation of dendritic morphology. , 1982, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[44]  Jerome A. Feldman,et al.  Connectionist Models and Their Properties , 1982, Cogn. Sci..

[45]  L. Kempe.  Handbook of Physiology. Section I. The Nervous System , 1982 .

[46]  M. Mesulam.  A cortical network for directed attention and unilateral neglect , 1981, Annals of neurology.

[47]  Daniel Sabbah,et al.  Design Of A Highly Parallel Visual Recognition System , 1981, IJCAI.

[48]  A G Barto,et al.  Toward a modern theory of adaptive networks: expectation and prediction. , 1981, Psychological review.

[49]  D Marr,et al.  Cooperative computation of stereo disparity. , 1976, Science.

[50]  N. P. Tyrin.  Vacuum apparatus for treatment of parodontitis , 1969 .

[51]  S. Grossberg.  Nonlinear difference-differential equations in prediction and learning theory. , 1967, Proceedings of the National Academy of Sciences of the United States of America.

[52]  N. Geschwind.  Disconnexion syndromes in animals and man. II. , 1965, Brain : a journal of neurology.

[53]  N. Geschwind.  Disconnexion syndromes in animals and man. I. , 1965, Brain : a journal of neurology.

[54]  A NEWELL,et al.  Computer simulation of human thinking. , 1961, Science.

[55]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[56]  James A. Anderson,et al.  Neurocomputing (vol. 2): directions for research , 1990 .

[57]  Jonathan A. Marshall,et al.  Self-organizing neural networks for perception of visual motion , 1990, Neural Networks.

[58]  Tarun Khanna,et al.  Foundations of neural networks , 1990 .

[59]  J R Moeller,et al.  Regional cerebral blood flow in mood disorders. I. Comparison of major depressives and normal controls at rest. , 1990, Archives of general psychiatry.

[60]  Charles W. Butler,et al.  Naturally intelligent systems , 1990 .

[61]  B. L. Beattie,et al.  Neuropsychological "systems efficiency" and positron emission tomography. , 1989, The Journal of neuropsychiatry and clinical neurosciences.

[62]  P. Mcgeer,et al.  Systems model of cortical organization: positron emission tomography and neuropsychological test performance. , 1989, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[63]  Geoffrey E. Hinton,et al.  Learning distributed representations of concepts. , 1989 .

[64]  Arthur C. Graesser,et al.  Four Computational Models for Investigating Neuropsychological Decision-making , 1988 .

[65]  D. O. Hebb,et al.  The organization of behavior , 1988 .

[66]  L. Miller.  Behaviorism and the New Science of Cognition , 1988 .

[67]  P. Goldman-Rakic.  Topography of cognition: parallel distributed networks in primate association cortex. , 1988, Annual review of neuroscience.

[68]  Michael I. Posner,et al.  Structures and function of selective attention. , 1988 .

[69]  P. Johnson-Laird.  The computer and the mind: an introduction to cognitive science , 1988 .

[70]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[71]  Teuvo Kohonen,et al.  Associative memory. A system-theoretical approach , 1977 .