Schemas and Neural Networks for Sixth Generation Computing. Invited Survey

Abstract The study of animal and human brains suggests overall architectural principles for “sixth generation computers.” Each such machine will comprise a network of more specialized devices, with many of these devices structured as highly parallel arrays of interacting neuron-like, possibly adaptive, components. We stress the interaction between computational neurobiology and neural engineering and note the two grains of analysis of schemas and neural networks, arguing that “schemas will be the programming language of the sixth generation.” After a brief introduction to the variety of neuron models now current, schemas are exemplified in a discussion of high-level vision. The integration of neural network and schema models is brought out in an integrated set of studies, called Rana computatrix , of mechanisms for visuomotor coordination in frog and toad. Whereas many articles on neural networks focus on learning and restrict themselves to a limited class of simple neurons, the present paper emphasizes the “domain-specific” structure of neural networks, as well as emphasizing that technologists have much to learn from the study of neurobiological systems. We close with a brief account of adaptation and the programming of sixth generation computers.

[1]  A. A. Mullin,et al.  Principles of neurodynamics , 1962 .

[2]  S. Amari,et al.  Competition and Cooperation in Neural Nets , 1982 .

[3]  J. Mcilwain Lateral spread of neural excitation during microstimulation in intermediate gray layer of cat's superior colliculus. , 1982, Journal of neurophysiology.

[4]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1990 .

[5]  Lokendra Shastri,et al.  A Connectionist Encoding of Semantic Networks , 1987 .

[6]  D. House Neural models of depth perception in frogs and toads , 1984 .

[7]  Victor R. Lesser,et al.  The Hearsay-II Speech-Understanding System: Integrating Knowledge to Resolve Uncertainty , 1980, CSUR.

[8]  D. O. Hebb,et al.  The organization of behavior , 1988 .

[9]  Elie Bienenstock,et al.  A neural network for invariant pattern recognition. , 1987 .

[10]  W. Pitts,et al.  How we know universals; the perception of auditory and visual forms. , 1947, The Bulletin of mathematical biophysics.

[11]  Terrence J. Sejnowski,et al.  Parallel Networks that Learn to Pronounce English Text , 1987, Complex Syst..

[12]  David Noton,et al.  A Theory of Visual Pattern Perception , 1970, IEEE Trans. Syst. Sci. Cybern..

[13]  W. R. Moore Conventional fault-tolerance and neural computers , 1988 .

[14]  A G Barto,et al.  Learning by statistical cooperation of self-interested neuron-like computing elements. , 1985, Human neurobiology.

[15]  Ronald C. Arkin,et al.  Neuroscience in Motion: The Application of Schema Theory to Mobile Robotics , 1989 .

[16]  Michael A. Arbib,et al.  The metaphorical brain : an introduction to cybernetics as artificial intelligence and brain theory , 1972 .

[17]  D. Ingle Focal attention in the frog: behavioral and physiological correlates. , 1975, Science.

[18]  G. Schneider Two visual systems. , 1969, Science.

[19]  R. M. Siegel,et al.  Encoding of spatial location by posterior parietal neurons. , 1985, Science.

[20]  G. Shepherd The Synaptic Organization of the Brain , 1979 .

[21]  Wilfrid Rall,et al.  Theoretical significance of dendritic trees for neuronal input-output relations , 1964 .

[22]  G. Edelman Neural Darwinism: The Theory Of Neuronal Group Selection , 1989 .

[23]  Elie Bienenstock,et al.  A neural network for the retrieval of superimposed connection patterns , 1987 .

[24]  M. Arbib Levels of modeling of mechanisms of visually guided behavior , 1987, Behavioral and Brain Sciences.

[25]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[26]  C. von der Malsburg,et al.  Development of ocularity domains and growth behaviour of axon terminals. , 1979, Biological cybernetics.

[27]  Stephen Grossberg,et al.  Competitive Learning: From Interactive Activation to Adaptive Resonance , 1987, Cogn. Sci..

[28]  J. Ewert,et al.  Visuomotor Coordination: Amphibians, Comparisons, Models, and Robots , 1989 .

[29]  Michael A. Arbib,et al.  Perceptual Structures and Distributed Motor Control , 1981 .

[30]  L. Stark,et al.  Scanpaths in Eye Movements during Pattern Perception , 1971, Science.

[31]  John F. Kalaska,et al.  Spatial coding of movement: A hypothesis concerning the coding of movement direction by motor cortical populations , 1983 .

[32]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[33]  Geoffrey E. Hinton,et al.  Distributed Representations , 1986, The Philosophy of Artificial Intelligence.

[34]  Michael A. Arbib,et al.  The Design of Well-Structured and Correct Programs , 1978, Texts and Monographs in Computer Science.

[35]  Masao Ito,et al.  Mechanisms of Motor Learning , 1982 .

[36]  James A. Anderson,et al.  Cognitive and psychological computation with neural models , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[37]  Michael A. Arbib,et al.  The metaphorical brain 2 - neural networks and beyond (2. ed.) , 1972 .

[38]  J. Ewert Neuroethology of releasing mechanisms: Prey-catching in toads , 1987, Behavioral and Brain Sciences.

[39]  M. Arbib,et al.  The role of the tectal column in facilitation of amphibian prey- catching behavior: a neural model , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[40]  M. Arbib Brains, Machines, and Mathematics , 1987, Springer US.

[41]  David Zipser,et al.  Feature Discovery by Competive Learning , 1986, Cogn. Sci..

[42]  G. Székely,et al.  Cellular and Synaptic Architecture of the Optic Tectum , 1976 .

[43]  Michael A. Arbib,et al.  From Schema Theory To Language , 1987 .

[44]  Christoph von der Malsburg,et al.  Pattern recognition by labeled graph matching , 1988, Neural Networks.

[45]  K. J. Craik,et al.  The nature of explanation , 1944 .

[46]  S. Amari Topographic organization of nerve fields , 1979, Neuroscience Letters.

[47]  Roger C. Schank,et al.  Scripts, plans, goals and understanding: an inquiry into human knowledge structures , 1978 .

[48]  A I Selverston,et al.  Gastric mill activity in the lobster. III. Effects of proctolin on the isolated central pattern generator. , 1988, Journal of neurophysiology.

[49]  Geoffrey E. Hinton,et al.  Symbols Among the Neurons: Details of a Connectionist Inference Architecture , 1985, IJCAI.

[50]  J. Albus A Theory of Cerebellar Function , 1971 .

[51]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[52]  S. Winograd,et al.  Reliable Computation in the Presence of Noise , 1963 .

[53]  D. Marr A theory of cerebellar cortex , 1969, The Journal of physiology.

[54]  Marvin Minsky,et al.  A framework for representing knowledge , 1974 .

[55]  Allen R. Hanson,et al.  A Methodology for the Development of General Knowledge-Based Vision Systems , 1984, Wissensbasierte Systeme.

[56]  Roman Bek,et al.  Discourse on one way in which a quantum-mechanics language on the classical logical base can be built up , 1978, Kybernetika.

[57]  W von Seelen,et al.  [Neurobiology and system theory of a visual pattern recognition mechanism in the toad]. , 1973, Kybernetik.

[58]  RICHARD L. DIDDAY,et al.  Eye Movements and Visual Perception: A "Two Visual System" Model , 1975, Int. J. Man Mach. Stud..

[59]  James S. Albus,et al.  New Approach to Manipulator Control: The Cerebellar Model Articulation Controller (CMAC)1 , 1975 .

[60]  Nestor A. Schmajuk,et al.  The hippocampus and the control of information storage in the brain , 1988 .

[61]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[62]  M. Arbib,et al.  A neural model of interactions subserving prey-predator discrimination and size preference in anuran amphibia. , 1985, Journal of theoretical biology.

[63]  P M MILNER,et al.  The cell assembly: Mark II. , 1957, Psychological review.

[64]  W. Pitts,et al.  What the Frog's Eye Tells the Frog's Brain , 1959, Proceedings of the IRE.

[65]  Michael A. Arbib,et al.  Visuomotor Coordination: Neural Models and Perceptual Robotics , 1989 .

[66]  Mitsuo Kawato,et al.  Hierarchical learning of voluntary movement by cerebellum and sensory association cortex , 1988 .

[67]  C. von der Malsburg Self-organization of orientation sensitive cells in the striate cortex. , 1973, Kybernetik.

[68]  Michael A. Arbib,et al.  Depth and detours: an essay on visually guided behavior , 1990 .

[69]  Randall Davis,et al.  Negotiation as a Metaphor for Distributed Problem Solving , 1988, Artif. Intell..

[70]  G. Roth,et al.  Mathematical model and simulation of retina and tectum opticum of lower vertebrates , 1987, Acta biotheoretica.

[71]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[72]  J. von Neumann,et al.  Probabilistic Logic and the Synthesis of Reliable Organisms from Unreliable Components , 1956 .

[73]  Norbert Wiener,et al.  Cybernetics. , 1948, Scientific American.

[74]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[75]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[76]  W. McCulloch,et al.  Embodiments of Mind , 1966 .

[77]  A. Selverston,et al.  The stomatogastric nervous system: Structure and function of a small neural network , 1976, Progress in Neurobiology.

[78]  Ralph Linsker,et al.  Self-organization in a perceptual network , 1988, Computer.

[79]  J. Hopfield,et al.  Computing with neural circuits: a model. , 1986, Science.

[80]  Terry Edward Waymouth Using object descriptions in a schema network for machine vision , 1986 .