Levels of modeling of mechanisms of visually guided behavior

Abstract Intermediate constructs are required as bridges between complex behaviors and realistic models of neural circuitry. For cognitive scientists in general, schemas are the appropriate functional units; brain theorists can work with neural layers as units intermediate between structures subserving schemas and small neural circuits. After an account of different levels of analysis, we describe visuomotor coordination in terms of perceptual schemas and motor schemas. The interest of schemas to cognitive science in general is illustrated with the example of perceptual schemas in high-level vision and motor schemas in the control of dextrous hands. Rana computatrix, the computational frog, is introduced to show how one constructs an evolving set of model families to mediate flexible cooperation between theory and experiment. Rana computatrix may be able to do for the study of the organizational principles of neural circuitry what Aplysia has done for the study of subcellular mechanisms of learning. Approach, avoidance, and detour behavior in frogs and toads are analyzed in terms of interacting schemas. Facilitation and prey recognition are implemented as tectal-pretectal interactions, with the tectum modeled by an array of tectal columns. We show how layered neural computation enters into models of stereopsis and how depth schemas may involve the interaction of accommodation and binocular cues in anurans.

[1]  G. Holmes,et al.  Sensory disturbances from cerebral lesions , 1911 .

[2]  J. Uexküll Umwelt und Innenwelt der Tiere , 1921 .

[3]  C. W. Greene THE AMERICAN PHYSIOLOGICAL SOCIETY. , 1922, Science.

[4]  O. L. Zangwill,et al.  HEAD'S CONCEPT OF THE SCHEMA AND ITS APPLICATION IN CONTEMPORARY BRITISH PSYCHOLOGY , 1942 .

[5]  K. J. Craik,et al.  The nature of explanation , 1944 .

[6]  William Rowan,et al.  The Study of Instinct , 1953 .

[7]  J. Deese The psychology of learning , 1952 .

[8]  Allen Newell,et al.  Elements of a theory of human problem solving. , 1958 .

[9]  A. Luria,et al.  Disorders of "simultaneous perception" in a case of bilateral occipito-parietal brain injury. , 1959, Brain : a journal of neurology.

[10]  W. Walter The Living Brain , 1963 .

[11]  V. Braitenberg,et al.  Taxis, kinesis and decussation. , 1965, Progress in brain research.

[12]  D. M. MacKay,et al.  Cerebral Organization and the Conscious Control of Action , 1965 .

[13]  J. Eccles Brain and Conscious Experience , 1965 .

[14]  C. Blakemore,et al.  The neural mechanism of binocular depth discrimination , 1967, The Journal of physiology.

[15]  D. Ingle Visual Releasers of Prey-Catching Behavior in Frogs and Toads , 1968 .

[16]  G. Schneider Two visual systems. , 1969, Science.

[17]  W. L. Kilmer,et al.  A model of the vertebrate central command system. , 1969 .

[18]  L. Squire Mechanisms of memory. , 1986, Lancet.

[19]  Marvin Minsky,et al.  Perceptrons: An Introduction to Computational Geometry , 1969 .

[20]  H. L. Oestreicher,et al.  Principles and practice of bionics , 1970 .

[21]  G. Székely The mesencephalic and diencephalic optic centres in the frog. , 1971, Vision research.

[22]  D. Noton,et al.  Eye movements and visual perception. , 1971, Scientific American.

[23]  B. Julesz Foundations of Cyclopean Perception , 1971 .

[24]  N. Tsukahara The properties of the cerebello-pontine reverberating circuit. , 1972, Brain research.

[25]  G. Ratcliff,et al.  Defective visual localization in focal brain wounds. , 1972, Brain : a journal of neurology.

[26]  F. Newcombe,et al.  Spatial orientation in man: effects of left, right, and bilateral posterior cerebral lesions1 , 1973, Journal of neurology, neurosurgery, and psychiatry.

[27]  A. Luria The Working Brain , 1973 .

[28]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[29]  A. Tanenbaum Computer recreations , 1973 .

[30]  D. Ingle,et al.  Disinhibition of Tectal Neurons by Pretectal Lesions in the Frog , 1973, Science.

[31]  W von Seelen,et al.  [Neurobiology and system theory of a visual pattern recognition mechanism in the toad]. , 1973, Kybernetik.

[32]  J. Ewert The neural basis of visually guided behavior. , 1974, Scientific American.

[33]  Marvin Minsky,et al.  A framework for representing knowledge , 1974 .

[34]  M. Arbib,et al.  Conceptual models of neural organization. , 1974, Neurosciences Research Program bulletin.

[35]  Patrick J. Hayes,et al.  Some problems and non-problems in representation theory , 1974 .

[36]  R. Schmidt A schema theory of discrete motor skill learning. , 1975 .

[37]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[38]  William A. Woods,et al.  What's in a Link: Foundations for Semantic Networks , 1975 .

[39]  RICHARD L. DIDDAY,et al.  Eye Movements and Visual Perception: A "Two Visual System" Model , 1975, Int. J. Man Mach. Stud..

[40]  Michael A. Arbib,et al.  From Automata Theory to Brain Theory , 1975, Int. J. Man Mach. Stud..

[41]  J I Nelson,et al.  Globality and stereoscopic fusion in binocular vision. , 1975, Journal of theoretical biology.

[42]  D. Ingle Focal attention in the frog: behavioral and physiological correlates. , 1975, Science.

[43]  Parvati Dev,et al.  Perception of Depth Surfaces in Random-Dot Stereograms: A Neural Model , 1975, Int. J. Man Mach. Stud..

[44]  Donald O. Walter,et al.  Mass action in the nervous system , 1975 .

[45]  J. Tanji,et al.  Reflex and intended responses in motor cortex pyramidal tract neurons of monkey. , 1976, Journal of neurophysiology.

[46]  D Marr,et al.  Cooperative computation of stereo disparity. , 1976, Science.

[47]  G. Székely,et al.  Cellular and Synaptic Architecture of the Optic Tectum , 1976 .

[48]  R. Didday A model of visuomotor mechanisms in the frog optic tectum , 1976 .

[49]  T. Collett Stereopsis in toads , 1977, Nature.

[50]  C. Kase,et al.  Global spatial disorientation Clinico-pathologic correlations , 1977, Journal of the Neurological Sciences.

[51]  E. Bisiach,et al.  Unilateral Neglect of Representational Space , 1978, Cortex.

[52]  V. Mountcastle,et al.  An organizing principle for cerebral function : the unit module and the distributed system , 1978 .

[53]  K. D. Hamsher,et al.  Stereopsis and the perception of anomalous contours , 1978, Neuropsychologia.

[54]  Eric R. Kandel,et al.  A cell-biological approach to learning , 1978 .

[55]  D. Dennett Why not the whole iguana? , 1978, Behavioral and Brain Sciences.

[56]  Allen R. Hanson,et al.  Computer Vision Systems , 1978 .

[57]  N. Matsumoto,et al.  Intracellular Recordings of Tectal Cells of the Frog , 1978 .

[58]  J. Gibson The Ecological Approach to Visual Perception , 1979 .

[59]  M. Arbib,et al.  Neurolinguistics must be computational , 1979 .

[60]  G. Ratcliff Spatial thought, mental rotation and the right cerebral hemisphere , 1979, Neuropsychologia.

[61]  J. Ewert,et al.  Invariants in configurational prey selection by Bufo bufo (L.). , 1979, Brain, behavior and evolution.

[62]  Dieter Metzing,et al.  Frame conceptions and text understanding , 1980 .

[63]  Z. Pylyshyn Computation and cognition: issues in the foundations of cognitive science , 1980, Behavioral and Brain Sciences.

[64]  John K. Tsotsos,et al.  A framework for visual motion understanding , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[65]  H. Whiting,et al.  Motor development in children : aspects of coordination and control , 1986 .

[66]  U. Heiden Analysis Of Neural Networks , 1980 .

[67]  J P Frisby,et al.  The Computation of Binocular Edges , 1980, Perception.

[68]  Allen Newell,et al.  Physical Symbol Systems , 1980, Cogn. Sci..

[69]  John R. Searle,et al.  Minds, brains, and programs , 1980, Behavioral and Brain Sciences.

[70]  N. Matsumoto,et al.  Excitatory synaptic potentials and morphological classification of tectal neurons of the frog , 1980, Brain Research.

[71]  P. Hayes The Logic of Frames , 1981 .

[72]  D A Robinson,et al.  The use of control systems analysis in the neurophysiology of eye movements. , 1981, Annual review of neuroscience.

[73]  Azriel Rosenfeld,et al.  Cooperating Processes for Low-Level Vision: A Survey , 1981, Artif. Intell..

[74]  Michael A. Arbib,et al.  Perceptual Structures and Distributed Motor Control , 1981 .

[75]  Allen Newell,et al.  The Knowledge Level , 1989, Artif. Intell..

[76]  A. W. Ellis Normality and pathology in cognitive functions , 1982 .

[77]  Hector J. Levesque,et al.  An overview of Knowledge Representation , 1983, On Conceptual Modelling.

[78]  Michael A. Arbib,et al.  Neural Models of Language Processes , 1982 .

[79]  David Marr,et al.  VISION A Computational Investigation into the Human Representation and Processing of Visual Information , 2009 .

[80]  A. Butler Brain Mechanisms of Behavior in Lower Vertebrates edited by P. R. Laming, Cambridge University Press, 1981.£25 (hard cover) £11 (paperback) (x + 318 pages) ISBN 0 521 28168 7 , 1982, Trends in Neurosciences.

[81]  R. Mansfield,et al.  Analysis of visual behavior , 1982 .

[82]  Michael A. Arbib,et al.  Modelling Neural Mechanisms of Visuomotor Coordination in Frog and Toad , 1982 .

[83]  J. Ewert Advances in vertebrate neuroethology , 1982, Trends in Neurosciences.

[84]  E. Renzi Disorders of space exploration and cognition , 1982 .

[85]  M. Arbib,et al.  Multiple representations of space underlying behavior , 1982, Behavioral and Brain Sciences.

[86]  S. Amari,et al.  Competition and Cooperation in Neural Nets , 1982 .

[87]  M. Arbib,et al.  The role of the tectal column in facilitation of amphibian prey- catching behavior: a neural model , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[88]  Alan K. Mackworth Constraints, Descriptions and Domain Mappings in Computational Vision , 1983 .

[89]  G. Lázár,et al.  Morphology and location of tectal projection neurons in frogs: A study with hrp and cobalt‐filling , 1983, The Journal of comparative neurology.

[90]  William S. Havens,et al.  Representing Knowledge of the Visual World , 1983, Computer.

[91]  C SchankRoger,et al.  Dynamic Memory: A Theory of Reminding and Learning in Computers and People , 1983 .

[92]  Influence of the Optic Tectum and Prosencephalic Structures on Visually Controlled Prey-Catching and Avoidance Behaviors in the Fire Salamander , 1983 .

[93]  J. Fodor The Modularity of mind. An essay on faculty psychology , 1986 .

[94]  A. Treisman The Role of Attention in Object Perception , 1983 .

[95]  A M Aertsen,et al.  Reverse-correlation methods in auditory research , 1983, Quarterly Reviews of Biophysics.

[96]  S. Levin Lectu re Notes in Biomathematics , 1983 .

[97]  Michael A. Arbib,et al.  Port Automata and the Algebra of Concurrent Processes , 1983, J. Comput. Syst. Sci..

[98]  John R. Anderson The Architecture of Cognition , 1983 .

[99]  Michael A. Arbib,et al.  Computing the optic flow: The MATCH algorithm and prediction , 1983, Comput. Vis. Graph. Image Process..

[100]  Ronald J. Brachman,et al.  What IS-A Is and Isn't: An Analysis of Taxonomic Links in Semantic Networks , 1983, Computer.

[101]  H. Vanegas,et al.  Comparative neurology of the optic tectum , 1984 .

[102]  N. A. Bernshteĭn,et al.  Human motor actions : Bernstein reassessed , 1984 .

[103]  F. Crick Function of the thalamic reticular complex: the searchlight hypothesis. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[104]  T. Poggio,et al.  The analysis of stereopsis. , 1984, Annual review of neuroscience.

[105]  Zenon W. Pylyshyn,et al.  Computation and Cognition: Toward a Foundation for Cognitive Science , 1984 .

[106]  V. Braitenberg Vehicles, Experiments in Synthetic Psychology , 1984 .

[107]  John K. Tsotsos Knowledge and the visual process: Content, form and use , 1984, Pattern Recognit..

[108]  A. Pellionisz,et al.  Coordination: a vector-matrix description of transformations of overcomplete CNS coordinates and a tensorial solution using the Moore-Penrose generalized inverse. , 1984, Journal of theoretical biology.

[109]  G. Lázár,et al.  Structure and Connections of the Frog Optic Tectum , 1984 .

[110]  R Lara,et al.  A global model of the neural mechanisms responsible for visuomotor coordination in toads. , 1984, Journal of theoretical biology.

[111]  Ronald J. Brachman,et al.  "I Lied About the Trees", Or, Defaults and Definitions in Knowledge Representation , 1985, AI Mag..

[112]  J. Fodor Précis of The Modularity of Mind , 1985, Behavioral and Brain Sciences.

[113]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[114]  Edward R. Gruberg,et al.  Ablation of nucleus isthmi leads to loss of specific visually elicited behaviors in the frog Rana pipiens , 1985, Neuroscience Letters.

[115]  J. A. S. Kelso,et al.  Cooperative Phenomena in Biological Motion , 1985 .

[116]  Geoffrey E. Hinton,et al.  Shape Recognition and Illusory Conjunctions , 1985, IJCAI.

[117]  S. Amari,et al.  Sensori-motor transformations in the brain (with a critique of the tensor theory of cerebellum). , 1985, Journal of theoretical biology.

[118]  M. Arbib Coordinated control programs for movements of the hand , 1985 .

[119]  A G Barto,et al.  Learning by statistical cooperation of self-interested neuron-like computing elements. , 1985, Human neurobiology.

[120]  John K. Tsotsos Knowledge organization and its role in representation and interpretation for time‐varying data: the ALVEN system , 1985, Comput. Intell..

[121]  H. Levesque,et al.  Readings in Knowledge Representation , 1985 .

[122]  W. Freeman,et al.  Spatial EEG patterns, non-linear dynamics and perception: the neo-sherringtonian view , 1985, Brain Research Reviews.

[123]  J. Ogden Autotopagnosia. Occurrence in a patient without nominal aphasia and with an intact ability to point to parts of animals and objects. , 1985, Brain : a journal of neurology.

[124]  M. Arbib,et al.  A neural model of interactions subserving prey-predator discrimination and size preference in anuran amphibia. , 1985, Journal of theoretical biology.

[125]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[126]  C. Cohan,et al.  Convergence in a distributed nervous system: parallel processing and self-organization. , 1986, Journal of neurobiology.

[127]  D. Benson,et al.  Loss of topographic familiarity. An environmental agnosia. , 1986, Archives of neurology.

[128]  J D Holtzman,et al.  Components of visual attention. Alterations in response pattern to visual stimuli following parietal lobe infarction. , 1986, Brain : a journal of neurology.

[129]  A. Young,et al.  Functions of the Right Cerebral Hemisphere , 1986 .

[130]  C. Gielen,et al.  Coordination of arm muscles during flexion and supination: Application of the tensor analysis approach , 1986, Neuroscience.

[131]  G. Székely,et al.  Tectal neurons of the frog: Intracellular recording and labeling with cobalt electrodes , 1986, The Journal of comparative neurology.

[132]  J. Hopfield,et al.  Computing with neural circuits: a model. , 1986, Science.

[133]  Michael A. Arbib,et al.  In Search of the Person: Philosophical Explorations in Cognitive Science , 1986 .

[134]  H. Prechtl,et al.  Prenatal Motor Development , 1986 .

[135]  E. Thelen Development of Coordinated Movement: Implications for Early Human Development , 1986 .

[136]  Michael A. Arbib,et al.  The construction of reality , 1986 .

[137]  Ad Aertsen,et al.  From Synchrony to Harmony: Ideas on the Function of Neural Assemblies and on the Interpretation of Neural Synchrony , 1986 .

[138]  Yves Joanette,et al.  Pointing with left vs right hand in left visual field neglect , 1986, Neuropsychologia.

[139]  Yillbyung Lee,et al.  A Neural Network Model of Frog Retin: A Discrete Time-Saving Approach , 1986 .

[140]  D. Perani,et al.  Unilateral neglect: Personal and extra-personal , 1986, Neuropsychologia.

[141]  O. I. Fukson,et al.  Adaptability of innate motor patterns and motor control mechanisms , 1986, Behavioral and Brain Sciences.

[142]  Berthold K. P. Horn Robot vision , 1986, MIT electrical engineering and computer science series.

[143]  P. N. Kugler A Morphological Perspective on the Origin and Evolution of Movement Patterns , 1986 .

[144]  N. Miller Dyspraxia and its management , 1986 .

[145]  M. Arbib,et al.  Opposition Space as a Structuring Concept for the Analysis of Skilled Hand Movements , 1986 .

[146]  Terry Edward Waymouth Using object descriptions in a schema network for machine vision , 1986 .

[147]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[148]  M. Arbib Brains, Machines, and Mathematics , 1987, Springer US.

[149]  Michael A. Arbib,et al.  From Schema Theory To Language , 1987 .

[150]  G. Humphreys,et al.  To See But Not To See: A Case Study Of Visual Agnosia , 1987 .

[151]  U. Bellugi,et al.  What the hands reveal about the brain , 1987 .

[152]  Jay L. Garfield,et al.  Modularity in Knowledge Representation and Natural-Language Understanding , 1987 .

[153]  P. Langley,et al.  Production system models of learning and development , 1987 .

[154]  K. Prazdny,et al.  On the coarse-to-fine strategy in stereomatching , 1987 .

[155]  Allen Newell,et al.  Learning by chunking: a production system model of practice , 1987 .

[156]  Michael A. Arbib,et al.  Brains, machines and mathematics (2. ed.) , 1987 .

[157]  Allen Newell,et al.  GPS, a program that simulates human thought , 1995 .

[158]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[159]  Geoffrey E. Hinton,et al.  Parallel Models of Associative Memory , 1989 .