A Connectionist Model May Shed Light on Neural Mechanisms for Visually Guided Reaching

Formal principles of vision-based planning and control of arm movements are used to gain insight into the neurobio-logical mechanisms that underlie this important class of sen-sorimotor behavior. The primary conceptual tool used in this work has been a neurally inspired connectionist system called MURPHY that learns to reach for visual targets among obstacles, crudely based on the style of architecture and representations in sensory and motor areas of cerebral cortex. This system has provided a concrete implementation that demonstrates how areas of cerebral cortex could in principle interact to direct both sensory-locked and internally planned reaching movements. We use MURPHY'S simple, artificial cortex as a point of departure in the development of two high-level cortical models for visual limb control, involving the supplementary motor area (SMA), areas 5 and 7 of the posterior parietal lobe, and several visually responsive areas including V2, PO, and areas TPO and STP in the upper bank of the superior temporal sulcus.

[1]  G. Bonin,et al.  The neocortex of Macaca mulatta , 1947 .

[2]  F. M. Henry,et al.  Increased Response Latency for Complicated Movements and A “Memory Drum” Theory of Neuromotor Reaction , 1960 .

[3]  John Paul Brady,et al.  Neural bases of behavior. , 1963 .

[4]  R. Held Plasticity in sensory-motor systems. , 1965, Scientific American.

[5]  N. A. Bernshteĭn The co-ordination and regulation of movements , 1967 .

[6]  J. Hyvärinen,et al.  Function of the parietal associative area 7 as revealed from cellular discharges in alert monkeys. , 1974, Brain : a journal of neurology.

[7]  V. Mountcastle,et al.  Posterior parietal association cortex of the monkey: command functions for operations within extrapersonal space. , 1975, Journal of neurophysiology.

[8]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.

[9]  V B Mountcastle,et al.  The world around us: neural command function for selective attention. , 1976, Neurosciences Research Program bulletin.

[10]  Stephen M. Kosslyn,et al.  A Simulation of Visual Imagery , 1977, Cogn. Sci..

[11]  J. Talairach,et al.  Clinical consequences of corticectomies involving the supplementary motor area in man , 1977, Journal of the Neurological Sciences.

[12]  S. T. Klapp,et al.  REACTION TIME ANALYSIS Of PROGRAMMED CONTROL , 1977, Exercise and sport sciences reviews.

[13]  H. Kuypers,et al.  Premotor cortical ablations in monkeys: contralateral changes in visually guided reaching behavior. , 1977, Science.

[14]  D. Pandya,et al.  Afferent cortical connections and architectonics of the superior temporal sulcus and surrounding cortex in the rhesus monkey , 1978, Brain Research.

[15]  Steven P. Shwartz,et al.  On the demystification of mental imagery , 1979, Behavioral and Brain Sciences.

[16]  Juhani Hyvärinen,et al.  Distribution of visual and somatic functions in the parietal associative area 7 of the monkey , 1979, Brain Research.

[17]  P. Roland,et al.  Different cortical areas in man in organization of voluntary movements in extrapersonal space. , 1980, Journal of neurophysiology.

[18]  P. Roland,et al.  Supplementary motor area and other cortical areas in organization of voluntary movements in man. , 1980, Journal of neurophysiology.

[19]  J. Lynch The functional organization of posterior parietal association cortex , 1980, Behavioral and Brain Sciences.

[20]  R. Desimone,et al.  Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. , 1981, Journal of neurophysiology.

[21]  D. Robinson,et al.  Behavioral enhancement of visual responses in monkey cerebral cortex. I. Modulation in posterior parietal cortex related to selective visual attention. , 1981, Journal of neurophysiology.

[22]  J. Paillard,et al.  Visual motion cues in prismatic adaptation: evidence of two separate and additive processes. , 1981, Acta psychologica.

[23]  D. Pandya,et al.  Intrinsic connections and architectonics of posterior parietal cortex in the rhesus monkey , 1982, The Journal of comparative neurology.

[24]  A P Georgopoulos,et al.  On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[25]  R. Shepard,et al.  Mental Images and Their Transformations , 1982 .

[26]  John H. R. Maunsell,et al.  Hierarchical organization and functional streams in the visual cortex , 1983, Trends in Neurosciences.

[27]  Geoffrey E. Hinton,et al.  Parallel visual computation , 1983, Nature.

[28]  John H. R. Maunsell,et al.  The connections of the middle temporal visual area (MT) and their relationship to a cortical hierarchy in the macaque monkey , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[29]  R. Brooks Planning Collision- Free Motions for Pick-and-Place Operations , 1983 .

[30]  R. Desimone,et al.  Stimulus-selective properties of inferior temporal neurons in the macaque , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[31]  Bernard Faverjon,et al.  Obstacle avoidance using an octree in the configuration space of a manipulator , 1984, ICRA.

[32]  N. Hogan An organizing principle for a class of voluntary movements , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[33]  J. Lockman The development of detour ability during infancy. , 1984, Child development.

[34]  Y. Lamarre,et al.  Discharge properties of area 5 neurones during arm movements triggered by sensory stimuli in the monkey , 1984, Brain Research.

[35]  V. Mountcastle The visual functions of the parietal lobe , 1984, Behavioural Brain Research.

[36]  D. Pandya,et al.  Projections to the frontal cortex from the posterior parietal region in the rhesus monkey , 1984, The Journal of comparative neurology.

[37]  S. Wise The primate premotor cortex: past, present, and preparatory. , 1985, Annual review of neuroscience.

[38]  R. Andersen,et al.  The thalamic relations of the caudal inferior parietal lobule and the lateral prefrontal cortex in monkeys: Divergent cortical projections from cell clusters in the medial pulvinar nucleus , 1985, The Journal of comparative neurology.

[39]  Charles G. Gross,et al.  Pattern recognition mechanisms , 1985 .

[40]  P E Roland,et al.  Localization of cortical areas activated by thinking. , 1985, Journal of neurophysiology.

[41]  R. Lemon,et al.  The involvement of monkey premotor cortex neurones in preparation of visually cued arm movements , 1985, Behavioural Brain Research.

[42]  R. Andersen,et al.  Callosal and prefrontal associational projecting cell populations in area 7A of the macaque monkey: A study using retrogradely transported fluorescent dyes , 1985, The Journal of comparative neurology.

[43]  G. Goldberg Supplementary motor area structure and function: Review and hypotheses , 1985, Behavioral and Brain Sciences.

[44]  C. Atkeson,et al.  Kinematic features of unrestrained vertical arm movements , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[45]  Ellen Covey,et al.  Cortical Visual Areas of the Macaque: Possible Substrates for Pattern Recognition Mechanisms , 1985 .

[46]  Oussama Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1986 .

[47]  Roger N. Shepard,et al.  Visual functions of mental imagery , 1986 .

[48]  Geoffrey E. Hinton,et al.  A general framework for parallel distributed processing , 1986 .

[49]  Tomas Lozano-Perez A simple motion-planning algorithm for general robot manipulators , 1986, IEEE J. Robotics Autom..

[50]  Bartlett W. Mel MURPHY: A Robot that Learns by Doing , 1987, NIPS.

[51]  James L. McClelland,et al.  Open Questions About Computation in Cerebral Cortex , 1987 .

[52]  S. Kosslyn Seeing and imagining in the cerebral hemispheres: a computational approach. , 1987, Psychological review.

[53]  A. J. Mistlin,et al.  Visual neurones responsive to faces , 1987, Trends in Neurosciences.

[54]  Stephen M. Omohundro,et al.  Efficient Algorithms with Neural Network Behavior , 1987, Complex Syst..

[55]  Daniel Bullock,et al.  Neural dynamics of planned arm movements: emergent invariants and speed-accuracy properties during trajectory formation , 1988 .

[56]  M. Farah Is visual imagery really visual? Overlooked evidence from neuropsychology. , 1988, Psychological review.

[57]  R. Andersen,et al.  The role of the posterior parietal cortex in coordinate transformations for visual-motor integration. , 1988, Canadian journal of physiology and pharmacology.

[58]  C. Gross,et al.  Topographical organization of cortical afferents to extrastriate visual area PO in the macaque: A dual tracer study , 1988, The Journal of comparative neurology.

[59]  G. Rizzolatti Motor and visual-motor functions of the premotor cortex , 1988 .

[60]  N Hogan,et al.  Planning and execution of multijoint movements. , 1988, Canadian journal of physiology and pharmacology.

[61]  S. Grossberg,et al.  Neural dynamics of planned arm movements: emergent invariants and speed-accuracy properties during trajectory formation. , 1988, Psychological review.

[62]  M Kuperstein,et al.  Neural model of adaptive hand-eye coordination for single postures. , 1988, Science.

[63]  T Flash,et al.  Generation of reaching movements: plausibility and implications of the equilibrium trajectory hypothesis. , 1989, Brain, behavior and evolution.

[64]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[65]  P. Goldman-Rakic,et al.  Posterior parietal cortex in rhesus monkey: II. Evidence for segregated corticocortical networks linking sensory and limbic areas with the frontal lobe , 1989, The Journal of comparative neurology.

[66]  J. T. Massey,et al.  Mental rotation of the neuronal population vector. , 1989, Science.

[67]  D. Pandya,et al.  Anatomical investigation of projections to the basis pontis from posterior parietal association cortices in rhesus monkey , 1989, The Journal of comparative neurology.

[68]  R. Andersen Visual and eye movement functions of the posterior parietal cortex. , 1989, Annual review of neuroscience.

[69]  P. Goldman-Rakic,et al.  Posterior parietal cortex in rhesus monkey: I. Parcellation of areas based on distinctive limbic and sensory corticocortical connections , 1989, The Journal of comparative neurology.

[70]  A. Riehle,et al.  Monkey primary motor and premotor cortex: single-cell activity related to prior information about direction and extent of an intended movement. , 1989, Journal of neurophysiology.

[71]  G. Edelman,et al.  Signal and sense : local and global order in perceptual maps , 1990 .

[72]  Oussama Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1985, Autonomous Robot Vehicles.

[73]  Geoffrey E. Hinton,et al.  Distributed Representations , 1986, The Philosophy of Artificial Intelligence.

[74]  G. E. Alexander,et al.  Preparation for movement: neural representations of intended direction in three motor areas of the monkey. , 1990, Journal of neurophysiology.

[75]  M. Delong,et al.  Primate models of movement disorders of basal ganglia origin , 1990, Trends in Neurosciences.

[76]  G. E. Alexander,et al.  Functional architecture of basal ganglia circuits: neural substrates of parallel processing , 1990, Trends in Neurosciences.

[77]  Bartlett W. Mel,et al.  How Receptive Field Parameters Affect Neural Learning , 1990, NIPS.

[78]  Rodney A. Brooks,et al.  Solving the Find-Path Problem by Good Representation of Free Space , 1983, Autonomous Robot Vehicles.

[79]  Cognitive and motor deficits in the performance of an object retrieval task with a barrier-detour in monkeys (Cercopithecus aethiops sabaeus) treated with MPTP: long-term performance and effect of transparency of the barrier. , 1990, Behavioral neuroscience.

[80]  R. Roth,et al.  Cognitive and motor deficits in the performance of an object retrieval task with a barrier-detour in monkeys (Cercopithecus aethiops sabaeus) treated with MPTP: long-term performance and effect of transparency of the barrier. , 1990, Behavioral neuroscience.

[81]  Jean-Claude Latombe,et al.  Robot motion planning , 1970, The Kluwer international series in engineering and computer science.

[82]  N. Hogan,et al.  Does the nervous system use equilibrium-point control to guide single and multiple joint movements? , 1992, The Behavioral and brain sciences.

[83]  J. Stein The representation of egocentric space in the posterior parietal cortex. , 1992, The Behavioral and brain sciences.

[84]  P. Crago,et al.  Equilibrium-point hypothesis, minimum effort control strategy and the triphasic muscle activation pattern , 1992 .