Generalization in vision and motor control

Learning is more than memory. It is not simply the building of a look-up table of labelled images, or a phone-directory-like list of motor acts and the corresponding sequences of muscle activation. Central to learning and intelligence is the ability to predict, that is, to generalize to new situations, beyond the memory of specific examples. The key to generalization, in turn, is the architecture of the system, more than the rules of synaptic plasticity. We propose a specific architecture for generalization for both the motor and the visual systems, and argue for a canonical microcircuit underlying visual and motor learning.

[1]  V. Mountcastle Modality and topographic properties of single neurons of cat's somatic sensory cortex. , 1957, Journal of neurophysiology.

[2]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[3]  É. D. L. Tour,et al.  Nouvelles observations concernant l’action du laurylsulfate de sodium sur la paroi et la membrane d’E. coli , 1965 .

[4]  D H HUBEL,et al.  RECEPTIVE FIELDS AND FUNCTIONAL ARCHITECTURE IN TWO NONSTRIATE VISUAL AREAS (18 AND 19) OF THE CAT. , 1965, Journal of neurophysiology.

[5]  M. Merzenich,et al.  Representation of the cochlear partition of the superior temporal plane of the macaque monkey. , 1973, Brain research.

[6]  M. Sanders Handbook of Sensory Physiology , 1975 .

[7]  R. Desimone,et al.  Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. , 1981, Journal of neurophysiology.

[8]  A P Georgopoulos,et al.  On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  N. Hogan An organizing principle for a class of voluntary movements , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[10]  S Grillner,et al.  Central pattern generators for locomotion, with special reference to vertebrates. , 1985, Annual review of neuroscience.

[11]  G. Loeb Motoneurone task groups: coping with kinematic heterogeneity. , 1985, The Journal of experimental biology.

[12]  T. Poggio A theory of how the brain might work. , 1990, Cold Spring Harbor symposia on quantitative biology.

[13]  R. Douglas,et al.  A functional microcircuit for cat visual cortex. , 1991, The Journal of physiology.

[14]  F A Mussa-Ivaldi,et al.  Computations underlying the execution of movement: a biological perspective. , 1991, Science.

[15]  F. Girosi,et al.  A Connection Between GRBF and MLP , 1992 .

[16]  H H Bülthoff,et al.  Psychophysical support for a two-dimensional view interpolation theory of object recognition. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[17]  David I. Perrett,et al.  Neurophysiology of shape processing , 1993, Image Vis. Comput..

[18]  K Tanaka,et al.  Neuronal mechanisms of object recognition. , 1993, Science.

[19]  C. Gross,et al.  Response properties of neurons in temporal cortical visual areas of infant monkeys. , 1993, Journal of neurophysiology.

[20]  E. Bizzi,et al.  Linear combinations of primitives in vertebrate motor control. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[21]  F A Mussa-Ivaldi,et al.  Adaptive representation of dynamics during learning of a motor task , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[22]  Keiji Tanaka,et al.  Neuronal selectivities to complex object features in the ventral visual pathway of the macaque cerebral cortex. , 1994, Journal of neurophysiology.

[23]  M. Carandini,et al.  Summation and division by neurons in primate visual cortex. , 1994, Science.

[24]  N. Logothetis,et al.  Shape representation in the inferior temporal cortex of monkeys , 1995, Current Biology.

[25]  L F Abbott,et al.  Transfer of coded information from sensory to motor networks , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[26]  P. Stein,et al.  Bilateral control of hindlimb scratching in the spinal turtle: contralateral spinal circuitry contributes to the normal ipsilateral motor pattern of fictive rostral scratching , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[27]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[28]  J. Movshon,et al.  Linearity and Normalization in Simple Cells of the Macaque Primary Visual Cortex , 1997, The Journal of Neuroscience.

[29]  G. Orban,et al.  Responses of macaque inferior temporal neurons to overlapping shapes. , 1997, Cerebral cortex.

[30]  T. Sejnowski,et al.  Spatial Transformations in the Parietal Cortex Using Basis Functions , 1997, Journal of Cognitive Neuroscience.

[31]  Keiji Tanaka,et al.  Effects of shape-discrimination training on the selectivity of inferotemporal cells in adult monkeys. , 1998, Journal of neurophysiology.

[32]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[33]  E. Rolls,et al.  View-invariant representations of familiar objects by neurons in the inferior temporal visual cortex. , 1998, Cerebral cortex.

[34]  Y. Frégnac,et al.  Visual input evokes transient and strong shunting inhibition in visual cortical neurons , 1998, Nature.

[35]  S. Wise,et al.  Changes in motor cortical activity during visuomotor adaptation , 1998, Experimental Brain Research.

[36]  E. Bizzi,et al.  Spinal cord modular organization and rhythm generation: an NMDA iontophoretic study in the frog. , 1998, Journal of neurophysiology.

[37]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[38]  E. Bizzi,et al.  Responses to spinal microstimulation in the chronically spinalized rat and their relationship to spinal systems activated by low threshold cutaneous stimulation , 1999, Experimental Brain Research.

[39]  Frances S. Chance,et al.  Complex cells as cortically amplified simple cells , 1999, Nature Neuroscience.

[40]  J. Maunsell,et al.  Form representation in monkey inferotemporal cortex is virtually unaltered by free viewing , 2000, Nature Neuroscience.

[41]  E. Bizzi,et al.  Cortical correlates of learning in monkeys adapting to a new dynamical environment. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[42]  W J Kargo,et al.  Rapid Correction of Aimed Movements by Summation of Force-Field Primitives , 2000, The Journal of Neuroscience.

[43]  Reza Shadmehr,et al.  Learning of action through adaptive combination of motor primitives , 2000, Nature.

[44]  E Bizzi,et al.  Motor learning through the combination of primitives. , 2000, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[45]  E. Bizzi,et al.  Modulation and vectorial summation of the spinalized frog's hindlimb end-point force produced by intraspinal electrical stimulation of the cord , 2001, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[46]  E. Bizzi,et al.  Neuronal Correlates of Motor Performance and Motor Learning in the Primary Motor Cortex of Monkeys Adapting to an External Force Field , 2001, Neuron.

[47]  Martin A. Giese,et al.  Biophysiologically Plausible Implementations of the Maximum Operation , 2002, Neural Computation.

[48]  Stephen H. Scott,et al.  Overlap of internal models in motor cortex for mechanical loads during reaching , 2002, Nature.

[49]  M. Tarr,et al.  Visual Object Recognition , 1996, ISTCS.

[50]  E. Vaadia,et al.  Preparatory activity in motor cortex reflects learning of local visuomotor skills , 2003, Nature Neuroscience.

[51]  A. Georgopoulos,et al.  Modular organization of directionally tuned cells in the motor cortex: Is there a short-range order? , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[52]  Emilio Bizzi,et al.  Combinations of muscle synergies in the construction of a natural motor behavior , 2003, Nature Neuroscience.

[53]  R. Zemel,et al.  Inference and computation with population codes. , 2003, Annual review of neuroscience.

[54]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[55]  T. Poggio,et al.  Cognitive neuroscience: Neural mechanisms for the recognition of biological movements , 2003, Nature Reviews Neuroscience.

[56]  T. Poggio,et al.  Figure-ground discrimination by relative movement in the visual system of the fly , 1979, Biological cybernetics.

[57]  R. Douglas,et al.  Neuronal circuits of the neocortex. , 2004, Annual review of neuroscience.

[58]  I. Gauthier,et al.  Visual object understanding , 2004, Nature Reviews Neuroscience.

[59]  T. Sato,et al.  Interactions of visual stimuli in the receptive fields of inferior temporal neurons in awake macaques , 2004, Experimental Brain Research.

[60]  J. Jing,et al.  The Construction of Movement with Behavior-Specific and Behavior-Independent Modules , 2004, The Journal of Neuroscience.

[61]  L. Chalupa,et al.  The visual neurosciences , 2004 .

[62]  R.B. Stein,et al.  The role of neuromuscular properties in determining the end-point of a movement , 2004, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[63]  M. Harries,et al.  Viewer-centred and object-centred coding of heads in the macaque temporal cortex , 2004, Experimental Brain Research.

[64]  J. K. Hietanen,et al.  The effects of lighting conditions on responses of cells selective for face views in the macaque temporal cortex , 2004, Experimental Brain Research.

[65]  N. Newman The Visual Neurosciences , 2005 .

[66]  T. Poggio,et al.  The Mathematics of Learning: Dealing with Data , 2005, 2005 International Conference on Neural Networks and Brain.