The advantage of flexible neuronal tunings in neural network models for motor learning

Human motor adaptation to novel environments is often modeled by a basis function network that transforms desired movement properties into estimated forces. This network employs a layer of nodes that have fixed broad tunings that generalize across the input domain. Learning is achieved by updating the weights of these nodes in response to training experience. This conventional model is unable to account for rapid flexibility observed in human spatial generalization during motor adaptation. However, added plasticity in the widths of the basis function tunings can achieve this flexibility, and several neurophysiological experiments have revealed flexibility in tunings of sensorimotor neurons. We found a model, Locally Weighted Projection Regression (LWPR), which uniquely possesses the structure of a basis function network in which both the weights and tuning widths of the nodes are updated incrementally during adaptation. We presented this LWPR model with training functions of different spatial complexities and monitored incremental updates to receptive field widths. An inverse pattern of dependence of receptive field adaptation on experienced error became evident, underlying both a relationship between generalization and complexity, and a unique behavior in which generalization always narrows after a sudden switch in environmental complexity. These results implicate a model that is flexible in both basis function widths and weights, like LWPR, as a viable alternative model for human motor adaptation that can account for previously observed plasticity in spatial generalization. This theory can be tested by using the behaviors observed in our experiments as novel hypotheses in human studies.

[1]  Alexandre Pouget,et al.  Computational approaches to sensorimotor transformations , 2000, Nature Neuroscience.

[2]  Kalle Lyytinen,et al.  Reach and Grasp , 2004, MIS Q..

[3]  Stefan Schaal,et al.  Incremental Online Learning in High Dimensions , 2005, Neural Computation.

[4]  Bernhard Schölkopf,et al.  Learning Inverse Dynamics: a Comparison , 2008, ESANN.

[5]  A B Schwartz,et al.  Motor cortical representation of speed and direction during reaching. , 1999, Journal of neurophysiology.

[6]  J. Stein,et al.  Neuronal activity in the lateral cerebellum of trained monkeys, related to visual stimuli or to eye movements. , 1990, The Journal of physiology.

[7]  Sherwin S Chan,et al.  Motor cortical representation of position and velocity during reaching. , 2007, Journal of neurophysiology.

[8]  A. P. Georgopoulos,et al.  Movement parameters and neural activity in motor cortex and area 5. , 1994, Cerebral cortex.

[9]  J. Movshon,et al.  Adaptation changes the direction tuning of macaque MT neurons , 2004, Nature Neuroscience.

[10]  Philippe Gorce,et al.  A neural network architecture to learn arm motion planning in grasping tasks with obstacle avoidance , 2005, Robotica.

[11]  P. Lennie,et al.  Rapid adaptation in visual cortex to the structure of images. , 1999, Science.

[12]  F A Mussa-Ivaldi,et al.  Adaptive representation of dynamics during learning of a motor task , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[13]  G. Orban,et al.  Practising orientation identification improves orientation coding in V1 neurons , 2001, Nature.

[14]  S. Lisberger,et al.  Visual responses of Purkinje cells in the cerebellar flocculus during smooth-pursuit eye movements in monkeys. I. Simple spikes. , 1990, Journal of neurophysiology.

[15]  Kurt A. Thoroughman,et al.  Rapid Reshaping of Human Motor Generalization , 2005, The Journal of Neuroscience.

[16]  A. Schwartz,et al.  Motor cortical activity during drawing movements: population representation during sinusoid tracing. , 1993, Journal of neurophysiology.

[17]  Heiko Hoffmann,et al.  Sensor-assisted adaptive motor control under continuously varying context , 2007, ICINCO-ICSO.

[18]  A. Georgopoulos,et al.  Cognitive neurophysiology of the motor cortex. , 1993, Science.

[19]  J. Baizer,et al.  Cerebellar lesions and prism adaptation in macaque monkeys. , 1999, Journal of neurophysiology.

[20]  Stefan Schaal,et al.  Statistical Learning for Humanoid Robots , 2002, Auton. Robots.

[21]  A. P. Georgopoulos,et al.  Primate motor cortex and free arm movements to visual targets in three- dimensional space. II. Coding of the direction of movement by a neuronal population , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[22]  Bart Krekelberg,et al.  Adaptation in macaque MT reduces perceived speed and improves speed discrimination. , 2006, Journal of neurophysiology.

[23]  R. Shadmehr,et al.  Intact ability to learn internal models of arm dynamics in Huntington's disease but not cerebellar degeneration. , 2005, Journal of neurophysiology.

[24]  A. Schwartz Motor cortical activity during drawing movements: single-unit activity during sinusoid tracing. , 1992, Journal of neurophysiology.

[25]  L. Paninski,et al.  Spatiotemporal tuning of motor cortical neurons for hand position and velocity. , 2004, Journal of neurophysiology.

[26]  T. Ebner,et al.  Cerebellar Purkinje Cell Simple Spike Discharge Encodes Movement Velocity in Primates during Visuomotor Arm Tracking , 1999, The Journal of Neuroscience.

[27]  A. Schwartz,et al.  Motor cortical activity during drawing movements: population representation during spiral tracing. , 1999, Journal of neurophysiology.

[28]  S. Lisberger,et al.  Visual responses of Purkinje cells in the cerebellar flocculus during smooth-pursuit eye movements in monkeys. II. Complex spikes. , 1990, Journal of neurophysiology.

[29]  E. Bizzi,et al.  Cortical correlates of learning in monkeys adapting to a new dynamical environment. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[30]  G. Teti,et al.  Reach and Grasp for an Anthropomorphic Robotic System based on Sensorimotor Learning , 2006, The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, 2006. BioRob 2006..

[31]  T. Ebner,et al.  Hereditary cerebellar ataxia progressively impairs force adaptation during goal-directed arm movements. , 2004, Journal of neurophysiology.

[32]  Stephane Molotchnikoff,et al.  Visual Cells Remember Earlier Applied Target: Plasticity of Orientation Selectivity , 2008, PloS one.

[33]  Christopher G. Atkeson,et al.  Constructive Incremental Learning from Only Local Information , 1998, Neural Computation.

[34]  T J Ebner,et al.  Encoding of target direction and speed during visual instruction and arm tracking in dorsal premotor and primary motor cortical neurons , 1999, The European journal of neuroscience.

[35]  Christopher K. I. Williams,et al.  Model Selection and Adaptation of Hyperparameters , 2005 .

[36]  D Timmann,et al.  Adaptation to visuomotor rotation and force field perturbation is correlated to different brain areas in patients with cerebellar degeneration. , 2009, Journal of neurophysiology.

[37]  Joshua G. Hale,et al.  Using Humanoid Robots to Study Human Behavior , 2000, IEEE Intell. Syst..

[38]  A. Georgopoulos,et al.  The motor cortex and the coding of force. , 1992, Science.

[39]  Tomaso Poggio,et al.  Generalization in vision and motor control , 2004, Nature.

[40]  A. Schwartz,et al.  Motor cortical activity during drawing movements: population representation during lemniscate tracing. , 1999 .

[41]  J. Hore,et al.  Changes in motor cortex neural discharge associated with the development of cerebellar limb ataxia. , 1988, Journal of neurophysiology.

[42]  Eilon Vaadia,et al.  Learning-Induced Improvement in Encoding and Decoding of Specific Movement Directions by Neurons in the Primary Motor Cortex , 2004, PLoS biology.

[43]  N. Mano,et al.  Simple-spike activity of cerebellar Purkinje cells related to visually guided wrist tracking movement in the monkey. , 1980, Journal of neurophysiology.

[44]  Tatsuya Kimura,et al.  Cerebellar complex spikes encode both destinations and errors in arm movements , 1998, Nature.

[45]  Reza Shadmehr,et al.  Learning of action through adaptive combination of motor primitives , 2000, Nature.