The Undershoot Bias

Learning in stochastic environments is increasingly viewed as an important psychological ability. To extend these results from a perceptual to a motor domain, we tested whether participants could learn to solve a stochastic minimal-time task using exploratory learning. The task involved moving a cursor on a computer screen to a target. We systematically varied the degree of random error in movement in three different conditions; each condition had a distinct time-optimal solution. We found that participants approximated the optimal solutions with practice. The results show that adults are sensitive to the stochastic structure of a task and naturally adjust the magnitude of an undershoot bias to the particular movement error of a task.

[1]  Daniel M. Wolpert,et al.  Making smooth moves , 2022 .

[2]  E. Newport,et al.  Computation of Conditional Probability Statistics by 8-Month-Old Infants , 1998 .

[3]  H. Clamann.  Statistical analysis of motor unit firing patterns in a human skeletal muscle. , 1969, Biophysical journal.

[4]  Sascha E. Engelbrecht,et al.  Minimum Principles in Motor Control. , 2001, Journal of mathematical psychology.

[5]  C. Von Hofsten.  Structuring of early reaching movements: a longitudinal study. , 1991, Journal of motor behavior.

[6]  Andrew G. Barto,et al.  Reinforcement learning , 1998 .

[7]  Steven W. Keele,et al.  Movement control in skilled motor performance. , 1968 .

[8]  N. Berthier.  Learning to reach: A mathematical model. , 1996 .

[9]  D. Elliott,et al.  Visual regulation of manual aiming , 1993 .

[10]  Ivan Toni,et al.  Differential influence of the visual framework on end point accuracy and trajectory specification of arm movements , 1996, Experimental Brain Research.

[11]  Dimitri P. Bertsekas,et al.  Dynamic Programming: Deterministic and Stochastic Models , 1987 .

[12]  D. Henson.  Corrective saccades: Effects of altering visual feedback , 1978, Vision Research.

[13]  John N. Tsitsiklis,et al.  Neuro-Dynamic Programming , 1996, Encyclopedia of Machine Learning.

[14]  G. Magenes,et al.  Eye-head-hand coordination in pointing at visual targets: spatial and temporal analysis , 2004, Experimental Brain Research.

[15]  E. R. Crossman,et al.  Feedback Control of Hand-Movement and Fitts' Law , 1983, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[16]  W. Helsen,et al.  A century later: Woodworth's (1899) two-component model of goal-directed aiming. , 2001, Psychological bulletin.

[17]  H. Zelaznik,et al.  Motor-output variability: a theory for the accuracy of rapid motor acts. , 1979, Psychological review.

[18]  R. Bellman,et al.  V. Adaptive Control Processes , 1964 .

[19]  Richard N. Aslin,et al.  Saccadic localization of visual targets by the very young human infant , 1975 .

[20]  N. Berthier,et al.  Infants' predictive reaching for moving objects in the dark. , 1996 .

[21]  R A Abrams,et al.  Optimality in human motor performance: ideal control of rapid aimed movements. , 1988, Psychological review.

[22]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[23]  C. Harris,et al.  Does saccadic undershoot minimize saccadic flight-time? A Monte-Carlo study , 1995, Vision Research.

[24]  Toshio Odanaka,et al.  ADAPTIVE CONTROL PROCESSES , 1990 .

[25]  C. Stevens,et al.  Synaptic noise and other sources of randomness in motoneuron interspike intervals. , 1968, Journal of neurophysiology.

[26]  D. Meyer,et al.  Models for the speed and accuracy of aimed movements. , 1982, Psychological review.

[27]  R. Aslin,et al.  PSYCHOLOGICAL SCIENCE Research Article UNSUPERVISED STATISTICAL LEARNING OF HIGHER-ORDER SPATIAL STRUCTURES FROM VISUAL SCENES , 2022 .

[28]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.