Time-to-Target Simplifies Optimal Control of Visuomotor Feedback Responses

Abstract Visuomotor feedback responses vary in intensity throughout a reach, commonly explained by optimal control. Here, we show that the optimal control for a range of movements with the same goal can be simplified to a time-to-target dependent control scheme. We measure our human participants’ visuomotor responses in five reaching conditions, each with different hand or cursor kinematics. Participants only produced different feedback responses when these kinematic changes resulted in different times-to-target. We complement our experimental data with a range of finite and non-finite horizon optimal feedback control (OFC) models, finding that the model with time-to-target as one of the input parameters best replicates the experimental data. Overall, this suggests that time-to-target is a critical control parameter in online feedback control. Moreover, we propose that for a specific task and known dynamics, humans can instantly produce a control signal without any additional online computation allowing rapid response onset and close to optimal control.

[1]  F. Lacquaniti,et al.  Does the brain model Newton's laws? , 2001, Nature Neuroscience.

[2]  Daniel M. Wolpert,et al.  A modular planar robotic manipulandum with end-point torque control , 2009, Journal of Neuroscience Methods.

[3]  F Crevecoeur,et al.  Feedback responses rapidly scale with the urgency to correct for external perturbations. , 2013, Journal of neurophysiology.

[4]  David W Franklin,et al.  Impedance control and internal model use during the initial stage of adaptation to novel dynamics in humans , 2005, The Journal of physiology.

[5]  Lionel Rigoux,et al.  A Model of Reward- and Effort-Based Optimal Decision Making and Motor Control , 2012, PLoS Comput. Biol..

[6]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[7]  R A Scheidt,et al.  Persistence of motor adaptation during constrained, multi-joint, arm movements. , 2000, Journal of neurophysiology.

[8]  C. Prablanc,et al.  Automatic control during hand reaching at undetected two-dimensional target displacements. , 1992, Journal of neurophysiology.

[9]  D. Wolpert,et al.  The Temporal Evolution of Feedback Gains Rapidly Update to Task Demands , 2013, The Journal of Neuroscience.

[10]  J. A. Pruszynski,et al.  Rapid motor responses are appropriately tuned to the metrics of a visuospatial task. , 2008, Journal of neurophysiology.

[11]  Zhong-Ping Jiang,et al.  Movement Duration, Fitts's Law, and an Infinite-Horizon Optimal Feedback Control Model for Biological Motor Systems , 2013, Neural Computation.

[12]  B. Day,et al.  Voluntary modification of automatic arm movements evoked by motion of a visual target , 1999, Experimental Brain Research.

[13]  Manu Chhabra,et al.  Flexible, Task-Dependent Use of Sensory Feedback to Control Hand Movements , 2011, The Journal of Neuroscience.

[14]  Sae Franklin,et al.  Rapid visuomotor feedback gains are tuned to the task dynamics , 2017, Journal of neurophysiology.

[15]  Sae Franklin,et al.  Visuomotor feedback gains upregulate during the learning of novel dynamics , 2012, Journal of neurophysiology.

[16]  Emmanuel Guigon,et al.  Computational Motor Control : Redundancy and Invariance , 2007 .

[17]  J. Diedrichsen,et al.  A Dedicated Binding Mechanism for the Visual Control of Movement , 2014, Current Biology.

[18]  J. Saunders,et al.  Humans use continuous visual feedback from the hand to control fast reaching movements , 2003, Experimental Brain Research.

[19]  J Randall Flanagan,et al.  Visuomotor feedback gains are modulated by gaze position. , 2018, Journal of neurophysiology.

[20]  Stephen H Scott,et al.  Visual Feedback Processing of the Limb Involves Two Distinct Phases , 2019, The Journal of Neuroscience.

[21]  Emanuel Todorov,et al.  Evidence for the Flexible Sensorimotor Strategies Predicted by Optimal Feedback Control , 2007, The Journal of Neuroscience.

[22]  David W. Franklin,et al.  When Optimal Feedback Control Is Not Enough: Feedforward Strategies Are Required for Optimal Control with Active Sensing , 2016, PLoS Comput. Biol..

[23]  David W Franklin,et al.  Rapid Feedback Responses Arise From Precomputed Gains. , 2016, Motor control.

[24]  Brian L. Day,et al.  Direct visuomotor mapping for fast visually-evoked arm movements , 2012, Neuropsychologia.

[25]  E. Todorov,et al.  A generalized iterative LQG method for locally-optimal feedback control of constrained nonlinear stochastic systems , 2005, Proceedings of the 2005, American Control Conference, 2005..

[26]  Helen J. Huang,et al.  A Representation of Effort in Decision-Making and Motor Control , 2016, Current Biology.

[27]  Sae Franklin,et al.  Fractionation of the visuomotor feedback response to directions of movement and perturbation , 2014, Journal of neurophysiology.

[28]  David C. Knill,et al.  Humans use continuous visual feedback from the hand to control both the direction and distance of pointing movements , 2005, Experimental Brain Research.

[29]  Frédéric Crevecoeur,et al.  Rapid Online Selection between Multiple Motor Plans , 2014, The Journal of Neuroscience.

[30]  Kelvin E. Jones,et al.  Sources of signal-dependent noise during isometric force production. , 2002, Journal of neurophysiology.

[31]  J. A. Pruszynski,et al.  A rapid visuomotor response on the human upper limb is selectively influenced by implicit motor learning. , 2019, Journal of neurophysiology.

[32]  F. Lacquaniti,et al.  Internal models of target motion: expected dynamics overrides measured kinematics in timing manual interceptions. , 2004, Journal of neurophysiology.

[33]  J. Duysens,et al.  Postural responses to target jumps and background motion in a fast pointing task , 2018, Experimental Brain Research.

[34]  Daniel M. Wolpert,et al.  Making smooth moves , 2022 .

[35]  Daniel Bullock,et al.  Prospective control of manual interceptive actions: comparative simulations of extant and new model constructs , 2001, Neural Networks.

[36]  Emanuel Todorov,et al.  Stochastic Optimal Control and Estimation Methods Adapted to the Noise Characteristics of the Sensorimotor System , 2005, Neural Computation.

[37]  Agnès Roby-Brami,et al.  Experimental and theoretical study of velocity fluctuations during slow movements in humans. , 2019, Journal of neurophysiology.

[38]  Abigail A. Russo,et al.  Neural Trajectories in the Supplementary Motor Area and Motor Cortex Exhibit Distinct Geometries, Compatible with Different Classes of Computation , 2019, Neuron.

[39]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[40]  Hubert Ripoll,et al.  Time-to-contact estimation of accelerated stimuli is based on first-order information. , 2003, Journal of experimental psychology. Human perception and performance.

[41]  David C Knill,et al.  Visual Feedback Control of Hand Movements , 2004, The Journal of Neuroscience.

[42]  J. Vercher,et al.  Target and hand position information in the online control of goal-directed arm movements , 2003, Experimental Brain Research.

[43]  Sae Franklin,et al.  Temporal Evolution of Spatial Computations for Visuomotor Control , 2016, The Journal of Neuroscience.

[44]  Kelvin E. Jones,et al.  The scaling of motor noise with muscle strength and motor unit number in humans , 2004, Experimental Brain Research.

[45]  Reza Shadmehr,et al.  Motor Adaptation as a Process of Reoptimization , 2008, The Journal of Neuroscience.

[46]  J Randall Flanagan,et al.  Parallel Specification of Visuomotor Feedback Gains during Bimanual Reaching to Independent Goals , 2017, eNeuro.

[47]  R. C. Oldfield.  The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[48]  Emmanuel Guigon,et al.  Optimality, stochasticity, and variability in motor behavior , 2008, Journal of Computational Neuroscience.

[49]  E. Brenner,et al.  Fast and fine-tuned corrections when the target of a hand movement is displaced , 2011, Experimental Brain Research.

[50]  Stephen H Scott,et al.  Influence of the behavioral goal and environmental obstacles on rapid feedback responses. , 2012, Journal of neurophysiology.

[51]  Daniel A. Braun,et al.  Optimal Control Predicts Human Performance on Objects with Internal Degrees of Freedom , 2009, PLoS Comput. Biol..

[52]  Etienne Olivier,et al.  Visual Responses on Neck Muscles Reveal Selective Gating that Prevents Express Saccades , 2004, Neuron.

[53]  Luigi Acerbi,et al.  Practical Bayesian Optimization for Model Fitting with Bayesian Adaptive Direct Search , 2017, NIPS.

[54]  J. A. Pruszynski,et al.  Optimal feedback control and the long-latency stretch response , 2012, Experimental Brain Research.

[55]  D. Wolpert,et al.  Specificity of Reflex Adaptation for Task-Relevant Variability , 2008, The Journal of Neuroscience.