Optimal control of a hybrid rhythmic-discrete task: the bouncing ball revisited.

Rhythmically bouncing a ball with a racket is a hybrid task that combines continuous rhythmic actuation of the racket with the control of discrete impact events between racket and ball. This study presents experimental data and a two-layered modeling framework that explicitly addresses the hybrid nature of control: a first discrete layer calculates the state to reach at impact and the second continuous layer smoothly drives the racket to this desired state, based on optimality principles. The testbed for this hybrid model is task performance at a range of increasingly slower tempos. When slowing the rhythm of the bouncing actions, the continuous cycles become separated into a sequence of discrete movements interspersed by dwell times and directed to achieve the desired impact. Analyses of human performance show increasing variability of performance measures with slower tempi, associated with a change in racket trajectories from approximately sinusoidal to less symmetrical velocity profiles. Matching results of model simulations give support to a hybrid control model based on optimality, and therefore suggest that optimality principles are applicable to the sensorimotor control of complex movements such as ball bouncing.

[1]  Q. Mcnemar Note on the sampling error of the difference between correlated proportions or percentages , 1947, Psychometrika.

[2]  Maurice G. Kendall The advanced theory of statistics , 1958 .

[3]  L. Pinneo On noise in the nervous system. , 1966, Psychological review.

[4]  J. Gibson The Senses Considered As Perceptual Systems , 1967 .

[5]  David N. Lee,et al.  Visual Timing in Hitting An Accelerating Ball , 1983, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[6]  R. Shepard Ecological constraints on internal representation: resonant kinematics of perceiving, imagining, thinking, and dreaming. , 1984, Psychological review.

[7]  R. Hartley Stochastic Modelling and Control , 1985 .

[8]  F. Lacquaniti,et al.  Anticipatory and reflex coactivation of antagonist muscles in catching , 1987, Brain Research.

[9]  J. Kelso,et al.  Skilled actions: a task-dynamic approach. , 1987, Psychological review.

[10]  P. Goldman-Rakic,et al.  Posterior parietal cortex in rhesus monkey: I. Parcellation of areas based on distinctive limbic and sensory corticocortical connections , 1989, The Journal of comparative neurology.

[11]  F. Lacquaniti,et al.  The role of preparation in tuning anticipatory and reflex responses during catching , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  Tad McGeer,et al.  Passive Dynamic Walking , 1990, Int. J. Robotics Res..

[13]  N. A. Borghese,et al.  Transient reversal of the stretch reflex in human arm muscles. , 1991, Journal of neurophysiology.

[14]  N. A. Borghese,et al.  Internal models of limb geometry in the control of hand compliance , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[15]  C. Prablanc,et al.  Automatic control during hand reaching at undetected two-dimensional target displacements. , 1992, Journal of neurophysiology.

[16]  P. Werkhoven,et al.  Visual processing of optic acceleration , 1992, Vision Research.

[17]  Francesco Lacquaniti,et al.  The role of vision in tuning anticipatory motor responses of the limbs , 1993 .

[18]  K. J. Cole,et al.  Memory representations underlying motor commands used during manipulation of common and novel objects. , 1993, Journal of neurophysiology.

[19]  D. Regan,et al.  Dissociation of discrimination thresholds for time to contact and for rate of angular expansion , 1993, Vision Research.

[20]  N. A. Borghese,et al.  Time-varying mechanical behavior of multijointed arm in man. , 1993, Journal of neurophysiology.

[21]  R. Ivry,et al.  Perception and production of temporal intervals across a range of durations: evidence for a common timing mechanism. , 1995, Journal of experimental psychology. Human perception and performance.

[22]  E Bizzi,et al.  Motor learning by field approximation. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[23]  F. Paas,et al.  Dwell time in reciprocal aiming tasks , 1996 .

[24]  S. Schaal,et al.  One-Handed Juggling: A Dynamical Approach to a Rhythmic Movement Task. , 1996, Journal of motor behavior.

[25]  Paul B. Johnson,et al.  Cortical networks for visual reaching: physiological and anatomical organization of frontal and parietal lobe arm regions. , 1996, Cerebral cortex.

[26]  Daeyeol Lee,et al.  Manual interception of moving targets I. Performance and movement initiation , 1997, Experimental Brain Research.

[27]  R. Hari,et al.  Cortical control of human motoneuron firing during isometric contraction. , 1997, Journal of neurophysiology.

[28]  J R Flanagan,et al.  The Role of Internal Models in Motion Planning and Control: Evidence from Grip Force Adjustments during Movements of Hand-Held Loads , 1997, The Journal of Neuroscience.

[29]  R. Bootsma,et al.  On the information-based regulation of movement: What Wann (1996) may want to consider , 1997 .

[30]  Seth Krantz,et al.  Discussion , 1998, Neuroscience.

[31]  Daniel M. Wolpert,et al.  Signal-dependent noise determines motor planning , 1998, Nature.

[32]  Marion A. Eppler,et al.  Development of Visually Guided Locomotion , 1998 .

[33]  E. Brenner,et al.  Hitting moving targets Continuous control of the acceleration of the hand on the basis of the target’s velocity , 1998, Experimental Brain Research.

[34]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[35]  A. G. Witney,et al.  Predictive motor learning of temporal delays. , 1999, Journal of neurophysiology.

[36]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[37]  Simon K. Rushton,et al.  Weighted combination of size and disparity: a computational model for timing a ball catch , 1999, Nature Neuroscience.

[38]  K. Chang,et al.  Subregions within the Supplementary Motor Area Activated at Different Stages of Movement Preparation and Execution , 1999, NeuroImage.

[39]  J. Tresilian Visually timed action: time-out for ‘tau’? , 1999, Trends in Cognitive Sciences.

[40]  John W. Krakauer,et al.  Independent learning of internal models for kinematic and dynamic control of reaching , 1999, Nature Neuroscience.

[41]  Stefan Schaal,et al.  Interaction of rhythmic and discrete pattern generators in single-joint movements , 2000 .

[42]  S. Thorpe,et al.  A Limit to the Speed of Processing in Ultra-Rapid Visual Categorization of Novel Natural Scenes , 2001, Journal of Cognitive Neuroscience.

[43]  C. Michaels,et al.  Information and action in punching a falling ball , 2001, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[44]  Nicholas L. Port,et al.  Motor Cortical Activity during Interception of Moving Targets. , 2001, Journal of Cognitive Neuroscience.

[45]  Daeyeol Lee,et al.  Neuronal Clusters in the Primate Motor Cortex during Interceptin of Moving Targets. , 2001, Journal of Cognitive Neuroscience.

[46]  F. Lacquaniti,et al.  Does the brain model Newton's laws? , 2001, Nature Neuroscience.

[47]  Zoubin Ghahramani,et al.  Perspectives and problems in motor learning , 2001, Trends in Cognitive Sciences.

[48]  S. Schaal,et al.  Bouncing a ball: tuning into dynamic stability. , 2001, Journal of experimental psychology. Human perception and performance.

[49]  Arnaud Delorme,et al.  Spike-based strategies for rapid processing , 2001, Neural Networks.

[50]  D Sternad,et al.  Dynamics of a bouncing ball in human performance. , 2000, Physical review. E, Statistical, nonlinear, and soft matter physics.

[51]  Daniel Bullock,et al.  Prospective control of manual interceptive actions: comparative simulations of extant and new model constructs , 2001, Neural Networks.

[52]  F. A. Mussa-Ivaldi,et al.  Does the motor control system use multiple models and context switching to cope with a variable environment? , 2002, Experimental Brain Research.

[53]  D. Boussaoud,et al.  Parietal inputs to dorsal versus ventral premotor areas in the macaque monkey: evidence for largely segregated visuomotor pathways , 2002, Experimental Brain Research.

[54]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[55]  Anne-Marie Brouwer,et al.  Perception of acceleration with short presentation times: Can acceleration be used in interception? , 2001, Perception & psychophysics.

[56]  A. Georgopoulos Cognitive motor control: spatial and temporal aspects , 2002, Current Opinion in Neurobiology.

[57]  S. Thorpe,et al.  Surfing a spike wave down the ventral stream , 2002, Vision Research.

[58]  J. Movshon,et al.  The Timing of Response Onset and Offset in Macaque Visual Neurons , 2002, The Journal of Neuroscience.

[59]  A. Georgopoulos,et al.  Neural responses in motor cortex and area 7a to real and apparent motion , 2004, Experimental Brain Research.

[60]  D. Sternad,et al.  Actively tracking ‘passive’ stability in a ball bouncing task , 2003, Brain Research.

[61]  M. Kawato,et al.  Modular organization of internal models of tools in the human cerebellum , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[62]  J. Smeets,et al.  When is behavioral data evidence for a control theory? Tau-coupling revisited. , 2003, Motor control.

[63]  Apostolos P. Georgopoulos,et al.  Interception of real and apparent motion targets: psychophysics in humans and monkeys , 2003, Experimental Brain Research.

[64]  Daniel M. Wolpert,et al.  Internal models underlying grasp can be additively combined , 2004, Experimental Brain Research.

[65]  D. Sternad,et al.  Control of ball-racket interactions in rhythmic propulsion of elastic and non-elastic balls , 2003, Experimental Brain Research.

[66]  Dagmar Sternad,et al.  The dialogue between data and model: passive stability and relaxation behavior in a ball bouncing task , 2004 .

[67]  F. Lacquaniti,et al.  Internal models of target motion: expected dynamics overrides measured kinematics in timing manual interceptions. , 2004, Journal of neurophysiology.

[68]  E. Todorov Optimality principles in sensorimotor control , 2004, Nature Neuroscience.

[69]  S. Scott Optimal feedback control and the neural basis of volitional motor control , 2004, Nature Reviews Neuroscience.

[70]  P. Beek,et al.  Discrete and cyclical movements: unified dynamics or separate control? , 2004, Acta psychologica.

[71]  P. Cavanagh,et al.  Electromechanical delay in human skeletal muscle under concentric and eccentric contractions , 1979, European Journal of Applied Physiology and Occupational Physiology.

[72]  A. Georgopoulos,et al.  Neural responses during interception of real and apparent circularly moving stimuli in motor cortex and area 7a. , 2004, Cerebral cortex.

[73]  M. Grealy,et al.  Judging Time Intervals Using a Model of Perceptuo-Motor Control , 2004, Journal of Cognitive Neuroscience.

[74]  M. Kawato,et al.  Random presentation enables subjects to adapt to two opposing forces on the hand , 2004, Nature Neuroscience.

[75]  James R Tresilian,et al.  The Accuracy of Interceptive Action in Time and Space , 2004, Exercise and sport sciences reviews.

[76]  H. Nagasaki Asymmetrical trajectory formation in cyclic forearm movements in man , 2004, Experimental Brain Research.

[77]  S. Schaal,et al.  Rhythmic arm movement is not discrete , 2004, Nature Neuroscience.

[78]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[79]  D. Wolpert,et al.  Failure to Consolidate the Consolidation Theory of Learning for Sensorimotor Adaptation Tasks , 2004, The Journal of Neuroscience.

[80]  Francesco Lacquaniti,et al.  Internal model of gravity for hand interception: parametric adaptation to zero-gravity visual targets on Earth. , 2005, Journal of neurophysiology.

[81]  F. Lacquaniti,et al.  Representation of Visual Gravitational Motion in the Human Vestibular Cortex , 2005, Science.

[82]  Emanuel Todorov,et al.  From task parameters to motor synergies: A hierarchical framework for approximately optimal control of redundant manipulators , 2005 .

[83]  Emanuel Todorov,et al.  From task parameters to motor synergies: A hierarchical framework for approximately optimal control of redundant manipulators , 2005, J. Field Robotics.

[84]  F. Lacquaniti,et al.  Fast adaptation of the internal model of gravity for manual interceptions: evidence for event-dependent learning. , 2005, Journal of neurophysiology.

[85]  Daniel Bullock,et al.  How Position, Velocity, and Temporal Information Combine in the Prospective Control of Catching: Data and Model , 2005, Journal of Cognitive Neuroscience.

[86]  Emanuel Todorov,et al.  Stochastic Optimal Control and Estimation Methods Adapted to the Noise Characteristics of the Sensorimotor System , 2005, Neural Computation.

[87]  S. Swinnen,et al.  The advantage of cyclic over discrete movements remains evident following changes in load and amplitude , 2006, Neuroscience Letters.

[88]  Manoj Srinivasan,et al.  Computer optimization of a minimal biped model discovers walking and running , 2006, Nature.

[89]  C. Shea,et al.  Target width scaling in a repetitive aiming task: switching between cyclical and discrete units of action , 2006, Experimental Brain Research.

[90]  J. Diedrichsen Optimal Task-Dependent Changes of Bimanual Feedback Control and Adaptation , 2007, Current Biology.

[91]  S. Schaal The Computational Neurobiology of Reaching and Pointing — A Foundation for Motor Learning by Reza Shadmehr and Steven P. Wise , 2007 .

[92]  Philippe Lefèvre,et al.  Rhythmic Feedback Control of a Blind Planar Juggler , 2007, IEEE Transactions on Robotics.

[93]  Dagmar Sternad,et al.  Passive stability and active control in a rhythmic task. , 2007, Journal of neurophysiology.

[94]  Emanuel Todorov,et al.  Evidence for the Flexible Sensorimotor Strategies Predicted by Optimal Feedback Control , 2007, The Journal of Neuroscience.

[95]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[96]  Susan A. Murphy,et al.  Monographs on statistics and applied probability , 1990 .

[97]  William D. Smart,et al.  Receding Horizon Differential Dynamic Programming , 2007, NIPS.

[98]  N. Hogan,et al.  On rhythmic and discrete movements: reflections, definitions and implications for motor control , 2007, Experimental Brain Research.

[99]  B. Reddy,et al.  4. Discussion , 2007 .

[100]  Auke Jan Ijspeert,et al.  Central pattern generators for locomotion control in animals and robots: A review , 2008, Neural Networks.

[101]  Philippe Lefèvre,et al.  Control of bimanual rhythmic movements: trading efficiency for robustness depending on the context , 2008, Experimental Brain Research.

[102]  Philippe Lefèvre,et al.  Robotics and neuroscience: A rhythmic interaction , 2008, Neural Networks.

[103]  Dagmar Sternad,et al.  Towards a Unified Theory of Rhythmic and Discrete Movements — Behavioral, Modeling and Imaging Results , 2008 .

[104]  S. Scott Inconvenient Truths about neural processing in primary motor cortex , 2008, The Journal of physiology.

[105]  D. Sternad,et al.  Stability and variability: indicators for passive stability and active control in a rhythmic task. , 2008, Journal of neurophysiology.

[106]  J. Krakauer,et al.  A computational neuroanatomy for motor control , 2008, Experimental Brain Research.

[107]  Viktor K. Jirsa,et al.  Distinct Timing Mechanisms Produce Discrete and Continuous Movements , 2008, PLoS Comput. Biol..

[108]  D. Sternad,et al.  Open-loop, closed-loop and compensatory control: performance improvement under pressure in a rhythmic task , 2010, Experimental Brain Research.

[109]  Philippe Lefèvre,et al.  A Computational Model for Rhythmic and Discrete Movements in Uni- and Bimanual Coordination , 2009, Neural Computation.

[110]  J. Diedrichsen,et al.  Reversal of bimanual feedback responses with changes in task goal. , 2009, Journal of neurophysiology.

[111]  Dagmar Sternad,et al.  Moving the Arm at Different Rates: Slow Movements are Avoided , 2009, Journal of motor behavior.