On the control of unstable objects: the dynamics of human stick balancing.

Although the dominant focus of human motor control and learning has been on sequence production and force field adaptation, the control of unstable objects has received much less attention. In this review, we summarize a recent body of work on the control of unstable objects using the paradigmatic example of stick balancing. In a series of four studies, we examined learning-induced changes in balancing an inverted pendulum at the fingertip. First, we identified the statistical distribution that captures the spatio-temporal dynamics of hand displacement trajectories. The probability distributions for changes in transverse plane fingertip speed revealed Levy-distributed dynamics that changed as a function of learning. Following this, we quantified the nature of the intermittent control mechanisms that gave rise to these Levy-distributed fingertip trajectories. The results pointed to the existence of a drift-and-correct mechanism. In a subsequent set of studies, we report task-specific changes in the coupling between posture and hand displacements as subjects became more proficient at stick balancing. Such changes revealed the presence of a hierarchical control mechanism that intermittently switched between coordinative and individual subsystem control. Finally, we show the effects of attentional focus and concurrent cognitive tasks in expert stick balancers. Our results are discussed in terms of an intermittent, drift-and-correct mechanism that is sensitive to the cognitive and physical task demands of the stick-balancing task. Dynamical system’s approaches to motor control and learning are discussed in detail.

[1]  P. Foo,et al.  Functional stabilization of unstable fixed points: human pole balancing using time-to-balance information. , 2000, Journal of experimental psychology. Human perception and performance.

[2]  Ramesh Balasubramaniam,et al.  Learning a stick-balancing task involves task-specific coupling between posture and hand displacements , 2011, Experimental Brain Research.

[3]  Ian David Loram,et al.  Human balancing of an inverted pendulum: position control by small, ballistic‐like, throw and catch movements , 2002, The Journal of physiology.

[4]  John G. Milton,et al.  Neural control on multiple time scales: Insights from human stick balancing , 2006 .

[5]  John G Milton,et al.  On-off intermittency in a human balancing task. , 2002, Physical review letters.

[6]  J. Randall Flanagan,et al.  Flexible Representations of Dynamics Are Used in Object Manipulation , 2008, Current Biology.

[7]  Jürgen Kurths,et al.  Recurrence plots for the analysis of complex systems , 2009 .

[8]  J. Kelso,et al.  Evolution of behavioral attractors with learning: nonequilibrium phase transitions. , 1992 .

[9]  C. Shea,et al.  The automaticity of complex motor skill learning as a function of attentional focus , 2001, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[10]  J. Zbilut,et al.  Embeddings and delays as derived from quantification of recurrence plots , 1992 .

[11]  A. Bastian,et al.  Thinking about walking: effects of conscious correction versus distraction on locomotor adaptation. , 2010, Journal of neurophysiology.

[12]  J. Collins,et al.  Upright, correlated random walks: A statistical-biomechanics approach to the human postural control system. , 1995, Chaos.

[13]  Emanuel Todorov,et al.  Stochastic Optimal Control and Estimation Methods Adapted to the Noise Characteristics of the Sensorimotor System , 2005, Neural Computation.

[14]  R. D Seidler,et al.  Patterns of transfer of adaptation among body segments , 2001, Behavioural Brain Research.

[15]  F A Mussa-Ivaldi,et al.  Adaptive representation of dynamics during learning of a motor task , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  P G Zanone,et al.  Evolution of behavioral attractors with learning: nonequilibrium phase transitions. , 1992, Journal of experimental psychology. Human perception and performance.

[17]  Benoît G. Bardy,et al.  Modulating postural control to facilitate visual performance , 2000 .

[18]  K. Narendra,et al.  Robust adaptive control in the presence of bounded disturbances , 1986 .

[19]  Michael I. Jordan,et al.  An internal model for sensorimotor integration. , 1995, Science.

[20]  Stefan Schaal,et al.  Forward models in visuomotor control. , 2002, Journal of neurophysiology.

[21]  Ramesh Balasubramaniam,et al.  Motor Learning Characterized by Changing Lévy Distributions , 2009, PloS one.

[22]  J. Lackner,et al.  Rapid adaptation to Coriolis force perturbations of arm trajectory. , 1994, Journal of neurophysiology.

[23]  John G Milton,et al.  On the Road to Automatic: Dynamic Aspects in the Development of Expertise , 2004, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[24]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[25]  B. Vereijken,et al.  Free(z)ing Degrees of Freedom in Skill Acquisition , 1992 .

[26]  K. Newell,et al.  Time scales in motor learning and development. , 2001, Psychological review.

[27]  D. Wolpert,et al.  Internal models in the cerebellum , 1998, Trends in Cognitive Sciences.

[28]  Randy J. Pagulayan,et al.  Postural stabilization of looking. , 1999 .

[29]  Juan Luis Cabrera,et al.  Human stick balancing: tuning Lèvy flights to improve balance control. , 2004, Chaos.

[30]  Andreas Daffertshofer,et al.  Stochastic two-delay differential model of delayed visual feedback effects on postural dynamics , 2010, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[31]  C. Shea,et al.  Increasing the distance of an external focus of attention enhances learning , 2003, Psychological research.

[32]  A. Faisal,et al.  Noise in the nervous system , 2008, Nature Reviews Neuroscience.

[33]  J. A. Pruszynski,et al.  Long-Latency Reflexes of the Human Arm Reflect an Internal Model of Limb Dynamics , 2008, Current Biology.

[34]  Benoît G. Bardy,et al.  Interaction between task demands and surface properties in the control of goal-oriented stance , 1999 .

[35]  Beatrix Vereijken,et al.  Changing coordinative structures in complex skill acquisition , 1997 .

[36]  J. A. Scott Kelso,et al.  Dynamic Encounters: Long Memory During Functional Stabilization , 1999 .

[37]  Geoffrey P. Bingham,et al.  Task-specific devices and the perceptual bottleneck☆ , 1988 .

[38]  E Bizzi,et al.  Augmented Feedback Presented in a Virtual Environment Accelerates Learning of a Difficult Motor Task. , 1997, Journal of motor behavior.

[39]  Peter J. Gawthrop,et al.  Intermittent control: a computational theory of human control , 2011, Biological Cybernetics.

[40]  Michael T. Turvey,et al.  Coordination modes in the multisegmental dynamics of hula hooping , 2004, Biological Cybernetics.

[41]  S. Scott,et al.  A motor learning strategy reflects neural circuitry for limb control , 2003, Nature Neuroscience.

[42]  T. Kirubarajan,et al.  Application of the Kalman-Levy Filter for Tracking Maneuvering Targets , 2004, IEEE Transactions on Aerospace and Electronic Systems.

[43]  Christopher D Mah,et al.  Generalization of Object Manipulation Skills Learned without Limb Motion , 2003, The Journal of Neuroscience.

[44]  T. Stoffregen,et al.  Affordances as constraints on the control of stance , 1988 .

[45]  V. Zatsiorsky,et al.  Instant equilibrium point and its migration in standing tasks: rambling and trembling components of the stabilogram. , 1999, Motor control.

[46]  Lena H Ting,et al.  A limited set of muscle synergies for force control during a postural task. , 2005, Journal of neurophysiology.

[47]  Tim Kiemel,et al.  Multisensory fusion and the stochastic structure of postural sway , 2002, Biological Cybernetics.

[48]  D. Wolpert,et al.  Evidence for an error deadzone in compensatory tracking. , 1992, Journal of motor behavior.

[49]  J. Kelso,et al.  To Switch or Not to Switch: Recruitment of Degrees of Freedom Stabilizes Biological Coordination. , 1999, Journal of motor behavior.

[50]  Alan M. Wing,et al.  The dynamics of standing balance , 2002, Trends in Cognitive Sciences.

[51]  Neil J. Gordon,et al.  The kalman-levy filter and heavy-tailed models for tracking manoeuvring targets , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[52]  Mitsuo Kawato,et al.  Central representation of dynamics when manipulating handheld objects. , 2006, Journal of neurophysiology.

[53]  M T Turvey,et al.  Specificity of postural sway to the demands of a precision task. , 2000, Gait & posture.

[54]  Peter J Gawthrop,et al.  Visual control of stable and unstable loads: what is the feedback delay and extent of linear time‐invariant control? , 2009, The Journal of physiology.

[55]  J. Diedrichsen Optimal Task-Dependent Changes of Bimanual Feedback Control and Adaptation , 2007, Current Biology.

[56]  D. Robertson,et al.  Kinetics of hula hooping: an inverse dynamics analysis. , 2008, Human movement science.

[57]  John G. Milton,et al.  Balancing with Vibration: A Prelude for “Drift and Act” Balance Control , 2009, PloS one.

[58]  Ferdinando A. Mussa-Ivaldi,et al.  Evidence for a specific internal representation of motion–force relationships during object manipulation , 2003, Biological Cybernetics.

[59]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[60]  Michael Hoerger,et al.  When does haste make waste? Speed-accuracy tradeoff, skill level, and the tools of the trade. , 2008, Journal of experimental psychology. Applied.

[61]  Michael A. Riley,et al.  Dynamical structure of hand trajectories during pole balancing , 2009, Neuroscience Letters.

[62]  R. Balasubramaniam,et al.  Attentional influences on the performance of secondary physical tasks during posture control , 2010, Experimental Brain Research.

[63]  John G. Milton,et al.  Stick balancing: On-off intermittency and survival times , 2004 .

[64]  W. Prinz,et al.  Directing attention to movement effects enhances learning: A review , 2001, Psychonomic bulletin & review.

[65]  M. Kawato,et al.  Modular organization of internal models of tools in the human cerebellum , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[66]  J. Lackner,et al.  Task-dependent motor learning , 2003, Experimental Brain Research.

[67]  Ana Solodkin,et al.  Imaging motor imagery: methodological issues related to expertise. , 2008, Methods.

[68]  Robert J Peterka,et al.  Dynamic regulation of sensorimotor integration in human postural control. , 2004, Journal of neurophysiology.

[69]  John M. Hollerbach,et al.  Dynamic interactions between limb segments during planar arm movement , 1982, Biological Cybernetics.

[70]  Sian L. Beilock,et al.  When paying attention becomes counterproductive: impact of divided versus skill-focused attention on novice and experienced performance of sensorimotor skills. , 2002, Journal of experimental psychology. Applied.

[71]  Daniel M. Wolpert,et al.  Transfer of Dynamic Learning Across Postures , 2009, Journal of neurophysiology.

[72]  N. A. Bernshteĭn The co-ordination and regulation of movements , 1967 .

[73]  Tim Kiemel,et al.  Multisensory information for human postural control: integrating touch and vision , 2000, Experimental Brain Research.

[74]  Ian David Loram,et al.  The frequency of human, manual adjustments in balancing an inverted pendulum is constrained by intrinsic physiological factors , 2006, The Journal of physiology.

[75]  Henrik Gollee,et al.  Human control of an inverted pendulum: Is continuous control necessary? Is intermittent control effective? Is intermittent control physiological? , 2011, The Journal of physiology.

[76]  J. Collins,et al.  Random walking during quiet standing. , 1994, Physical review letters.

[77]  Michael T. Turvey,et al.  Postural stabilization for the control of touching , 1999 .