Double-well dynamics of noise-driven control activation in human intermittent control: the case of stick balancing

When facing a task of balancing a dynamic system near an unstable equilibrium, humans often adopt intermittent control strategy: Instead of continuously controlling the system, they repeatedly switch the control on and off. Paradigmatic example of such a task is stick balancing. Despite the simplicity of the task itself, the complexity of human intermittent control dynamics in stick balancing still puzzles researchers in motor control. Here we attempt to model one of the key mechanisms of human intermittent control, control activation, using as an example the task of overdamped stick balancing. In doing so, we focus on the concept of noise-driven activation, a more general alternative to the conventional threshold-driven activation. We describe control activation as a random walk in an energy potential, which changes in response to the state of the controlled system. By way of numerical simulations, we show that the developed model captures the core properties of human control activation observed previously in the experiments on overdamped stick balancing. Our results demonstrate that the double-well potential model provides tractable mathematical description of human control activation at least in the considered task and suggest that the adopted approach can potentially aid in understanding human intermittent control in more complex processes.

[1]  Ramesh Balasubramaniam,et al.  On the control of unstable objects: the dynamics of human stick balancing. , 2013, Advances in experimental medicine and biology.

[2]  J. R. Pomerantz,et al.  A century of Gestalt psychology in visual perception: II. Conceptual and theoretical foundations. , 2012, Psychological bulletin.

[3]  Ihor Lubashevsky,et al.  Extended phase space description of human-controlled systems dynamics , 2012, 1212.2717.

[4]  Explicit Order 1.5 Schemes for the Strong Approximation of Itô Stochastic Differential Equations , 2005 .

[5]  John G. Milton,et al.  Unstable dynamical systems: Delays, noise and control , 2008 .

[6]  Maria Alejandra Gonzalez-Perez,et al.  Conceptual and Theoretical Foundations , 2014 .

[7]  Ihor Lubashevsky,et al.  To react or not to react? Intrinsic stochasticity of human control in virtual stick balancing , 2014, Journal of The Royal Society Interface.

[8]  Reinhard Mahnke,et al.  Physics of Stochastic Processes: How Randomness Acts in Time , 2009 .

[9]  Ian David Loram,et al.  Human postural sway results from frequent, ballistic bias impulses by soleus and gastrocnemius , 2005, The Journal of physiology.

[10]  H. Haken Principles of brain functioning , 1995 .

[11]  H C Mayer,et al.  Walking with coffee: why does it spill? , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[12]  T. Ohira,et al.  The time-delayed inverted pendulum: implications for human balance control. , 2009, Chaos.

[13]  Michael J. Richardson,et al.  Modeling the Dynamics of Risky Choice , 2013 .

[14]  John G Milton,et al.  The delayed and noisy nervous system: implications for neural control , 2011, Journal of neural engineering.

[15]  Yoshiyuki Asai,et al.  Learning an Intermittent Control Strategy for Postural Balancing Using an EMG-Based Human-Computer Interface , 2013, PloS one.

[16]  John G Milton,et al.  Intermittent Motor Control: The "drift-and-act" Hypothesis. , 2013, Advances in experimental medicine and biology.

[17]  H Markram,et al.  Dynamics of population rate codes in ensembles of neocortical neurons. , 2004, Journal of neurophysiology.

[18]  G. Ermentrout Dynamic patterns: The self-organization of brain and behavior , 1997 .

[19]  L Schimansky-Geier,et al.  Transmission of noise coded versus additive signals through a neuronal ensemble. , 2001, Physical review letters.

[20]  Ihor Lubashevsky,et al.  Rational-driver approximation in car-following theory. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[21]  Christian W. Eurich,et al.  Visuomotor tracking on a computer screen - an experimental paradigm to study the dynamics of motor control , 2004, Neurocomputing.

[22]  Taishin Nomura,et al.  Bounded stability of the quiet standing posture: an intermittent control model. , 2008, Human movement science.

[23]  Ian David Loram,et al.  Direct measurement of human ankle stiffness during quiet standing: the intrinsic mechanical stiffness is insufficient for stability , 2002, The Journal of physiology.

[24]  Iris van Rooij,et al.  A non-representational approach to imagined action , 2002, Cogn. Sci..

[25]  A. Opstal Dynamic Patterns: The Self-Organization of Brain and Behavior , 1995 .

[26]  J A Kelso,et al.  The nonlinear dynamics of speech categorization. , 1994, Journal of experimental psychology. Human perception and performance.

[27]  P. Morasso,et al.  Body sway during quiet standing: is it the residual chattering of an intermittent stabilization process? , 2005, Human movement science.

[28]  Mark L. Latash,et al.  Progress in Motor Control , 2016, Advances in Experimental Medicine and Biology.

[29]  John G Milton,et al.  On-off intermittency in a human balancing task. , 2002, Physical review letters.

[30]  Marian Stamp Dawkins,et al.  The Noisy Brain: Stochastic Dynamics as a Principle of Brain Function The Noisy Brain: Stochastic Dynamics as a Principle of Brain Function. By Edmund T. Rolls & Gustavo Deco. Oxford: Oxford University Press (2010). Pp. 310. Price £37.95 hardback. , 2010, Animal Behaviour.

[31]  Henrik Gollee,et al.  Human control of an inverted pendulum: Is continuous control necessary? Is intermittent control effective? Is intermittent control physiological? , 2011, The Journal of physiology.

[32]  J. Rinzel,et al.  Noise-induced alternations in an attractor network model of perceptual bistability. , 2007, Journal of neurophysiology.

[33]  Constantinos N Maganaris,et al.  Active, non‐spring‐like muscle movements in human postural sway: how might paradoxical changes in muscle length be produced? , 2005, The Journal of physiology.

[34]  Peter J. Gawthrop,et al.  Intermittent control: a computational theory of human control , 2011, Biological Cybernetics.

[35]  Huibert Kwakernaak,et al.  Linear Optimal Control Systems , 1972 .

[36]  John G. Milton,et al.  Balancing with Vibration: A Prelude for “Drift and Act” Balance Control , 2009, PloS one.

[37]  John G. Milton,et al.  Stick balancing, falls and Dragon-Kings , 2012 .