To react or not to react? Intrinsic stochasticity of human control in virtual stick balancing

Understanding how humans control unstable systems is central to many research problems, with applications ranging from quiet standing to aircraft landing. Increasingly, much evidence appears in favour of event-driven control hypothesis: human operators only start actively controlling the system when the discrepancy between the current and desired system states becomes large enough. The event-driven models based on the concept of threshold can explain many features of the experimentally observed dynamics. However, much still remains unclear about the dynamics of human-controlled systems, which likely indicates that humans use more intricate control mechanisms. This paper argues that control activation in humans may be not threshold-driven, but instead intrinsically stochastic, noise-driven. Specifically, we suggest that control activation stems from stochastic interplay between the operator's need to keep the controlled system near the goal state, on the one hand, and the tendency to postpone interrupting the system dynamics, on the other hand. We propose a model capturing this interplay and show that it matches the experimental data on human balancing of virtual overdamped stick. Our results illuminate that the noise-driven activation mechanism plays a crucial role at least in the considered task, and, hypothetically, in a broad range of human-controlled processes.

[1]  Herman van der Kooij,et al.  Postural responses evoked by platform pertubations are dominated by continuous feedback. , 2007, Journal of neurophysiology.

[2]  Peter J. Gawthrop,et al.  Predictive feedback in human simulated pendulum balancing , 2009, Biological Cybernetics.

[3]  Ian David Loram,et al.  Human postural sway results from frequent, ballistic bias impulses by soleus and gastrocnemius , 2005, The Journal of physiology.

[4]  H. Kooij,et al.  POSTURAL RESPONSES EVOKED BY PLATFORM PERTUBATIONS ARE DOMINATED BY CONTINUOUS FEEDBACK , 2007 .

[5]  John G. Milton,et al.  Balancing with Vibration: A Prelude for “Drift and Act” Balance Control , 2009, PloS one.

[6]  Andreas Daffertshofer,et al.  Stochastic two-delay differential model of delayed visual feedback effects on postural dynamics , 2010, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[7]  Ihor Lubashevsky,et al.  Extended phase space description of human-controlled systems dynamics , 2012, 1212.2717.

[8]  John G. Milton,et al.  Stick balancing, falls and Dragon-Kings , 2012 .

[9]  Ernest Peter Todosiev,et al.  The action point model of the driver-vehicle system / , 1963 .

[10]  K. J. Craik THEORY OF THE HUMAN OPERATOR IN CONTROL SYSTEMS , 1948 .

[11]  Yoshiyuki Asai,et al.  A Model of Postural Control in Quiet Standing: Robust Compensation of Delay-Induced Instability Using Intermittent Activation of Feedback Control , 2009, PloS one.

[12]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[13]  Peter J Gawthrop,et al.  Visual control of stable and unstable loads: what is the feedback delay and extent of linear time‐invariant control? , 2009, The Journal of physiology.

[14]  Peter J. Gawthrop,et al.  Human stick balancing: an intermittent control explanation , 2013, Biological Cybernetics.

[15]  Peter J. Gawthrop,et al.  Intermittent control: a computational theory of human control , 2011, Biological Cybernetics.

[16]  Ihor Lubashevsky,et al.  Dynamical Trap Effect in Virtual Stick Balancing , 2013 .

[17]  Gabor Stepan,et al.  Delay effects in the human sensory system during balancing , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[18]  Amir Karniel,et al.  Minimum Acceleration Criterion with Constraints Implies Bang-Bang Control as an Underlying Principle for Optimal Trajectories of Arm Reaching Movements , 2008, Neural Computation.

[19]  Ihor Lubashevsky,et al.  Computer simulation of stick balancing: action point analysis , 2012, HCCE '12.

[20]  John G Milton,et al.  Intermittent Motor Control: The "drift-and-act" Hypothesis. , 2013, Advances in experimental medicine and biology.

[21]  Henrik Gollee,et al.  Human control of an inverted pendulum: Is continuous control necessary? Is intermittent control effective? Is intermittent control physiological? , 2011, The Journal of physiology.

[22]  J. Rinzel,et al.  Noise-induced alternations in an attractor network model of perceptual bistability. , 2007, Journal of neurophysiology.

[23]  John G Milton,et al.  The delayed and noisy nervous system: implications for neural control , 2011, Journal of neural engineering.

[24]  Ihor Lubashevsky,et al.  Empirical basis for car-following theory development , 2003 .

[25]  Ramesh Balasubramaniam,et al.  On the control of unstable objects: the dynamics of human stick balancing. , 2013, Advances in experimental medicine and biology.

[26]  P. Foo,et al.  Functional stabilization of unstable fixed points: human pole balancing using time-to-balance information. , 2000, Journal of experimental psychology. Human perception and performance.

[27]  Gábor Stépán,et al.  Balancing with Reflex Delay , 2000 .

[28]  John G Milton,et al.  On-off intermittency in a human balancing task. , 2002, Physical review letters.

[29]  Explicit Order 1.5 Schemes for the Strong Approximation of Itô Stochastic Differential Equations , 2005 .

[30]  Guido Caldarelli,et al.  SPRINGER PROCEEDINGS IN COMPLEXITY , 2016 .

[31]  B. Brehmer Dynamic decision making: human control of complex systems. , 1992, Acta psychologica.

[32]  D. E. Jones The stability of the bicycle , 1970 .

[33]  Peter Wagner,et al.  Analyzing fluctuations in car-following , 2012 .

[34]  H C Mayer,et al.  Walking with coffee: why does it spill? , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[35]  Alexander Vazhenin,et al.  Proceedings of the 2012 Joint International Conference on Human-Centered Computer Environments , 2012 .

[36]  Yasuyuki Inoue,et al.  A wavelet-based method for extracting intermittent discontinuities observed in human motor behavior , 2015, Neural Networks.

[37]  Frank Moss,et al.  Medical technology: Balancing the unbalanced , 2003, Nature.

[38]  Yoshiyuki Asai,et al.  Learning an Intermittent Control Strategy for Postural Balancing Using an EMG-Based Human-Computer Interface , 2013, PloS one.

[39]  John G. Milton,et al.  Unstable dynamical systems: Delays, noise and control , 2008 .

[40]  J. Shaoul Human Error , 1973, Nature.

[41]  J. Collins,et al.  Open-loop and closed-loop control of posture: A random-walk analysis of center-of-pressure trajectories , 2004, Experimental Brain Research.

[42]  Ian David Loram,et al.  Human balancing of an inverted pendulum: position control by small, ballistic‐like, throw and catch movements , 2002, The Journal of physiology.

[43]  Houman Dallali,et al.  Modelling human balance using switched systems with linear feedback control , 2012, Journal of The Royal Society Interface.

[44]  K. J. W. Craik Theory of the human operator in control systems; the operator as an engineering system. , 1947 .

[45]  Leonhard Euler Institutionum calculi integralis , 1824 .

[46]  Toru Ohira,et al.  Balancing with positive feedback: the case for discontinuous control , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[47]  G. Gescheider Psychophysics: The Fundamentals , 1997 .

[48]  Bialek,et al.  Random switching and optimal processing in the perception of ambiguous signals. , 1995, Physical review letters.

[49]  Tamás Insperger,et al.  Stick balancing with reflex delay in case of parametric forcing , 2011 .

[50]  Yasuyuki Suzuki,et al.  Intermittent control with ankle, hip, and mixed strategies during quiet standing: a theoretical proposal based on a double inverted pendulum model. , 2012, Journal of theoretical biology.

[51]  Christian W. Eurich,et al.  Visuomotor tracking on a computer screen - an experimental paradigm to study the dynamics of motor control , 2004, Neurocomputing.

[52]  Taishin Nomura,et al.  Bounded stability of the quiet standing posture: an intermittent control model. , 2008, Human movement science.

[53]  A. Savitzky,et al.  Smoothing and Differentiation of Data by Simplified Least Squares Procedures. , 1964 .