Intermittent control: a computational theory of human control

The paradigm of continuous control using internal models has advanced understanding of human motor control. However, this paradigm ignores some aspects of human control, including intermittent feedback, serial ballistic control, triggered responses and refractory periods. It is shown that event-driven intermittent control provides a framework to explain the behaviour of the human operator under a wider range of conditions than continuous control. Continuous control is included as a special case, but sampling, system matched hold, an intermittent predictor and an event trigger allow serial open-loop trajectories using intermittent feedback. The implementation here may be described as “continuous observation, intermittent action”. Beyond explaining unimodal regulation distributions in common with continuous control, these features naturally explain refractoriness and bimodal stabilisation distributions observed in double stimulus tracking experiments and quiet standing, respectively. Moreover, given that human control systems contain significant time delays, a biological-cybernetic rationale favours intermittent over continuous control: intermittent predictive control is computationally less demanding than continuous predictive control. A standard continuous-time predictive control model of the human operator is used as the underlying design method for an event-driven intermittent controller. It is shown that when event thresholds are small and sampling is regular, the intermittent controller can masquerade as the underlying continuous-time controller and thus, under these conditions, the continuous-time and intermittent controller cannot be distinguished. This explains why the intermittent control hypothesis is consistent with the continuous control hypothesis for certain experimental conditions.

[1]  Peter McLeod,et al.  Parallel processing and the psychological refractory period , 1977 .

[2]  Ian David Loram,et al.  Human balancing of an inverted pendulum: position control by small, ballistic‐like, throw and catch movements , 2002, The Journal of physiology.

[3]  R. Miall,et al.  The precision of temporal judgement: milliseconds, many minutes, and beyond , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[4]  David L. Kleinman,et al.  An optimal control model of human response part I: Theory and validation , 1970 .

[5]  H. Sompolinsky,et al.  Bistability of cerebellar Purkinje cells modulated by sensory stimulation , 2005, Nature Neuroscience.

[6]  Peter J. Gawthrop,et al.  Event-driven intermittent control , 2009, Int. J. Control.

[7]  K. J. Craik Theory of the human operator in control systems; man as an element in a control system. , 1948, British Journal of Psychology General Section.

[8]  Peter J. Gawthrop Intermittent constrained predictive control of mechanical systems , 2004 .

[9]  R. Chris Miall,et al.  State Estimation in the Cerebellum , 2008, The Cerebellum.

[10]  Huibert Kwakernaak,et al.  Linear Optimal Control Systems , 1972 .

[11]  R. Miall,et al.  Intermittency in human manual tracking tasks. , 1993, Journal of motor behavior.

[12]  K. J. Craik THEORY OF THE HUMAN OPERATOR IN CONTROL SYSTEMS , 1948 .

[13]  R. W. Pew,et al.  Sine-Wave Tracking Revisited , 1967 .

[14]  Reza Shadmehr,et al.  Computational nature of human adaptive control during learning of reaching movements in force fields , 1999, Biological Cybernetics.

[15]  Michael I. Jordan,et al.  An internal model for sensorimotor integration. , 1995, Science.

[16]  James C. Houk,et al.  A Cerebellar Model of Timing and Prediction in the Control of Reaching , 1999, Neural Computation.

[17]  Yalchin Oytam,et al.  Degrees of freedom and motor planning in purposive movement. , 2005, Human movement science.

[18]  Peter J. Gawthrop,et al.  Intermittent Predictive Control of an Inverted Pendulum , 2006 .

[19]  D. Navon,et al.  Queuing or Sharing? A Critical Evaluation of the Single-Bottleneck Notion , 2002, Cognitive Psychology.

[20]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[21]  M. A. Arbib,et al.  Models of Trajectory Formation and Temporal Interaction of Reach and Grasp. , 1993, Journal of motor behavior.

[22]  David L. Kleinman,et al.  Optimal control of linear systems with time-delay and observation noise , 1969 .

[23]  D. Wolpert,et al.  Is the cerebellum a smith predictor? , 1993, Journal of motor behavior.

[24]  K. E. Novak,et al.  The use of overlapping submovements in the control of rapid hand movements , 2002, Experimental Brain Research.

[25]  D. B. Lockhart,et al.  Optimal sensorimotor transformations for balance , 2007, Nature Neuroscience.

[26]  Peter J. Gawthrop,et al.  Intermittent model predictive control , 2007 .

[27]  L. Stark,et al.  Sampling or intermittency in hand control system dynamics. , 1968, Biophysical journal.

[28]  Robin T. Bye,et al.  The BUMP model of response planning: variable horizon predictive control accounts for the speed-accuracy tradeoffs and velocity profiles of aimed movement. , 2008, Human movement science.

[29]  D. Kleinman,et al.  An optimal control model of human response part II: Prediction of human performance in a complex task , 1970 .

[30]  Robert Sessions Woodworth,et al.  THE ACCURACY OF VOLUNTARY MOVEMENT , 1899 .

[31]  David L. Kleinman,et al.  The Human as an Optimal Controller and Information Processor , 1969 .

[32]  Gideon F. Inbar,et al.  A model for learning human reaching movements , 1996, Biological Cybernetics.

[33]  Peter J. Gawthrop,et al.  Predictive feedback in human simulated pendulum balancing , 2009, Biological Cybernetics.

[34]  Tamás Insperger,et al.  Act-and-wait concept for continuous-time control systems with feedback delay , 2006, IEEE Transactions on Control Systems Technology.

[35]  Duane T. McRuer,et al.  Human dynamics in man-machine systems , 1980, Autom..

[36]  P.J. Antsaklis,et al.  Stability of discrete-time plants using model-based control with intermittent feedback , 2008, 2008 16th Mediterranean Conference on Control and Automation.

[37]  David Marr,et al.  VISION A Computational Investigation into the Human Representation and Processing of Visual Information , 2009 .

[38]  C. W. Telford The refractory phase of voluntary and associative responses , 1931 .

[39]  R. Peterka Sensorimotor integration in human postural control. , 2002, Journal of neurophysiology.

[40]  P D Neilson,et al.  Influence of intermittency and synergy on grasping. , 1999, Motor control.

[41]  D. Wolpert,et al.  Internal models in the cerebellum , 1998, Trends in Cognitive Sciences.

[42]  M. C. Smith,et al.  Theories of the psychological refractory period. , 1967, Psychological bulletin.

[43]  Amir Karniel,et al.  Minimum Acceleration Criterion with Constraints Implies Bang-Bang Control as an Underlying Principle for Optimal Trajectories of Arm Reaching Movements , 2008, Neural Computation.

[44]  Peter J. Gawthrop,et al.  Frequency-domain analysis of intermittent control , 2009 .

[45]  Peter J. Gawthrop,et al.  Open-loop intermittent feedback control: practical continuous-time GPC , 1999 .

[46]  Ian David Loram,et al.  Human postural sway results from frequent, ballistic bias impulses by soleus and gastrocnemius , 2005, The Journal of physiology.

[47]  B. Simon Functional integration and quantum physics , 1979 .

[48]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[49]  John Porrill,et al.  Adaptive-filter Models of the Cerebellum: Computational Analysis , 2008, The Cerebellum.

[50]  Daniel M Wolpert,et al.  Computational principles of sensorimotor control that minimize uncertainty and variability , 2007, The Journal of physiology.

[51]  M. D. Neilson,et al.  An overview of adaptive model theory: solving the problems of redundancy, resources, and nonlinear interactions in human movement control , 2005, Journal of neural engineering.

[52]  Graham C. Goodwin,et al.  Control System Design , 2000 .

[53]  Herman van der Kooij,et al.  POSTURAL RESPONSES EVOKED BY PLATFORM PERTUBATIONS ARE DOMINATED BY CONTINUOUS FEEDBACK , 2007 .

[54]  David L. Kleinman,et al.  A Model for Human Controller Remnant , 1969 .

[55]  P. R. Davidson,et al.  Widespread access to predictive models in the motor system: a short review , 2005, Journal of neural engineering.

[56]  A. Welford Single-channel operation in the brain. , 1967, Acta psychologica.

[57]  George A. Bekey,et al.  The Human Operator as a Sampled-Data System , 1962 .

[58]  Neville Hogan,et al.  Serial processing in human movement production , 1998, Neural Networks.

[59]  Daniel M. Wolpert,et al.  Forward Models for Physiological Motor Control , 1996, Neural Networks.

[60]  Etienne Burdet,et al.  Quantization of human motions and learning of accurate movements , 1998, Biological Cybernetics.

[61]  Herman van der Kooij,et al.  A multisensory integration model of human stance control , 1999, Biological Cybernetics.

[62]  M. Vince The intermittency of control movements and the psychological refractory period. , 1948, The British journal of psychology. General section.

[63]  BaronS.,et al.  An optimal control model of human response part II , 1970 .

[64]  Frans C. T. van der Helm,et al.  An adaptive model of sensory integration in a dynamic environment applied to human stance control , 2001, Biological Cybernetics.

[65]  Peter J Gawthrop,et al.  Visual control of stable and unstable loads: what is the feedback delay and extent of linear time‐invariant control? , 2009, The Journal of physiology.

[66]  Torrence D. J. Welch,et al.  A feedback model reproduces muscle activity during human postural responses to support-surface translations. , 2008, Journal of neurophysiology.

[67]  G. Fullerton Psychology and physiology. , 1896 .

[68]  S. Schaal The Computational Neurobiology of Reaching and Pointing — A Foundation for Motor Learning by Reza Shadmehr and Steven P. Wise , 2007 .

[69]  P. D. Neilson,et al.  Internal models and intermittency: A theoretical account of human tracking behavior , 2004, Biological Cybernetics.

[70]  Gene F. Franklin,et al.  Feedback Control of Dynamic Systems , 1986 .

[71]  D. Wolpert,et al.  Perception of the Consequences of Self-Action Is Temporally Tuned and Event Driven , 2005, Current Biology.

[72]  Constantinos N Maganaris,et al.  Active, non‐spring‐like muscle movements in human postural sway: how might paradoxical changes in muscle length be produced? , 2005, The Journal of physiology.

[73]  Peter D. Neilson,et al.  A neuroengineering solution to the optimal tracking problem , 1999 .

[74]  Peter J. Gawthrop Intermittent predictive control , 2002 .

[75]  Yoshiyuki Asai,et al.  A Model of Postural Control in Quiet Standing: Robust Compensation of Delay-Induced Instability Using Intermittent Activation of Feedback Control , 2009, PloS one.

[76]  R. Peterka,et al.  A new interpretation of spontaneous sway measures based on a simple model of human postural control. , 2005, Journal of neurophysiology.

[77]  K. J. W. Craik Theory of the human operator in control systems; the operator as an engineering system. , 1947 .

[78]  H FaggAndrew,et al.  A cerebellar model of timing and prediction in the control of reaching , 1999 .

[79]  Jacques Droulez,et al.  Does the brain use sliding variables for the control of movements? , 1997, Biological Cybernetics.

[80]  James Stanley,et al.  Using predictive motor control processes in a cognitive task: behavioral and neuroanatomical perspectives. , 2009, Advances in experimental medicine and biology.

[81]  Peter J. Gawthrop,et al.  Act-and-Wait and Intermittent Control: Some Comments , 2010, IEEE Transactions on Control Systems Technology.

[82]  R. Fitzpatrick,et al.  Proprioceptive, visual and vestibular thresholds for the perception of sway during standing in humans. , 1994, The Journal of physiology.

[83]  Peter J. Gawthrop,et al.  Frequency-domain identification of the human controller , 2012, Biological Cybernetics.