Sensory uncertainty and stick balancing at the fingertip

The effects of sensory input uncertainty, $$\varepsilon $$ε, on the stability of time-delayed human motor control are investigated by calculating the minimum stick length, $$\ell _\mathrm{crit}$$ℓcrit, that can be stabilized in the inverted position for a given time delay, $$\tau $$τ. Five control strategies often discussed in the context of human motor control are examined: three time-invariant controllers [proportional–derivative, proportional–derivative–acceleration (PDA), model predictive (MP) controllers] and two time-varying controllers [act-and-wait (AAW) and intermittent predictive controllers]. The uncertainties of the sensory input are modeled as a multiplicative term in the system output. Estimates based on the variability of neural spike trains and neural population responses suggest that $$\varepsilon \approx 7$$ε≈7–13 %. It is found that for this range of uncertainty, a tapped delay-line type of MP controller is the most robust controller. In particular, this controller can stabilize inverted sticks of the length balanced by expert stick balancers (0.25–0.5 m when $$\tau \approx 0.08$$τ≈0.08 s). However, a PDA controller becomes more effective when $$\varepsilon > 15\,\%$$ε>15%. A comparison between $$\ell _\mathrm{crit}$$ℓcrit for human stick balancing at the fingertip and balancing on the rubberized surface of a table tennis racket suggest that friction likely plays a role in balance control. Measurements of $$\ell _\mathrm{crit},\,\tau $$ℓcrit,τ, and a variability of the fluctuations in the vertical displacement angle, an estimate of $$\varepsilon $$ε, may make it possible to study the changes in control strategy as motor skill develops.

[1]  James Stanley,et al.  Using predictive motor control processes in a cognitive task: behavioral and neuroanatomical perspectives. , 2009, Advances in experimental medicine and biology.

[2]  Peter J. Gawthrop,et al.  Act-and-Wait and Intermittent Control: Some Comments , 2010, IEEE Transactions on Control Systems Technology.

[3]  V. Mountcastle,et al.  THE VARIABILITY OF CENTRAL NEURAL ACTIVITY IN A SENSORY SYSTEM, AND ITS IMPLICATIONS FOR THE CENTRAL REFLECTION OF SENSORY EVENTS. , 1963, Journal of neurophysiology.

[4]  A. Olbrot,et al.  Finite spectrum assignment problem for systems with delays , 1979 .

[5]  Gábor Stépán,et al.  Semi-Discretization for Time-Delay Systems: Stability and Engineering Applications , 2011 .

[6]  S. Pau,et al.  Encoding and recall of finger sequences in experienced pianists compared to musically naïves : a combined behavioural and functional imaging study , 2013 .

[7]  Mitsuo Kawato,et al.  Feedback-Error-Learning Neural Network for Supervised Motor Learning , 1990 .

[8]  Tamás Insperger,et al.  Act-and-wait concept for continuous-time control systems with feedback delay , 2006, IEEE Transactions on Control Systems Technology.

[9]  Yoshiyuki Asai,et al.  A Model of Postural Control in Quiet Standing: Robust Compensation of Delay-Induced Instability Using Intermittent Activation of Feedback Control , 2009, PloS one.

[10]  Klaus Pawelzik,et al.  Criticality of adaptive control dynamics. , 2011, Physical review letters.

[11]  D. Wolpert,et al.  Is the cerebellum a smith predictor? , 1993, Journal of motor behavior.

[12]  Yasuyuki Suzuki,et al.  Intermittent control with ankle, hip, and mixed strategies during quiet standing: a theoretical proposal based on a double inverted pendulum model. , 2012, Journal of theoretical biology.

[13]  J. Krakauer,et al.  Error correction, sensory prediction, and adaptation in motor control. , 2010, Annual review of neuroscience.

[14]  Si Wu,et al.  Compensating time delays with neural predictions: are predictions sensory or motor? , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[15]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[16]  O Smith,et al.  CLOSER CONTROL OF LOOPS WITH DEAD TIME , 1957 .

[17]  J. Freudenberg,et al.  Frequency Domain Properties of Scalar and Multivariable Feedback Systems , 1988 .

[18]  William S. Levine,et al.  The Control Handbook , 2005 .

[19]  Robert D. Lipschutz,et al.  Targeted reinnervation for enhanced prosthetic arm function in a woman with a proximal amputation: a case study , 2007, The Lancet.

[20]  Wim Michiels,et al.  On the delay sensitivity of Smith Predictors , 2003, Int. J. Syst. Sci..

[21]  M. Krstić Delay Compensation for Nonlinear, Adaptive, and PDE Systems , 2009 .

[22]  R. Miall,et al.  Adaptation to visual feedback delays in manual tracking: evidence against the Smith Predictor model of human visually guided action , 2006, Experimental Brain Research.

[23]  G. Stein,et al.  Respect the unstable , 2003 .

[24]  John G Milton,et al.  The delayed and noisy nervous system: implications for neural control , 2011, Journal of neural engineering.

[25]  Fritz Schürer Zur Theorie des Balancierens , 1948 .

[26]  Kirsten Morris,et al.  Friction and the Inverted Pendulum Stabilization Problem , 2008 .

[27]  Steven L. Small,et al.  The mind of expert motor performance is cool and focused , 2007, NeuroImage.

[28]  John G. Milton,et al.  Balancing with Vibration: A Prelude for “Drift and Act” Balance Control , 2009, PloS one.

[29]  Stan Baggen,et al.  Error Correction , 1984 .

[30]  Wim Michiels,et al.  Stability and Stabilization of Time-Delay Systems (Advances in Design & Control) (Advances in Design and Control) , 2007 .

[31]  Stefan Schaal,et al.  Forward models in visuomotor control. , 2002, Journal of neurophysiology.

[32]  Tamás Insperger,et al.  Stick balancing with reflex delay in case of parametric forcing , 2011 .

[33]  Georg Jahn,et al.  Encoding and recall of finger sequences in experienced pianists compared with musically naïve controls: A combined behavioral and functional imaging study , 2013, NeuroImage.

[34]  Ian Postlethwaite,et al.  Multivariable Feedback Control: Analysis and Design , 1996 .

[35]  Roberto Malinow,et al.  Measuring the impact of probabilistic transmission on neuronal output , 1993, Neuron.

[36]  A. Grinvald,et al.  Dynamics of Ongoing Activity: Explanation of the Large Variability in Evoked Cortical Responses , 1996, Science.

[37]  Gábor Stépán,et al.  Digital Control as Source of Chaotic Behavior , 2010, Int. J. Bifurc. Chaos.

[38]  Mark D. McDonnell,et al.  The benefits of noise in neural systems: bridging theory and experiment , 2011, Nature Reviews Neuroscience.

[39]  Christian W. Eurich,et al.  STATE-DEPENDENT NOISE AND HUMAN BALANCE CONTROL , 2004 .

[40]  S. Niculescu,et al.  Stability and Stabilization of Time-Delay Systems: An Eigenvalue-Based Approach , 2007 .

[41]  Gábor Stépán,et al.  Acceleration feedback improves balancing against reflex delay , 2013, Journal of The Royal Society Interface.

[42]  Dirk Roose,et al.  Limitations of a class of stabilization methods for delay systems , 2001, IEEE Trans. Autom. Control..

[43]  Ramesh Balasubramaniam,et al.  Motor Learning Characterized by Changing Lévy Distributions , 2009, PloS one.

[44]  Juan Luis Cabrera,et al.  Human stick balancing: tuning Lèvy flights to improve balance control. , 2004, Chaos.

[45]  Wim Michiels,et al.  An eigenvalue based approach for the robust stabilization of linear time-delay systems , 2003 .

[46]  Gabor Stepan,et al.  Delay effects in the human sensory system during balancing , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[47]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[48]  Eyad H. Abed,et al.  Control of Bifurcations and Chaos , 2010 .

[49]  Michael I. Jordan Computational aspects of motor control and motor learning , 2008 .

[50]  Kok Kiong Tan,et al.  Finite-Spectrum Assignment for Time-Delay Systems , 1998 .

[51]  John G. Milton,et al.  Unstable dynamical systems: Delays, noise and control , 2008 .

[52]  Peter J. Gawthrop,et al.  Intermittent model predictive control , 2007 .

[53]  Bernd Krauskopf,et al.  Extending the permissible control loop latency for the controlled inverted pendulum , 2005 .

[54]  T. Ohira,et al.  The time-delayed inverted pendulum: implications for human balance control. , 2009, Chaos.

[55]  R. Eckmiller Advanced neural computers , 1990 .

[56]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[57]  G. Stépán Retarded dynamical systems : stability and characteristic functions , 1989 .

[58]  Peter J. Gawthrop,et al.  Intermittent control: a computational theory of human control , 2011, Biological Cybernetics.

[59]  Michael C. Mackey,et al.  Neural ensemble coding and statistical periodicity: Speculations on the operation of the mind's eye , 2000, Journal of Physiology-Paris.

[60]  David L. Kleinman,et al.  Optimal control of linear systems with time-delay and observation noise , 1969 .

[61]  Sian L. Beilock,et al.  Choke: What the Secrets of the Brain Reveal About Getting It Right When You Have To , 2010 .

[62]  M. U. Kurse,et al.  Computational Models for Neuromuscular Function , 2009, IEEE Reviews in Biomedical Engineering.

[63]  Sabine Mondié,et al.  Approximation of control laws with distributed delays: a necessary condition for stability , 2001, Kybernetika.

[64]  Nicholas G Hatsopoulos,et al.  Incorporating Feedback from Multiple Sensory Modalities Enhances Brain–Machine Interface Control , 2010, The Journal of Neuroscience.

[65]  Mitsuo Kawato,et al.  Neural network control for a closed-loop System using Feedback-error-learning , 1993, Neural Networks.

[66]  Taishin Nomura,et al.  Bounded stability of the quiet standing posture: an intermittent control model. , 2008, Human movement science.

[67]  Gábor Stépán,et al.  Microchaotic Motion of Digitally Controlled Machines , 1998 .

[68]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[69]  Daniel M Wolpert,et al.  Computational principles of sensorimotor control that minimize uncertainty and variability , 2007, The Journal of physiology.

[70]  Mary E. Landry,et al.  Dynamics of an Inverted Pendulum with Delayed Feedback Control , 2005, SIAM J. Appl. Dyn. Syst..

[71]  Graham C. Goodwin,et al.  Control System Design , 2000 .

[72]  Jack K. Hale,et al.  Introduction to Functional Differential Equations , 1993, Applied Mathematical Sciences.

[73]  Z. Artstein Linear systems with delayed controls: A reduction , 1982 .

[74]  G. Stépán,et al.  Act-and-wait control concept for discrete-time systems with feedback delay , 2007 .

[75]  W. Newsome,et al.  The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding , 1998, The Journal of Neuroscience.

[76]  John G Milton,et al.  On-off intermittency in a human balancing task. , 2002, Physical review letters.