The time-delayed inverted pendulum: implications for human balance control.

The inverted pendulum is frequently used as a starting point for discussions of how human balance is maintained during standing and locomotion. Here we examine three experimental paradigms of time-delayed balance control: (1) mechanical inverted time-delayed pendulum, (2) stick balancing at the fingertip, and (3) human postural sway during quiet standing. Measurements of the transfer function (mechanical stick balancing) and the two-point correlation function (Hurst exponent) for the movements of the fingertip (real stick balancing) and the fluctuations in the center of pressure (postural sway) demonstrate that the upright fixed point is unstable in all three paradigms. These observations imply that the balanced state represents a more complex and bounded time-dependent state than a fixed-point attractor. Although mathematical models indicate that a sufficient condition for instability is for the time delay to make a corrective movement, tau(n), be greater than a critical delay tau(c) that is proportional to the length of the pendulum, this condition is satisfied only in the case of human stick balancing at the fingertip. Thus it is suggested that a common cause of instability in all three paradigms stems from the difficulty of controlling both the angle of the inverted pendulum and the position of the controller simultaneously using time-delayed feedback. Considerations of the problematic nature of control in the presence of delay and random perturbations ("noise") suggest that neural control for the upright position likely resembles an adaptive-type controller in which the displacement angle is allowed to drift for small displacements with active corrections made only when theta exceeds a threshold. This mechanism draws attention to an overlooked type of passive control that arises from the interplay between retarded variables and noise.

[1]  Irmgard Flügge-Lotz Discontinuous and optimal control , 1968 .

[2]  G. Cavagna,et al.  The sources of external work in level walking and running. , 1976, The Journal of physiology.

[3]  J. Schwarzenbach System modelling and control , 1978 .

[4]  Il Hong Suh,et al.  Proportional minus delay controller , 1979 .

[5]  M A Townsend,et al.  Biped gait stabilization via foot placement. , 1985, Journal of biomechanics.

[6]  G. Stépán Retarded dynamical systems : stability and characteristic functions , 1989 .

[7]  Tad McGeer,et al.  Passive Dynamic Walking , 1990, Int. J. Robotics Res..

[8]  D. McLean System Modelling and Control — Third edition J. Schwarzenbach and K.F. Gill Edward Arnold, Hodder & Stoughton Publishers, Mill Road, Dunton Green, Sevenoaks, Kent, TN13 2YA. 1992. 340pp. Illustrated. £17.95. , 1992 .

[9]  J. Collins,et al.  Random walking during quiet standing. , 1994, Physical review letters.

[10]  Gábor Stépán,et al.  STABILIZING AN INVERTED PENDULUM - ALTERNATIVES AND LIMITATIONS , 1994 .

[11]  Gábor Stépán,et al.  Balancing with Reflex Delay , 2000 .

[12]  M S Redfern,et al.  A model of foot placement during gait. , 1994, Journal of biomechanics.

[13]  Milton,et al.  Delayed random walks. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[14]  N. Yamada Chaotic swaying of the upright posture , 1995 .

[15]  R. McN. Alexander,et al.  Simple Models of Human Movement , 1995 .

[16]  John G. Milton,et al.  Limit cycles, tori, and complex dynamics in a second-order differential equation with delayed negative feedback , 1995 .

[17]  G. Haller,et al.  Micro-chaos in digital control , 1996 .

[18]  J. Milton,et al.  Noise-induced transitions in human postural sway. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[19]  P. Matthews Relationship of firing intervals of human motor units to the trajectory of post‐spike after‐hyperpolarization and synaptic noise. , 1996, The Journal of physiology.

[20]  D. Winter,et al.  Stiffness control of balance in quiet standing. , 1998, Journal of neurophysiology.

[21]  M. Coleman,et al.  An Uncontrolled Walking Toy That Cannot Stand Still , 1998 .

[22]  F. Atay Balancing the inverted pendulum using position feedback , 1999 .

[23]  Arthur D. Kuo,et al.  Stabilization of Lateral Motion in Passive Dynamic Walking , 1999, Int. J. Robotics Res..

[24]  J. A. Scott Kelso,et al.  Dynamic Encounters: Long Memory During Functional Stabilization , 1999 .

[25]  P. Morasso,et al.  Can muscle stiffness alone stabilize upright standing? , 1999, Journal of neurophysiology.

[26]  P. Foo,et al.  Functional stabilization of unstable fixed points: human pole balancing using time-to-balance information. , 2000, Journal of experimental psychology. Human perception and performance.

[27]  Gábor Stépán,et al.  SAMPLING DELAY AND BACKLASH IN BALANCING SYSTEMS , 2000 .

[28]  Tetsuya Yagi,et al.  A silicon retina calculating high-precision spatial and temporal derivatives , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[29]  Ian David Loram,et al.  Human balancing of an inverted pendulum: is sway size controlled by ankle impedance? , 2001, The Journal of physiology.

[30]  John G Milton,et al.  On-off intermittency in a human balancing task. , 2002, Physical review letters.

[31]  R. Peterka Sensorimotor integration in human postural control. , 2002, Journal of neurophysiology.

[32]  Stefan Schaal,et al.  Forward models in visuomotor control. , 2002, Journal of neurophysiology.

[33]  Ian David Loram,et al.  Human balancing of an inverted pendulum: position control by small, ballistic‐like, throw and catch movements , 2002, The Journal of physiology.

[34]  L. Levy Falls in Older People: Risk Factors and Strategies for Prevention , 2002 .

[35]  Lee Nolan,et al.  Aging, muscle activity, and balance control: physiologic changes associated with balance impairment. , 2003, Gait & posture.

[36]  Ravi S. Menon,et al.  Interaction of Retinal Image and Eye Velocity in Motion Perception , 2003, Neuron.

[37]  James J. Collins,et al.  Noise-Enhanced Human Sensorimotor Function Using Stochastic Resonance to Enhance Somatosensation and Improve Performance of the Human Balance Control System , 2003 .

[38]  M. Pandy Simple and complex models for studying muscle function in walking. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[39]  John G. Milton,et al.  Stick balancing: On-off intermittency and survival times , 2004 .

[40]  J. Collins,et al.  Open-loop and closed-loop control of posture: A random-walk analysis of center-of-pressure trajectories , 2004, Experimental Brain Research.

[41]  Christian W. Eurich,et al.  Visuomotor tracking on a computer screen - an experimental paradigm to study the dynamics of motor control , 2004, Neurocomputing.

[42]  Christian W. Eurich,et al.  STATE-DEPENDENT NOISE AND HUMAN BALANCE CONTROL , 2004 .

[43]  S. Lephart,et al.  Effect of lateral ankle ligament anesthesia on single-leg stance stability. , 2004, Medicine and science in sports and exercise.

[44]  M. Woollacott,et al.  Relation between muscle response onset and body segmental movements during postural perturbations in humans , 2004, Experimental Brain Research.

[45]  J. J. Collins,et al.  Age-related changes in open-loop and closed-loop postural control mechanisms , 2004, Experimental Brain Research.

[46]  Juan Luis Cabrera,et al.  Human stick balancing: tuning Lèvy flights to improve balance control. , 2004, Chaos.

[47]  Klaus Pawelzik,et al.  Optimal Control Yields Power Law Behavior , 2005, ICANN.

[48]  Erkki Oja,et al.  Artificial neural networks. Formal models and their applications , 2005 .

[49]  Juan Luis Cabrera,et al.  Controlling instability with delayed antagonistic stochastic dynamics , 2005 .

[50]  Mary E. Landry,et al.  Dynamics of an Inverted Pendulum with Delayed Feedback Control , 2005, SIAM J. Appl. Dyn. Syst..

[51]  Ian David Loram,et al.  Human postural sway results from frequent, ballistic bias impulses by soleus and gastrocnemius , 2005, The Journal of physiology.

[52]  Kaustubh Pathak,et al.  Velocity and position control of a wheeled inverted pendulum by partial feedback linearization , 2005, IEEE Transactions on Robotics.

[53]  K. M. Newell,et al.  Stochastic processes in postural center-of-pressure profiles , 2006, Experimental Brain Research.

[54]  John G. Milton,et al.  Neural control on multiple time scales: Insights from human stick balancing , 2006 .

[55]  Tetsuya Yagi,et al.  An analog silicon retina with multichip configuration , 2006, IEEE Transactions on Neural Networks.

[56]  Tamás Insperger,et al.  Act-and-wait concept for continuous-time control systems with feedback delay , 2006, IEEE Transactions on Control Systems Technology.

[57]  Gábor Stépán,et al.  Stability of time-periodic and delayed systems - a route to act-and-wait control , 2006, Annu. Rev. Control..

[58]  D. B. Lockhart,et al.  Optimal sensorimotor transformations for balance , 2007, Nature Neuroscience.

[59]  Kirsten Morris,et al.  Time Delay and Feedback Control of an Inverted Pendulum With Stick Slip Friction , 2007 .

[60]  Arthur D Kuo,et al.  The six determinants of gait and the inverted pendulum analogy: A dynamic walking perspective. , 2007, Human movement science.

[61]  T. Kalmár-Nagy,et al.  Nonlinear Stability of a Delayed Feedback Controlled Container Crane , 2007 .

[62]  Toru Ohira,et al.  Human and Machine Stick Balancing , 2007 .

[63]  Taishin Nomura,et al.  Bounded stability of the quiet standing posture: an intermittent control model. , 2008, Human movement science.

[64]  Kirsten Morris,et al.  Friction and the Inverted Pendulum Stabilization Problem , 2008 .

[65]  Ling Dong-xi,et al.  Transient Properties of a Bistable System with Delay Time Driven by Non-Gaussian and Gaussian Noises: Mean First-Passage Time , 2008 .

[66]  Kui-Fu Chen Standing human: an inverted pendulum , 2008 .

[67]  John G. Milton,et al.  Unstable dynamical systems: Delays, noise and control , 2008 .

[68]  Toru Ohira,et al.  Balancing with positive feedback: the case for discontinuous control , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[69]  Tamás Kalmár-Nagy,et al.  Delay differential equations : recent advances and new directions , 2009 .

[70]  John G. Milton,et al.  Delayed Random Walks: Investigating the Interplay Between Delay and Noise , 2009 .