Learning an Intermittent Control Strategy for Postural Balancing Using an EMG-Based Human-Computer Interface

It has been considered that the brain stabilizes unstable body dynamics by regulating co-activation levels of antagonist muscles. Here we critically reexamined this established theory of impedance control in a postural balancing task using a novel EMG-based human-computer interface, in which subjects were asked to balance a virtual inverted pendulum using visual feedback information on the pendulum's position. The pendulum was actuated by a pair of antagonist joint torques determined in real-time by activations of the corresponding pair of antagonist ankle muscles of subjects standing upright. This motor-task raises a frustrated environment; a large feedback time delay in the sensorimotor loop, as a source of instability, might favor adopting the non-reactive, preprogrammed impedance control, but the ankle muscles are relatively hard to co-activate, which hinders subjects from adopting the impedance control. This study aimed at discovering how experimental subjects resolved this frustrated environment through motor learning. One third of subjects adapted to the balancing task in a way of the impedance-like control. It was remarkable, however, that the majority of subjects did not adopt the impedance control. Instead, they acquired a smart and energetically efficient strategy, in which two muscles were inactivated simultaneously at a sequence of optimal timings, leading to intermittent appearance of periods of time during which the pendulum was not actively actuated. Characterizations of muscle inactivations and the pendulum¡Çs sway showed that the strategy adopted by those subjects was a type of intermittent control that utilizes a stable manifold of saddle-type unstable upright equilibrium that appeared in the state space of the pendulum when the active actuation was turned off.

[1]  Mitsuo Kawato,et al.  Equilibrium-Point Control Hypothesis Examined by Measured Arm Stiffness During Multijoint Movement , 1996, Science.

[2]  E. Todorov Optimality principles in sensorimotor control , 2004, Nature Neuroscience.

[3]  Gábor Stépán,et al.  On the dimension reduction of systems with feedback delay by act-and-wait control , 2010, IMA J. Math. Control. Inf..

[4]  Zoubin Ghahramani,et al.  Computational principles of movement neuroscience , 2000, Nature Neuroscience.

[5]  D. Nozaki,et al.  Adaptation to Visual Feedback Delay Influences Visuomotor Learning , 2012, PloS one.

[6]  Ian David Loram,et al.  Human balancing of an inverted pendulum with a compliant linkage: neural control by anticipatory intermittent bias , 2003, The Journal of physiology.

[7]  R. Miall,et al.  Visuomotor tracking with delayed visual feedback , 1985, Neuroscience.

[8]  Yoshiyuki Asai,et al.  A Model of Postural Control in Quiet Standing: Robust Compensation of Delay-Induced Instability Using Intermittent Activation of Feedback Control , 2009, PloS one.

[9]  J. Milton,et al.  Noise-induced transitions in human postural sway. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[10]  D. Winter,et al.  Stiffness control of balance in quiet standing. , 1998, Journal of neurophysiology.

[11]  Pietro Morasso,et al.  Stabilization Strategies for Unstable Dynamics , 2012, PloS one.

[12]  Rieko Osu,et al.  Endpoint Stiffness of the Arm Is Directionally Tuned to Instability in the Environment , 2007, The Journal of Neuroscience.

[13]  Daniel Mirman,et al.  Interactions dominate the dynamics of visual cognition , 2010, Cognition.

[14]  Yasuyuki Suzuki,et al.  Intermittent control with ankle, hip, and mixed strategies during quiet standing: a theoretical proposal based on a double inverted pendulum model. , 2012, Journal of theoretical biology.

[15]  Peter G. Weyand,et al.  Assessing the metabolic cost of walking: The influence of baseline subtractions , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[16]  Toru Ohira,et al.  Balancing with positive feedback: the case for discontinuous control , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[17]  Peter J. Gawthrop,et al.  Intermittent control: a computational theory of human control , 2011, Biological Cybernetics.

[18]  R. Major Biomechanics of the Musculo-Skeletal System , 1994 .

[19]  R. Peterka,et al.  A new interpretation of spontaneous sway measures based on a simple model of human postural control. , 2005, Journal of neurophysiology.

[20]  N. Hogan Adaptive control of mechanical impedance by coactivation of antagonist muscles , 1984 .

[21]  Constantinos N Maganaris,et al.  Paradoxical muscle movement in human standing , 2004, The Journal of physiology.

[22]  P. Morasso,et al.  Direct measurement of ankle stiffness during quiet standing: implications for control modelling and clinical application. , 2005, Gait & posture.

[23]  R. Miall,et al.  Digital Object Identifier (DOI) 10.1007/s002219900286 RESEARCH ARTICLE , 2022 .

[24]  John G Milton,et al.  The delayed and noisy nervous system: implications for neural control , 2011, Journal of neural engineering.

[25]  Ian David Loram,et al.  Human balancing of an inverted pendulum: is sway size controlled by ankle impedance? , 2001, The Journal of physiology.

[26]  Frans C. T. van der Helm,et al.  Comparison of different methods to identify and quantify balance control , 2005, Journal of Neuroscience Methods.

[27]  Stefan Schaal,et al.  Forward models in visuomotor control. , 2002, Journal of neurophysiology.

[28]  Henrik Gollee,et al.  Human control of an inverted pendulum: Is continuous control necessary? Is intermittent control effective? Is intermittent control physiological? , 2011, The Journal of physiology.

[29]  Ramesh Balasubramaniam,et al.  Motor Learning Characterized by Changing Lévy Distributions , 2009, PloS one.

[30]  A Cappozzo,et al.  Hemodynamics as a possible internal mechanical disturbance to balance. , 2001, Gait & posture.

[31]  R. Miall,et al.  Intermittency in human manual tracking tasks. , 1993, Journal of motor behavior.

[32]  L. Christensen,et al.  University of Birmingham Disruption of state estimation in the human lateral cerebellum , 2007 .

[33]  Hamid-Reza Kobravi,et al.  Decentralized adaptive robust control based on sliding mode and nonlinear compensator for the control of ankle movement using functional electrical stimulation of agonist–antagonist muscles , 2009, Journal of neural engineering.

[34]  Pietro G. Morasso,et al.  Internal models in the control of posture , 1999, Neural Networks.

[35]  Daniel M. Wolpert,et al.  Signal-dependent noise determines motor planning , 1998, Nature.

[36]  J. Collins,et al.  Open-loop and closed-loop control of posture: A random-walk analysis of center-of-pressure trajectories , 2004, Experimental Brain Research.

[37]  Valentina Squeri,et al.  Force-Field Compensation in a Manual Tracking Task , 2010, PloS one.

[38]  Gábor Stépán,et al.  Acceleration feedback improves balancing against reflex delay , 2013, Journal of The Royal Society Interface.

[39]  Ian David Loram,et al.  Human postural sway results from frequent, ballistic bias impulses by soleus and gastrocnemius , 2005, The Journal of physiology.

[40]  Taishin Nomura,et al.  Modeling human postural sway using an intermittent control and hemodynamic perturbations. , 2013, Mathematical biosciences.

[41]  Daniel M. Wolpert,et al.  Forward Models for Physiological Motor Control , 1996, Neural Networks.

[42]  Gábor Stépán,et al.  Balancing with Reflex Delay , 2000 .

[43]  John G Milton,et al.  On-off intermittency in a human balancing task. , 2002, Physical review letters.

[44]  Peter J. Gawthrop,et al.  Refractoriness in Sustained Visuo-Manual Control: Is the Refractory Duration Intrinsic or Does It Depend on External System Properties? , 2013, PLoS Comput. Biol..

[45]  P. Morasso,et al.  Ankle muscle stiffness alone cannot stabilize balance during quiet standing. , 2002, Journal of neurophysiology.

[46]  Henrik Gollee,et al.  Identification of intermittent control in man and machine , 2012, Journal of The Royal Society Interface.

[47]  Pietro Morasso ‘Brute force’vs.‘gentle taps’ in the control of unstable loads , 2011, The Journal of physiology.

[48]  Tamás Insperger,et al.  Act-and-wait concept for continuous-time control systems with feedback delay , 2006, IEEE Transactions on Control Systems Technology.

[49]  R. Miall,et al.  Adaptation to visual feedback delays in manual tracking: evidence against the Smith Predictor model of human visually guided action , 2006, Experimental Brain Research.

[50]  S. Schaal,et al.  Rhythmic arm movement is not discrete , 2004, Nature Neuroscience.

[51]  Joseph A. Doeringer,et al.  Intermittency in preplanned elbow movements persists in the absence of visual feedback. , 1998, Journal of neurophysiology.

[52]  Frans C T van der Helm,et al.  Comparison of different methods to identify and quantify balance control. , 2005, Journal of neuroscience methods.

[53]  D. Wolpert,et al.  Internal models in the cerebellum , 1998, Trends in Cognitive Sciences.

[54]  Ian David Loram,et al.  Human balancing of an inverted pendulum: position control by small, ballistic‐like, throw and catch movements , 2002, The Journal of physiology.

[55]  Gábor Stépán,et al.  Stability of time-periodic and delayed systems - a route to act-and-wait control , 2006, Annu. Rev. Control..

[56]  Houman Dallali,et al.  Modelling human balance using switched systems with linear feedback control , 2012, Journal of The Royal Society Interface.

[57]  Motoki Kouzaki,et al.  Importance of body sway velocity information in controlling ankle extensor activities during quiet stance. , 2003, Journal of neurophysiology.

[58]  Rieko Osu,et al.  The central nervous system stabilizes unstable dynamics by learning optimal impedance , 2001, Nature.

[59]  Mitsuo Kawato,et al.  Neural network control for a closed-loop System using Feedback-error-learning , 1993, Neural Networks.

[60]  Christian W. Eurich,et al.  Visuomotor tracking on a computer screen - an experimental paradigm to study the dynamics of motor control , 2004, Neurocomputing.

[61]  Ralf Engbert,et al.  An integrated model of fixational eye movements and microsaccades , 2011, Proceedings of the National Academy of Sciences.

[62]  Taishin Nomura,et al.  Bounded stability of the quiet standing posture: an intermittent control model. , 2008, Human movement science.

[63]  Rangarajan,et al.  Integrated approach to the assessment of long range correlation in time series data , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[64]  Sae Franklin,et al.  Visuomotor feedback gains upregulate during the learning of novel dynamics , 2012, Journal of neurophysiology.

[65]  V. Utkin Variable structure systems with sliding modes , 1977 .

[66]  J. Collins,et al.  Random walking during quiet standing. , 1994, Physical review letters.

[67]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[68]  Neville Hogan,et al.  The mechanics of multi-joint posture and movement control , 1985, Biological Cybernetics.