Experimental and educational platforms for studying architecture and tradeoffs in human sensorimotor control

This paper describes several surprisingly rich but simple demos and a new experimental platform for human sensorimotor control research and also controls education. The platform safely simulates a canonical sensorimotor task of riding a mountain bike down a steep, twisting, bumpy trail using a standard display and inexpensive off-the-shelf gaming steering wheel with a force feedback motor. We use the platform to verify our theory, presented in a companion paper. The theory tells how component hardware speed-accuracy tradeoffs (SATs) in control loops impose corresponding SATs at the system level and how effective architectures mitigate the deleterious impact of hardware SATs through layering and “diversity sweet spots” (DSSs). Specifically, we measure the impacts on system performance of delays, quantization, and uncertainties in sensorimotor control loops, both within the subject's nervous system and added externally via software in the platform. This provides a remarkably rich test of the theory, which is consistent with all preliminary data. Moreover, as the theory predicted, subjects effectively multiplex specific higher layer planning/tracking of the trail using vision with lower layer rejection of unseen bump disturbances using reflexes. In contrast, humans multitask badly on tasks that do not naturally distribute across layers (e.g. texting and driving). The platform is cheap to build and easy to program for both research and education purposes, yet verifies our theory, which is aimed at closing a crucial gap between neurophysiology and sensorimotor control. The platform can be downloaded at https://github.com/Doyle-Lab/WheelCon.

[1]  I. Scott MacKenzie,et al.  Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts' law research in HCI , 2004, Int. J. Hum. Comput. Stud..

[2]  S. R. Taylor,et al.  Calcium transients in isolated amphibian skeletal muscle fibres: detection with aequorin. , 1978, The Journal of physiology.

[3]  P. Fitts,et al.  INFORMATION CAPACITY OF DISCRETE MOTOR RESPONSES. , 1964, Journal of experimental psychology.

[4]  H. Nagai Bellman equations of risk sensitive control , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[5]  F. Tong,et al.  Training Improves Multitasking Performance by Increasing the Speed of Information Processing in Human Prefrontal Cortex , 2009, Neuron.

[6]  Richard P. Heitz,et al.  The speed-accuracy tradeoff: history, physiology, methodology, and behavior , 2014, Front. Neurosci..

[7]  Scott T. Grafton,et al.  Forward modeling allows feedback control for fast reaching movements , 2000, Trends in Cognitive Sciences.

[8]  R Plamondon,et al.  Speed/accuracy trade-offs in target-directed movements , 1997, Behavioral and Brain Sciences.

[9]  Daniel A. Braun,et al.  Risk sensitivity in a motor task with speed-accuracy trade-off. , 2011, Journal of neurophysiology.

[10]  Peter Sterling,et al.  Principles of Neural Design , 2015 .

[11]  Terence D. Sanger,et al.  Neuro-mechanical control using differential stochastic operators , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[12]  P. Whittle Risk-Sensitive Optimal Control , 1990 .

[13]  John C Doyle,et al.  Architecture, constraints, and behavior , 2011, Proceedings of the National Academy of Sciences.

[14]  Xin He,et al.  Coordinated alpha and gamma control of muscles and spindles in movement and posture , 2015, Front. Comput. Neurosci..

[15]  John Doyle,et al.  Theoretical foundations for layered architectures and speed-accuracy tradeoffs in sensorimotor control , 2019, 2019 American Control Conference (ACC).

[16]  D. B. Lockhart,et al.  Optimal sensorimotor transformations for balance , 2007, Nature Neuroscience.

[17]  David W. Franklin,et al.  Computational Mechanisms of Sensorimotor Control , 2011, Neuron.

[18]  Terence D. Sanger,et al.  Risk-Aware Control , 2014, Neural Computation.

[19]  I. V. Orekhova,et al.  The neuromuscular transform: the dynamic, nonlinear link between motor neuron firing patterns and muscle contraction in rhythmic behaviors. , 2000, Journal of neurophysiology.

[20]  Nikolai Matni,et al.  Hard limits on robust control over delayed and quantized communication channels with applications to sensorimotor control , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[21]  Daniel M Wolpert,et al.  Computational principles of sensorimotor control that minimize uncertainty and variability , 2007, The Journal of physiology.

[22]  H. Pashler Dual-task interference in simple tasks: data and theory. , 1994, Psychological bulletin.

[23]  C. Stevens,et al.  Synaptic noise and other sources of randomness in motoneuron interspike intervals. , 1968, Journal of neurophysiology.

[24]  Roland van den Tillaar,et al.  Influence of Instruction on Velocity and Accuracy in Soccer Kicking of Experienced Soccer Players , 2014, Journal of motor behavior.

[25]  Zeynep Erim,et al.  Common drive of motor units in regulation of muscle force , 1994, Trends in Neurosciences.

[26]  G. E. Loeb,et al.  A hierarchical foundation for models of sensorimotor control , 1999, Experimental Brain Research.

[27]  Mazyar Fallah,et al.  Temporal resolution of the human visual system for processing color, orientation, and color/orientation conjunctions , 2005 .

[28]  Babak Hassibi,et al.  Rate-cost tradeoffs in control , 2016, 2016 54th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[29]  W. M. Smith,et al.  The effects of delayed and displaced visual feedback on motor control. , 1980, Journal of motor behavior.

[30]  John Doyle,et al.  Understanding robust control theory via stick balancing , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[31]  Kieron Rooney,et al.  Throwing Speed and Accuracy in Baseball and Cricket Players , 2014, Perceptual and motor skills.

[32]  R. Bogacz,et al.  The neural basis of the speed–accuracy tradeoff , 2010, Trends in Neurosciences.

[33]  W. Mcdonald,et al.  Delayed visual evoked response in optic neuritis. , 1972, Lancet.