Decoding Intent With Control Theory: Comparing Muscle Versus Manual Interface Performance

Manual device interaction requires precise coordination which may be difficult for users with motor impairments. Muscle interfaces provide alternative interaction methods that may enhance performance, but have not yet been evaluated for simple (eg. mouse tracking) and complex (eg. driving) continuous tasks. Control theory enables us to probe continuous task performance by separating user input into intent and error correction to quantify how motor impairments impact device interaction. We compared the effectiveness of a manual versus a muscle interface for eleven users without and three users with motor impairments performing continuous tasks. Both user groups preferred and performed better with the muscle versus the manual interface for the complex continuous task. These results suggest muscle interfaces and algorithms that can detect and augment user intent may be especially useful for future design of interfaces for continuous tasks.

[1]  Leah Findlater,et al.  Personalized, Wearable Control of a Head-mounted Display for Users with Upper Body Motor Impairments , 2015, CHI.

[2]  Carlo J. De Luca,et al.  The Use of Surface Electromyography in Biomechanics , 1997 .

[3]  Shumin Zhai,et al.  Beyond Fitts' law: models for trajectory-based HCI tasks , 1997, CHI Extended Abstracts.

[4]  Mathieu Nancel,et al.  Myopoint: Pointing and Clicking Using Forearm Mounted Electromyography and Inertial Motion Sensors , 2015, CHI.

[5]  Joan Lobo-Prat,et al.  Evaluation of EMG, force and joystick as control interfaces for active arm supports , 2014, Journal of NeuroEngineering and Rehabilitation.

[6]  Todd A Kuiken,et al.  Comparison of electromyography and force as interfaces for prosthetic control. , 2011, Journal of rehabilitation research and development.

[7]  Réjean Plamondon,et al.  Gesture Input for Users with Motor Impairments on Touchscreens: Empirical Results based on the Kinematic Theory , 2018, CHI Extended Abstracts.

[8]  Jeffrey P. Bigham,et al.  Enhancing Android accessibility for users with hand tremor by reducing fine pointing and steady tapping , 2015, W4A.

[9]  I.,et al.  Fitts' Law as a Research and Design Tool in Human-Computer Interaction , 1992, Hum. Comput. Interact..

[10]  Shari Trewin,et al.  Physical accessibility of touchscreen smartphones , 2013, ASSETS.

[11]  Radu-Daniel Vatavu,et al.  Smart Touch: Improving Touch Accuracy for People with Motor Impairments with Template Matching , 2016, CHI.

[12]  A. Bastian Learning to predict the future: the cerebellum adapts feedforward movement control , 2006, Current Opinion in Neurobiology.

[13]  James Fogarty,et al.  Leveraging Dual-Observable Input for Fine-Grained Thumb Interaction Using Forearm EMG , 2015, UIST.

[14]  T. Michael Seigler,et al.  The Roles of Feedback and Feedforward as Humans Learn to Control Unknown Dynamic Systems , 2018, IEEE Transactions on Cybernetics.

[15]  Tanja Schultz,et al.  Advancing Muscle-Computer Interfaces with High-Density Electromyography , 2015, CHI.

[16]  Duane T. McRuer,et al.  A Review of Quasi-Linear Pilot Models , 1967 .

[17]  Jacob O. Wobbrock,et al.  Enhanced area cursors: reducing fine pointing demands for people with motor impairments , 2010, UIST.

[18]  Shari Trewin,et al.  Keyboard and mouse errors due to motor disabilities , 1999, Int. J. Hum. Comput. Stud..

[19]  K. Park,et al.  Flexible polymeric dry electrodes for the long-term monitoring of ECG , 2008 .

[20]  Mark Hallett,et al.  Plasticity of the human motor cortex and recovery from stroke , 2001, Brain Research Reviews.

[21]  M. Schwartz,et al.  Muscle synergies demonstrate only minimal changes after treatment in cerebral palsy , 2019, Journal of NeuroEngineering and Rehabilitation.

[22]  Jon Froehlich,et al.  Comparing Touchscreen and Mouse Input Performance by People With and Without Upper Body Motor Impairments , 2017, CHI.

[23]  H. Devries MUSCLES ALIVE-THEIR FUNCTIONS REVEALED BY ELECTROMYOGRAPHY , 1976 .

[24]  René van Paassen,et al.  Identification of the Feedforward Component in Manual Control With Predictable Target Signals , 2013, IEEE Transactions on Cybernetics.

[25]  Katherine M. Steele,et al.  Assessment of Dry Epidermal Electrodes for Long-Term Electromyography Measurements , 2018, Sensors.

[26]  Krzysztof Z. Gajos,et al.  Automatically generating personalized user interfaces with Supple , 2010, Artif. Intell..

[27]  Samuel A. Burden,et al.  Contributions of feedforward and feedback control in a manual trajectory-tracking task , 2019 .

[28]  Mahendran Balasubramanian,et al.  Ambulatory cardiac bio-signals: From mirage to clinical reality through a decade of progress , 2019, Int. J. Medical Informatics.

[29]  Joaquim A. Jorge,et al.  Towards accessible touch interfaces , 2010, ASSETS '10.

[30]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[31]  Krzysztof Z. Gajos,et al.  Ability-Based Design: Concept, Principles and Examples , 2011, TACC.

[32]  Samuel A. Burden,et al.  Toward experimental validation of a model for human sensorimotor learning and control in teleoperation , 2017, Defense + Security.

[33]  R. Brent Gillespie,et al.  Human control strategies in pursuit tracking with a disturbance input , 2014, 53rd IEEE Conference on Decision and Control.

[34]  Hugo Hugo Posada-Quintero Posada-Quintero,et al.  Assessment of Carbon/Salt/Adhesive Electrodes for Surface Electromyography Measurements , 2016, IEEE Journal of Translational Engineering in Health and Medicine.

[35]  M. Hoagland,et al.  Feedback Systems An Introduction for Scientists and Engineers SECOND EDITION , 2015 .

[36]  Desney S. Tan,et al.  Enabling always-available input with muscle-computer interfaces , 2009, UIST '09.

[37]  Desney S. Tan,et al.  Demonstrating the feasibility of using forearm electromyography for muscle-computer interfaces , 2008, CHI.

[38]  Dario Farina,et al.  The Extraction of Neural Information from the Surface EMG for the Control of Upper-Limb Prostheses: Emerging Avenues and Challenges , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[39]  Leah Findlater,et al.  Exploring Accessible Smartwatch Interactions for People with Upper Body Motor Impairments , 2018, CHI.

[40]  Malcolm H Granat,et al.  Continuous monitoring of upper-limb activity in a free-living environment. , 2005, Archives of physical medicine and rehabilitation.

[41]  R N Scott,et al.  Myoelectric prostheses: state of the art. , 1988, Journal of medical engineering & technology.

[42]  N. Lu,et al.  Long-Term Modeling and Monitoring of Neuromusculoskeletal System Performance Using Tattoo-Like EMG Sensors , 2022, International Journal of Prognostics and Health Management.

[43]  E Bizzi,et al.  Motor learning by field approximation. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[44]  K. Steele,et al.  "Look, Your Muscles Are Firing!": A Qualitative Study of Clinician Perspectives on the Use of Surface Electromyography in Neurorehabilitation. , 2019, Archives of physical medicine and rehabilitation.

[45]  O. Stavdahl,et al.  Control of Upper Limb Prostheses: Terminology and Proportional Myoelectric Control—A Review , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.