A musculoskeletal model-based Assistance-As-Needed paradigm for assistive robotics

A Musculoskeletal Model-based Assistance-As-Needed Paradigm for Assistive Robotics Robotic systems which operate collaboratively with their human operators to provide assistance are becoming reality, and many different paradigms for administering this assistance have been developed. A promising paradigm is Assistance-As-Needed, which aims to provide physical assistance specific to the individual requirements of the operator. This requires that the needs of the operator be determined, which is challenging as they depend on both the task being performed, and the capability of the operator to perform it. Current solutions use performance-based methods which critique the operator from observations obtained during tasks, and then adapt assistance based on how they performed. This approach has shown success in applications such as robotic rehabilitation. However, empirical performance-based methods have inherent limitations, primarily due to the numerous observations required before the operator’s assistance needs can be determined. The ideal Assistance-As-Needed paradigm should be able to determine the operator’s assistance requirements without prior observations, and with respect to arbitrary tasks. This thesis presents a novel Assistance-As-Needed paradigm using models to estimate the assistance needs of the human operator. An optimisation model is developed which utilises a publicly available musculoskeletal model representing the human upper limb to estimate their strength, which is compared to the strength required by the task being performed to gauge their assistance requirements. An advantage of this model-based

[1]  J. G. Andrews,et al.  A biomechanical investigation of the human hip. , 1978, Journal of biomechanics.

[2]  D. Reinkensmeyer,et al.  Effect of visual distraction and auditory feedback on patient effort during robot-assisted movement training after stroke , 2011, Journal of NeuroEngineering and Rehabilitation.

[3]  Daniel E. Whitney,et al.  Force Feedback Control of Manipulator Fine Motions , 1977 .

[4]  Vincent De Sapio,et al.  Human-Like Motion from Physiologically-Based Potential Energies , 2004 .

[5]  Robert S. Thompson,et al.  Forecasting the Future of Hong Kong , 1987 .

[6]  Carolynn Patten,et al.  Combined Functional Task Practice and Dynamic High Intensity Resistance Training Promotes Recovery of Upper‐extremity Motor Function in Post‐stroke Hemiparesis: A Case Study , 2006, Journal of neurologic physical therapy : JNPT.

[7]  Antonio Bicchi,et al.  Fast and "soft-arm" tactics [robot arm design] , 2004, IEEE Robotics & Automation Magazine.

[8]  Yoshifumi Nishida,et al.  A concept of needs-oriented design and evaluation of assistive robots based on ICF , 2011, 2011 IEEE International Conference on Rehabilitation Robotics.

[9]  Wendy M Murray,et al.  Muscle short-range stiffness can be used to estimate the endpoint stiffness of the human arm. , 2011, Journal of neurophysiology.

[10]  D. Anton Occupational biomechanics , 1986 .

[11]  S. Kumar,et al.  Theories of musculoskeletal injury causation , 2001, Ergonomics.

[12]  Roy P. Walmsley,et al.  Intermachine reliability of isokinetic concentric measurements of shoulder internal and external peak torque , 1995 .

[13]  Joel Stein,et al.  High-Intensity Resistance Training Improves Muscle Strength, Self-Reported Function, and Disability in Long-Term Stroke Survivors , 2004, Stroke.

[14]  Lydia E. Kavraki,et al.  Motion Planning , 2011, IEEE Robotics & Automation Magazine.

[15]  L. Ada,et al.  Loss of strength contributes more to physical disability after stroke than loss of dexterity , 2004, Clinical rehabilitation.

[16]  Bruno Siciliano,et al.  Robot Force Control , 2000 .

[17]  E. Forster,et al.  Extension of a state-of-the-art optimization criterion to predict co-contraction. , 2004, Journal of biomechanics.

[18]  F. Zajac,et al.  Muscle coordination of maximum-speed pedaling. , 1997, Journal of biomechanics.

[19]  Brian A. Garner,et al.  Estimation of Musculotendon Properties in the Human Upper Limb , 2003, Annals of Biomedical Engineering.

[20]  J. Burdick,et al.  Implications of Assist-As-Needed Robotic Step Training after a Complete Spinal Cord Injury on Intrinsic Strategies of Motor Learning , 2006, The Journal of Neuroscience.

[21]  J. Edward Colgate,et al.  Cobot architecture , 2001, IEEE Trans. Robotics Autom..

[22]  John Kenneth Salisbury,et al.  A New Actuation Approach for Human Friendly Robot Design , 2004, Int. J. Robotics Res..

[23]  David G Lloyd,et al.  Estimation of muscle forces and joint moments using a forward-inverse dynamics model. , 2005, Medicine and science in sports and exercise.

[24]  Marco Pirini,et al.  The ABC of EMG , 2014 .

[25]  Etienne Burdet,et al.  ReachMAN: a personal robot to train reaching and manipulation , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Scott L. Delp,et al.  A Model of the Upper Extremity for Simulating Musculoskeletal Surgery and Analyzing Neuromuscular Control , 2005, Annals of Biomedical Engineering.

[27]  Jiang Yu Zheng,et al.  Interactive human motion acquisition from video sequences , 2000, Proceedings Computer Graphics International 2000.

[28]  E Y Chao,et al.  Scapular and clavicular kinematics during humeral elevation: a study with cadavers. , 2001, Journal of shoulder and elbow surgery.

[29]  Shigeki Toyama,et al.  Development of Wearable-Agri-Robot ∼mechanism for agricultural work∼ , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[30]  Homayoon Kazerooni,et al.  Human power extender: an example of human-machine interaction via the transfer of power and information signals , 1998, AMC'98 - Coimbra. 1998 5th International Workshop on Advanced Motion Control. Proceedings (Cat. No.98TH8354).

[31]  Antonio Bicchi,et al.  Safety for Physical Human-Robot Interaction , 2008, Springer Handbook of Robotics.

[32]  W. Harwin,et al.  The effect of the GENTLE/s robot-mediated therapy system on arm function after stroke , 2008, Clinical rehabilitation.

[33]  Robert Riener,et al.  ARMin - robot for rehabilitation of the upper extremities , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[34]  Marcus G Pandy,et al.  Lines of action and stabilizing potential of the shoulder musculature , 2009, Journal of anatomy.

[35]  N. Hogan,et al.  Interactive robots for neuro-rehabilitation. , 2004, Restorative neurology and neuroscience.

[36]  F. Zajac,et al.  A planar model of the knee joint to characterize the knee extensor mechanism. , 1989, Journal of biomechanics.

[37]  Jan F. Veneman,et al.  Compliant Actuation of Exoskeletons , 2006 .

[38]  J. Bean,et al.  High intensity strength training improves strength and functional performance after stroke. , 2000, American journal of physical medicine & rehabilitation.

[39]  J. Salisbury,et al.  Active stiffness control of a manipulator in cartesian coordinates , 1980, 1980 19th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[40]  Hermano Igo Krebs,et al.  Rehabilitation Robotics: Performance-Based Progressive Robot-Assisted Therapy , 2003, Auton. Robots.

[41]  Sarah J. Housman,et al.  A Randomized Controlled Trial of Gravity-Supported, Computer-Enhanced Arm Exercise for Individuals With Severe Hemiparesis , 2009, Neurorehabilitation and neural repair.

[42]  M. Pandy Moment arm of a muscle force. , 1999, Exercise and sport sciences reviews.

[43]  L S CALDWELL,et al.  The effect of the spatial position of a control on the strength of six linear hand movements. , 1959, Report. Army Medical Research Laboratory.

[44]  Cheng Peng Human Factors Engineering in Clinical Engineering , 2012 .

[45]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[46]  Muzaffer Erig,et al.  Three-Dimensional Biomechanical Static Strength Prediction Model Sensitivity to Postural and Anthropometric Inaccuracies , 1991 .

[47]  J. Dewald,et al.  Abnormal joint torque patterns in the paretic upper limb of subjects with hemiparesis , 2001, Muscle & nerve.

[48]  D. Sale,et al.  Elbow flexion strength curves in untrained men and women and male bodybuilders , 2004, European Journal of Applied Physiology and Occupational Physiology.

[49]  Scott L Delp,et al.  Generating dynamic simulations of movement using computed muscle control. , 2003, Journal of biomechanics.

[50]  S L Delp,et al.  A graphics-based software system to develop and analyze models of musculoskeletal structures. , 1995, Computers in biology and medicine.

[51]  Sean Gallagher,et al.  Isometric, Isoinertial, and Psychophysical Strength Testing: Devices and Protocols , 2004 .

[52]  Biman Das,et al.  Isometric Pull-Push Strengths in Workspace: 1. Strength Profiles , 2004, International journal of occupational safety and ergonomics : JOSE.

[53]  Robert Sparrow,et al.  In the hands of machines? The future of aged care , 2006, Minds and Machines.

[54]  Ayman Habib,et al.  OpenSim: Open-Source Software to Create and Analyze Dynamic Simulations of Movement , 2007, IEEE Transactions on Biomedical Engineering.

[55]  Christian Gerber,et al.  Numerical modelling of the shoulder for clinical applications , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[56]  L. Menegaldo,et al.  Moment arms and musculotendon lengths estimation for a three-dimensional lower-limb model. , 2004, Journal of biomechanics.

[57]  Elizabeth A. Brackbill,et al.  Robot-assisted modifications of gait in healthy individuals , 2010, Experimental Brain Research.

[58]  M. Ishii,et al.  Stand alone wearable power assisting suit - sensing and control systems , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[59]  R. M. Glaser,et al.  Improving the efficacy of electrical stimulation-induced leg cycle ergometry: an analysis based on a dynamic musculoskeletal model , 1993 .

[60]  J. Winters,et al.  Effect of initial upper-limb alignment on muscle contributions to isometric strength curves. , 1993, Journal of biomechanics.

[61]  Lorenzo Sciavicco,et al.  The parallel approach to force/position control of robotic manipulators , 1993, IEEE Trans. Robotics Autom..

[62]  Thomas B. Sheridan,et al.  Robust compliant motion for manipulators, part II: Design method , 1986, IEEE J. Robotics Autom..

[63]  Homayoon Kazerooni,et al.  Exoskeletons for Human Performance Augmentation , 2008, Springer Handbook of Robotics.

[64]  R. M. H. McMinn,et al.  Gray's Anatomy , 1973 .

[65]  Todd P. Stitik,et al.  Work Related Musculoskeletal Disorders (WMSDs): A Reference Book for Prevention , 1996 .

[66]  John T. McConville,et al.  Anthropometric Survey of U.S. Army Personnel: Methods and Summary Statistics 1988 , 1989 .

[67]  Phillip Kott Model-based estimation: , 2008 .

[68]  S Hesse,et al.  Repetitive locomotor training and physiotherapy improve walking and basic activities of daily living after stroke: a single-blind, randomized multicentre trial (DEutsche GAngtrainerStudie, DEGAS) , 2007, Clinical rehabilitation.

[69]  M. Pandy,et al.  Dynamic optimization of human walking. , 2001, Journal of biomechanical engineering.

[70]  Sing Kai Lo,et al.  Reliability of Upper Extremity Isokinetic Torque Measurements with the Kin-Com (II) Dynamometer , 1993 .

[71]  A. E. Engin,et al.  On the biomechanics of the shoulder complex. , 1980, Journal of biomechanics.

[72]  Y. Narayan,et al.  Effect of trunk rotation and arm position on gross upper extremity adduction strength and muscular activity , 2000, Ergonomics.

[73]  David J. Reinkensmeyer,et al.  Compliant Control of Post-Stroke Rehabilitation Robots: Using Movement-Specific Models to Improve Controller Performance , 2008 .

[74]  Homayoon Kazerooni,et al.  Human/robot interaction via the transfer of power and information signals , 1989, Images of the Twenty-First Century. Proceedings of the Annual International Engineering in Medicine and Biology Society,.

[75]  Carlo J. De Luca,et al.  The Use of Surface Electromyography in Biomechanics , 1997 .

[76]  L. Der-Yeghiaian,et al.  Robot-based hand motor therapy after stroke. , 2007, Brain : a journal of neurology.

[77]  Daniel Thalmann,et al.  A biomechanical musculoskeletal model of human upper limb for dynamic simulation , 1996 .

[78]  Yoonsu Nam,et al.  TENDON SLACK LENGTH AND ITS EFFECT ON MUSCLE FORCE-GENERATION CHARACTERISTICS , 2011 .

[79]  F. Zajac Muscle and tendon: properties, models, scaling, and application to biomechanics and motor control. , 1989, Critical reviews in biomedical engineering.

[80]  M. Pandy,et al.  The Obstacle-Set Method for Representing Muscle Paths in Musculoskeletal Models , 2000, Computer methods in biomechanics and biomedical engineering.

[81]  D T Davy,et al.  An investigation of muscle lines of action about the hip: a centroid line approach vs the straight line approach. , 1975, Journal of biomechanics.

[82]  Daniel Vélez Día,et al.  Biomechanics and Motor Control of Human Movement , 2013 .

[83]  Wayne Swan,et al.  Australia to 2050: future challenges , 2010 .

[84]  H. Kawamoto,et al.  Power assist method for HAL-3 using EMG-based feedback controller , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[85]  Kurt Manal,et al.  Subject-Specific Estimates of Tendon Slack Length: A Numerical Method , 2004 .

[86]  Xueling Bai,et al.  Finite Element Musculoskeletal Modeling of Mechanical Virtual Human of China , 2008, 2008 2nd International Conference on Bioinformatics and Biomedical Engineering.

[87]  J. Edward Colgate,et al.  Motion Guides for Assisted Manipulation , 2002, Int. J. Robotics Res..

[88]  Russell H. Taylor,et al.  Medical robotics in computer-integrated surgery , 2003, IEEE Trans. Robotics Autom..

[89]  J. Dimnet,et al.  Biomechanics of the upper limb using robotic techniques , 1996 .

[90]  R. Brand,et al.  Pelvic muscle and acetabular contact forces during gait. , 1997, Journal of biomechanics.

[91]  A. Seireg,et al.  Biochemical Analysis Of The Musculoskeletal Structure For Medicine And Sports , 1989 .

[92]  Robert J. Marley,et al.  Isokinetic strength characteristics in wrist flexion and extension , 2000 .

[93]  E Y Chao,et al.  Three-dimensional rotation of the elbow. , 1978, Journal of biomechanics.

[94]  Oussama Khatib,et al.  Simulating the task-level control of human motion: a methodology and framework for implementation , 2005, The Visual Computer.

[95]  J. D. de Groot,et al.  A three-dimensional regression model of the shoulder rhythm. , 2001, Clinical biomechanics.

[96]  Robert O. Ambrose,et al.  The minimum form of strength in serial, parallel and bifurcated manipulators , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[97]  M. Tresch,et al.  The case for and against muscle synergies , 2022 .

[98]  Mark H. Lee,et al.  Design issues for assistive robotics for the elderly , 2006, Adv. Eng. Informatics.

[99]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation: Part I—Theory , 1985 .

[100]  Luigi Villani,et al.  Force Control , 2021, Springer Handbook of Robotics, 2nd Ed..

[101]  J Ekholm,et al.  Isometric strength in flexors, abductors, and external rotators of the shoulder. , 1993, Clinical biomechanics.

[102]  John T. McConville,et al.  INVESTIGATION OF INERTIAL PROPERTIES OF THE HUMAN BODY , 1975 .

[103]  Thomas B. Sheridan,et al.  Robust compliant motion for manipulators, part I: The fundamental concepts of compliant motion , 1986, IEEE J. Robotics Autom..

[104]  M G Pandy,et al.  Musculoskeletal Model of the Upper Limb Based on the Visible Human Male Dataset , 2001, Computer methods in biomechanics and biomedical engineering.

[105]  Klas Nilsson,et al.  Industrial Robotics , 2008, Springer Handbook of Robotics.

[106]  WALTER Maurel,et al.  A Case Study on Human Upper Limb Modelling for Dynamic Simulation. , 1999, Computer methods in biomechanics and biomedical engineering.

[107]  Michael L Boninger,et al.  Personalized neuromusculoskeletal modeling to improve treatment of mobility impairments: a perspective from European research sites , 2012, Journal of NeuroEngineering and Rehabilitation.

[108]  Günter Hommel,et al.  A Human--Exoskeleton Interface Utilizing Electromyography , 2008, IEEE Transactions on Robotics.

[109]  Yoshiyuki Sankai,et al.  HAL: Hybrid Assistive Limb Based on Cybernics , 2007, ISRR.

[110]  Alin Albu-Schäffer,et al.  DLR's torque-controlled light weight robot III-are we reaching the technological limits now? , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[111]  Jose L Pons,et al.  Wearable Robots: Biomechatronic Exoskeletons , 2008 .