An Uncontrolled Manifold Analysis of Arm Joint Variability in Virtual Planar Position and Orientation Telemanipulation

<italic>Objective:</italic> In teleoperated robot-assisted tasks, the user interacts with manipulators to finely control remote tools. Manipulation of robotic devices, characterized by specific kinematic and dynamic proprieties, is a complex task for the human sensorimotor system due to the inherent biomechanical and neuronal redundancies that characterize the human arm and its control. We investigate how master devices with different kinematics structures and how different task constraints influence users capabilities in exploiting arm redundancy. <italic>Methods:</italic> A virtual teleoperation workbench was designed and the arm kinematics of seven users was acquired during the execution of two planar virtual tasks, involving either the control of position only or position-orientation of a tool. Using the uncontrolled manifold analysis of arm joint variability, we estimated the logarithmic ratio between the task irrelevant and the task relevant manifolds (<inline-formula><tex-math notation="LaTeX">${\bf R}_{{\bf v}}$</tex-math></inline-formula>). <italic>Results:</italic> The <inline-formula><tex-math notation="LaTeX">${\bf R}_{{\bf v}}$</tex-math></inline-formula> values obtained in the position-orientation task were higher than in the position only task, while no differences were found between the master devices. A modulation of <inline-formula><tex-math notation="LaTeX">${\bf R}_{{\bf v}}$</tex-math></inline-formula> was found through the execution of the position task and a positive correlation was found between task performance and redundancy exploitation. <italic>Conclusion:</italic> Users exploited additional portions of arm redundancy when dealing with the tool orientation. The <inline-formula><tex-math notation="LaTeX">${\bf R}_{{\bf v}}$</tex-math></inline-formula> modulation seems influenced by the task constraints and by the users possibility of reconfiguring the arm position. Significance: This paper advances the general understanding of the exploitation of arm redundancy in complex tasks, and can improve the development of future robotic devices.

[1]  E S Wallace,et al.  Motor abundance and control structure in the golf swing. , 2016, Human movement science.

[2]  Giancarlo Ferrigno,et al.  On the Value of Estimating Human Arm Stiffness during Virtual Teleoperation with Robotic Manipulators , 2017, Front. Neurosci..

[3]  Giancarlo Ferrigno,et al.  Analysis of Joint and Hand Impedance During Teleoperation and Free-Hand Task Execution , 2017, IEEE Robotics and Automation Letters.

[4]  Wei Tech Ang,et al.  Analysis of Accuracy in Pointing with Redundant Hand-held Tools: A Geometric Approach to the Uncontrolled Manifold Method , 2013, PLoS Comput. Biol..

[5]  Gregor Schöner,et al.  Toward a new theory of motor synergies. , 2007, Motor control.

[6]  Scott L. Delp,et al.  A Model of the Upper Extremity for Simulating Musculoskeletal Surgery and Analyzing Neuromuscular Control , 2005, Annals of Biomedical Engineering.

[7]  Mark H. Anshel,et al.  The effect of goal difficulty and task complexity on intrinsic motivation and motor performance. , 1992 .

[8]  Nima Enayati,et al.  Haptics in Robot-Assisted Surgery: Challenges and Benefits , 2016, IEEE Reviews in Biomedical Engineering.

[9]  Vladimir M Zatsiorsky,et al.  Optimization-Based Models of Muscle Coordination , 2002, Exercise and sport sciences reviews.

[10]  A. Abiri,et al.  Diffusion of robotic-assisted laparoscopic technology across specialties: a national study from 2008 to 2013 , 2018, Surgical Endoscopy.

[11]  Ilana Nisky,et al.  Improved Active Handrest Performance Through Use of Virtual Fixtures , 2014, IEEE Transactions on Human-Machine Systems.

[12]  Juan Pablo Wachs,et al.  User-Centered and Analytic-Based Approaches to Generate Usable Gestures for Individuals With Quadriplegia , 2016, IEEE Transactions on Human-Machine Systems.

[13]  D. Sternad,et al.  Decomposition of variability in the execution of goal-oriented tasks: three components of skill improvement. , 2004, Journal of experimental psychology. Human perception and performance.

[14]  Gregor Schöner,et al.  Differential joint coordination in the tasks of standing up and sitting down. , 2002, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[15]  T. Flash,et al.  Minimum-jerk, two-thirds power law, and isochrony: converging approaches to movement planning. , 1995, Journal of experimental psychology. Human perception and performance.

[16]  Paola Cesari,et al.  Body-goal Variability Mapping in an Aiming Task , 2006, Biological Cybernetics.

[17]  Allison M. Okamura,et al.  Teleoperated versus open needle driving: Kinematic analysis of experienced surgeons and novice users , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[18]  T. Flash,et al.  On the similarities between the perception and production of elliptical trajectories , 2006, Experimental Brain Research.

[19]  Fadi Dornaika,et al.  Hand-Eye Calibration , 1995, Int. J. Robotics Res..

[20]  John Peter Scholz,et al.  A comparison of methods for identifying the Jacobian for uncontrolled manifold variance analysis. , 2010, Journal of biomechanics.

[21]  Dagmar Sternad,et al.  Coordinate Dependence of Variability Analysis , 2010, PLoS Comput. Biol..

[22]  Y. Matsuoka,et al.  Robotics for surgery. , 1999, Annual review of biomedical engineering.

[23]  B. Steenbergen,et al.  Achieving Coordination in Prehension: Joint Freezing and Postural Contributions. , 1995, Journal of motor behavior.

[24]  A. Okamura,et al.  Effects of robotic manipulators on movements of novices and surgeons , 2014, Surgical Endoscopy.

[25]  Mark L. Latash,et al.  The role of kinematic redundancy in adaptation of reaching , 2006, Experimental Brain Research.

[26]  Michael I. Jordan,et al.  Constrained and unconstrained movements involve different control strategies. , 1997, Journal of neurophysiology.

[27]  G Ferrigno,et al.  Enhanced torque‐based impedance control to assist brain targeting during open‐skull neurosurgery: a feasibility study , 2016, The international journal of medical robotics + computer assisted surgery : MRCAS.

[28]  Blandine Bril,et al.  Coordination strategies used in stone knapping. , 2013, American journal of physical anthropology.

[29]  M L Latash,et al.  On the problem of adequate language in motor control. , 1998, Motor control.

[30]  S. Fukashiro,et al.  Uncontrolled manifold analysis of joint angle variability during table tennis forehand. , 2017, Human movement science.

[31]  Ilana Nisky,et al.  Instrument Orientation-Based Metrics for Surgical Skill Evaluation in Robot-Assisted and Open Needle Driving , 2017, ArXiv.

[32]  D. Domkin,et al.  Structure of joint variability in bimanual pointing tasks , 2002, Experimental Brain Research.

[33]  M. Kawato,et al.  Trajectory formation of arm movement by cascade neural network model based on minimum torque-change criterion , 1990, Biological Cybernetics.

[34]  F. Park Distance Metrics on the Rigid-Body Motions with Applications to Mechanism Design , 1995 .

[35]  Allison M. Okamura,et al.  Uncontrolled Manifold Analysis of Arm Joint Angle Variability During Robotic Teleoperation and Freehand Movement of Surgeons and Novices , 2014, IEEE Transactions on Biomedical Engineering.

[36]  Jonathan B Dingwell,et al.  Trial-to-trial dynamics and learning in a generalized, redundant reaching task. , 2013, Journal of neurophysiology.

[37]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[38]  Ayman Habib,et al.  OpenSim: Open-Source Software to Create and Analyze Dynamic Simulations of Movement , 2007, IEEE Transactions on Biomedical Engineering.

[39]  Gregor Schöner,et al.  Identifying the control structure of multijoint coordination during pistol shooting , 2000, Experimental Brain Research.

[40]  Anca Velisar,et al.  Benchmarking of dynamic simulation predictions in two software platforms using an upper limb musculoskeletal model , 2015, Computer methods in biomechanics and biomedical engineering.

[41]  T. Flash,et al.  Human arm stiffness characteristics during the maintenance of posture , 1990, Experimental Brain Research.

[42]  M. Goudas,et al.  Feedback regarding Goal Achievement and Intrinsic Motivation , 2000, Perceptual and motor skills.

[43]  M. Latash,et al.  Motor Control Strategies Revealed in the Structure of Motor Variability , 2002, Exercise and sport sciences reviews.

[44]  G Somu,et al.  Robotic Telesurgery: Benefits Beyond Barriers , 2016 .

[45]  Paul Glazier Movement Variability in the Golf Swing , 2011, Research quarterly for exercise and sport.

[46]  R A Prokopenko,et al.  Assessment of the accuracy of a human arm model with seven degrees of freedom. , 2001, Journal of biomechanics.

[47]  G. Dietrich,et al.  Skills and learning difficulties involved in stone knapping: The case of stone‐bead knapping in Khambhat, India , 1995 .

[48]  A. Lanfranco,et al.  Robotic Surgery: A Current Perspective , 2004, Annals of surgery.

[49]  Nima Enayati,et al.  Skill-based human–robot cooperation in tele-operated path tracking , 2017, Autonomous Robots.

[50]  Juan P. Wachs,et al.  A comparative study for telerobotic surgery using free hand gestures , 2016 .

[51]  Emanuel Todorov,et al.  Structured variability of muscle activations supports the minimal intervention principle of motor control. , 2009, Journal of neurophysiology.

[52]  Edwin A. Locke,et al.  The High Performance Cycle: Standing the Test of Time , 2005 .

[53]  Gregor Schöner,et al.  The uncontrolled manifold concept: identifying control variables for a functional task , 1999, Experimental Brain Research.

[54]  N. A. Bernstein The Bernstein Problem: How Does the Central Nervous System Make Its Choices? , 2014 .

[55]  G. Edelman,et al.  Solving Bernstein's problem: a proposal for the development of coordinated movement by selection. , 1993, Child development.

[56]  Mark L. Latash,et al.  The bliss (not the problem) of motor abundance (not redundancy) , 2012, Experimental Brain Research.

[57]  Carlton Cooke,et al.  INSTEP SOCCER KICK TECHNIQUE AND PERFORMANCE THROUGH AN ANALYSIS OF MOVEMENT VARlABILlN , 2016 .

[58]  Nima Enayati,et al.  Performance metrics for guidance active constraints in surgical robotics , 2018, The international journal of medical robotics + computer assisted surgery : MRCAS.

[59]  Ulman Lindenberger,et al.  Coordination of degrees of freedom and stabilization of task variables in a complex motor skill: expertise-related differences in cello bowing , 2013, Experimental Brain Research.

[60]  M. Latash,et al.  Structure of motor variability in marginally redundant multifinger force production tasks , 2001, Experimental Brain Research.