Exploiting upper-limb functional principal components for human-like motion generation of anthropomorphic robots

Background Human-likeliness of robot movements is a key component to enable a safe and effective human-robot interaction, since it contributes to increase acceptance and motion predictability of robots that have to closely interact with people, e.g. for assistance and rehabilitation purposes. Several parameters have been used to quantify how much a robot behaves like a human, which encompass aspects related to both the robot appearance and motion. The latter point is fundamental to allow the operator to interpret robotic actions, and plan a meaningful reactions. While different approaches have been presented in literature, which aim at devising bio-aware control guidelines, a direct implementation of human actions for robot planning is not straightforward, still representing an open issue in robotics. Methods We propose to embed a synergistic representation of human movements for robot motion generation. To do this, we recorded human upper-limb motions during daily living activities. We used functional Principal Component Analysis (fPCA) to extract principal motion patterns. We then formulated the planning problem by optimizing the weights of a reduced set of these components. For free-motions, our planning method results into a closed form solution which uses only one principal component. In case of obstacles, a numerical routine is proposed, incrementally enrolling principal components until the problem is solved with a suitable precision. Results Results of fPCA show that more than 80% of the observed variance can be explained by only three functional components. The application of our method to different meaningful movements, with and without obstacles, show that our approach is able to generate complex motions with a very reduced number of functional components. We show that the first synergy alone accounts for the 96% of cost reduction and that three components are able to achieve a satisfactory motion reconstruction in all the considered cases. Conclusions In this work we moved from the analysis of human movements via fPCA characterization to the design of a novel human-like motion generation algorithm able to generate, efficiently and with a reduced set of basis elements, several complex movements in free space, both in free motion and in case of obstacle avoidance tasks.

[1]  Siddhartha S. Srinivasa,et al.  CHOMP: Covariant Hamiltonian optimization for motion planning , 2013, Int. J. Robotics Res..

[2]  Brian R. Duffy,et al.  Anthropomorphism and the social robot , 2003, Robotics Auton. Syst..

[3]  Cosimo Della Santina,et al.  A technical framework for human-like motion generation with autonomous anthropomorphic redundant manipulators , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[4]  V. Dietz,et al.  Three-dimensional, task-specific robot therapy of the arm after stroke: a multicentre, parallel-group randomised trial , 2014, The Lancet Neurology.

[5]  Antonio Frisoli,et al.  A force-feedback exoskeleton for upper-limb rehabilitation in virtual reality , 2009 .

[6]  Peter Robinson,et al.  How anthropomorphism affects empathy toward robots , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[7]  Charles C. Kemp,et al.  Two Arms Are Better Than One: A Behavior Based Control System for Assistive Bimanual Manipulation , 2007 .

[8]  Dana Kulic,et al.  Measurement Instruments for the Anthropomorphism, Animacy, Likeability, Perceived Intelligence, and Perceived Safety of Robots , 2009, Int. J. Soc. Robotics.

[9]  Sylvain Miossec,et al.  Human motion in cooperative tasks: Moving object case study , 2009, 2008 IEEE International Conference on Robotics and Biomimetics.

[10]  Steven M. LaValle,et al.  RRT-connect: An efficient approach to single-query path planning , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[11]  Julia Fink,et al.  Anthropomorphism and Human Likeness in the Design of Robots and Human-Robot Interaction , 2012, ICSR.

[12]  Yuanqing Li,et al.  Neural-Dynamic-Method-Based Dual-Arm CMG Scheme With Time-Varying Constraints Applied to Humanoid Robots , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Jan Rosell,et al.  HG-RRT*: Human-guided optimal random trees for motion planning , 2015, 2015 IEEE 20th Conference on Emerging Technologies & Factory Automation (ETFA).

[14]  Robert Reams,et al.  Hadamard inverses, square roots and products of almost semidefinite matrices , 1999 .

[15]  Matei T. Ciocarlie,et al.  Hand Posture Subspaces for Dexterous Robotic Grasping , 2009, Int. J. Robotics Res..

[16]  Grigore C. Burdea,et al.  Feasibility of Modified Remotely Monitored In-Home Gaming Technology for Improving Hand Function in Adolescents With Cerebral Palsy , 2010, IEEE Transactions on Information Technology in Biomedicine.

[17]  G. Morel,et al.  Constraining Upper Limb Synergies of Hemiparetic Patients Using a Robotic Exoskeleton in the Perspective of Neuro-Rehabilitation , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  Suguru Arimoto,et al.  Natural resolution of ill-posedness of inverse kinematics for redundant robots: a challenge to Bernstein's degrees-of-freedom problem , 2005, Adv. Robotics.

[19]  T. Flash,et al.  The control of hand equilibrium trajectories in multi-joint arm movements , 1987, Biological Cybernetics.

[20]  Vladlen Koltun,et al.  Animating human lower limbs using contact-invariant optimization , 2013, ACM Trans. Graph..

[21]  P. Morasso Spatial control of arm movements , 2004, Experimental Brain Research.

[22]  E. Tunik,et al.  Movement rehabilitation in virtual reality from then to now: how are we doing? , 2014, International journal on disability and human development : IJDHD.

[23]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[24]  J. F. Soechting,et al.  Postural Hand Synergies for Tool Use , 1998, The Journal of Neuroscience.

[25]  Giuseppe Averta,et al.  Unvealing the Principal Modes of Human Upper Limb Movements through Functional Analysis , 2017, Front. Robot. AI.

[26]  Mark R. Cutkosky,et al.  On grasp choice, grasp models, and the design of hands for manufacturing tasks , 1989, IEEE Trans. Robotics Autom..

[27]  J. L. Roux An Introduction to the Kalman Filter , 2003 .

[28]  Rüdiger Dillmann,et al.  Robot Companions for Citizens , 2011, FET.

[29]  Hilde van der Togt,et al.  Publisher's Note , 2003, J. Netw. Comput. Appl..

[30]  Matteo Bianchi,et al.  Hand synergies: Integration of robotics and neuroscience for understanding the control of biological and artificial hands. , 2016, Physics of life reviews.

[31]  Oliver Brock,et al.  Single-Query Motion Planning with Utility-Guided Random Trees , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[32]  S. Leonhardt,et al.  A survey on robotic devices for upper limb rehabilitation , 2014, Journal of NeuroEngineering and Rehabilitation.

[33]  Ruud G. J. Meulenbroek,et al.  End-point constraints in aiming movements: effects of approach angle and speed , 2001, Biological Cybernetics.

[34]  Emilio Frazzoli,et al.  Sampling-based algorithms for optimal motion planning , 2011, Int. J. Robotics Res..

[35]  Fanny Ficuciello,et al.  Synergy-Based Control of Underactuated Anthropomorphic Hands , 2019, IEEE Transactions on Industrial Informatics.

[36]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation: Part I—Theory , 1985 .

[37]  Aude Billard,et al.  Modeling Compositions of Impedance-based Primitives via Dynamical Systems. , 2018, ICRA 2018.

[38]  Zoran Popovic,et al.  Interactive Control of Diverse Complex Characters with Neural Networks , 2015, NIPS.

[39]  Robert Riener,et al.  Quantifying the Human Likeness of a Humanoid Robot , 2013, Int. J. Soc. Robotics.

[40]  Sheng Quan Xie,et al.  Exoskeleton robots for upper-limb rehabilitation: state of the art and future prospects. , 2012, Medical engineering & physics.

[41]  Shijie Guo,et al.  Realization and Safety Measures of Patient Transfer by Nursing-Care Assistant Robot RIBA with Tactile Sensors , 2011, J. Robotics Mechatronics.

[42]  Glen Berseth,et al.  Terrain-adaptive locomotion skills using deep reinforcement learning , 2016, ACM Trans. Graph..

[43]  Giuseppe Averta,et al.  Incrementality and Hierarchies in the Enrollment of Multiple Synergies for Grasp Planning , 2018, IEEE Robotics and Automation Letters.

[44]  Pieter Abbeel,et al.  Finding Locally Optimal, Collision-Free Trajectories with Sequential Convex Optimization , 2013, Robotics: Science and Systems.

[45]  Narendra Ahuja,et al.  A potential field approach to path planning , 1992, IEEE Trans. Robotics Autom..

[46]  Grant D. Huang,et al.  Robot-assisted therapy for long-term upper-limb impairment after stroke. , 2010, The New England journal of medicine.

[47]  Monica Malvezzi,et al.  Mapping Synergies From Human to Robotic Hands With Dissimilar Kinematics: An Approach in the Object Domain , 2013, IEEE Transactions on Robotics.

[48]  Mike Stilman,et al.  Global Manipulation Planning in Robot Joint Space With Task Constraints , 2010, IEEE Transactions on Robotics.

[49]  Matteo Bianchi,et al.  A data-driven kinematic model of the human hand with soft-tissue artifact compensation mechanism for grasp synergy analysis , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[50]  Neville Hogan,et al.  Robotic Therapy: The Tipping Point , 2012, American journal of physical medicine & rehabilitation.

[51]  Milan Simic,et al.  Sampling-Based Robot Motion Planning: A Review , 2014, IEEE Access.

[52]  Aurelio Piazzi,et al.  Global minimum-jerk trajectory planning of robot manipulators , 2000, IEEE Trans. Ind. Electron..