Anticipatory models of human movements and dynamics: the roadmap of the AnDy project

Future robots will need more and more anticipation capabilities, to properly react to human actions and provide efficient collaboration. To achieve this goal, we need new technologies that not only estimate the motion of the humans, but that fully describe the whole-body dynamics of the interaction and that can also predict its outcome. These hardware and software technologies are the goal of the European project AnDy. In this paper, we describe the roadmap of AnDy, which leverages existing technologies to endow robots with the ability to control physical collaboration through intentional interaction. To achieve this goal, AnDy relies on three technological and scientific breakthroughs. First, AnDy will innovate the way of measuring human whole-body motions by developing the wearable AnDySuit, which tracks motions and records forces. Second, AnDy will develop the AnDyModel, which combines ergonomic models with cognitive predictive models of human dynamic behavior in collaborative tasks, learned from data acquired with the AnDySuit. Third, AnDy will propose AnDyControl, an innovative technology for assisting humans through pre-dictive physical control, based on AnDyModel. By measuring and modeling human whole-body dynamics, AnDy will provide robots with a new level of awareness about human intentions and ergonomy. By incorporating this awareness on-line in the robot's controllers, AnDy paves the way for novel applications of physical human-robot collaboration in manufacturing, health-care, and assisted living.

[1]  M. Ishii,et al.  Stand alone wearable power assisting suit - sensing and control systems , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[2]  Gabriele Nava,et al.  Momentum control of humanoid robots with series elastic actuators , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[3]  Takayuki Tanaka,et al.  Motion-Based-Design of Elastic Material for Passive Assistive Device Using Musculoskeletal Model , 2011, J. Robotics Mechatronics.

[4]  Sukyung Park,et al.  Leg stiffness increases with speed to modulate gait frequency and propulsion energy. , 2011, Journal of biomechanics.

[5]  Aaron M. Dollar,et al.  Lower Extremity Exoskeletons and Active Orthoses: Challenges and State-of-the-Art , 2008, IEEE Transactions on Robotics.

[6]  Daniele Pucci,et al.  iCub Whole-Body Control through Force Regulation on Rigid Non-Coplanar Contacts , 2015, Front. Robot. AI.

[7]  Kyle B. Reed,et al.  Cooperative Physical Human-Human and Human-Robot Interaction , 2012, Immersive Multimodal Interactive Presence.

[8]  Siddhartha S. Srinivasa,et al.  Generating Legible Motion , 2013, Robotics: Science and Systems.

[9]  Mohamed Chetouani,et al.  Towards Engagement Models that Consider Individual Factors in HRI: On the Relation of Extroversion and Negative Attitude Towards Robots to Gaze and Speech During a Human–Robot Assembly Task , 2015, Int. J. Soc. Robotics.

[10]  David Vogt,et al.  Inferring guidance information in cooperative human-robot tasks , 2013, 2013 13th IEEE-RAS International Conference on Humanoid Robots (Humanoids).

[11]  Michael Alexander,et al.  Passive exoskeletons for assisting limb movement. , 2006, Journal of rehabilitation research and development.

[12]  Yoshiyuki Sankai,et al.  Power assist method based on Phase Sequence and muscle force condition for HAL , 2005, Adv. Robotics.

[13]  Andrej Gams,et al.  Effects of Robotic Knee Exoskeleton on Human Energy Expenditure , 2013, IEEE Transactions on Biomedical Engineering.

[14]  Mohamed Chetouani,et al.  Robot initiative in a team learning task increases the rhythm of interaction but not the perceived engagement , 2014, Front. Neurorobot..

[15]  Philippe Fraisse,et al.  Experimental study on haptic communication of a human in a shared human-robot collaborative task , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Ken Endo,et al.  A Quasi-Passive Leg Exoskeleton for Load-Carrying Augmentation , 2007, Int. J. Humanoid Robotics.

[17]  Giuseppe Oriolo,et al.  Learning soft task priorities for safe control of humanoid robots with constrained stochastic optimization , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[18]  Olivier Sigaud,et al.  Learning compact parameterized skills with a single regression , 2013, 2013 13th IEEE-RAS International Conference on Humanoid Robots (Humanoids).

[19]  Freek Stulp,et al.  Co-manipulation with multiple probabilistic virtual guides , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  Alessandro De Luca,et al.  Collision detection and reaction: A contribution to safe physical Human-Robot Interaction , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  François Keith,et al.  Human-humanoid haptic joint object transportation case study , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Alexander Verl,et al.  Cooperation of human and machines in assembly lines , 2009 .

[23]  Martin Buss,et al.  Shared decision making in a collaborative task with reciprocal haptic feedback - an efficiency-analysis , 2010, 2010 IEEE International Conference on Robotics and Automation.

[24]  Rachid Alami,et al.  Synthesizing Robot Motions Adapted to Human Presence , 2010 .

[25]  Olivier Sigaud,et al.  Deep unsupervised network for multimodal perception, representation and classification , 2015, Robotics Auton. Syst..

[26]  Daniel P. Ferris,et al.  Running in the real world: adjusting leg stiffness for different surfaces , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[27]  Nicola Vitiello,et al.  Sensing Pressure Distribution on a Lower-Limb Exoskeleton Physical Human-Machine Interface , 2010, Sensors.

[28]  Antonio Bicchi,et al.  On making robots understand safety: Embedding injury knowledge into control , 2012, Int. J. Robotics Res..

[29]  Nikolaos G. Tsagarakis,et al.  Variable impedance actuators: Moving the robots of tomorrow , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.