Prediction of Intention during Interaction with iCub with Probabilistic Movement Primitives

This paper describes our open-source software for predicting the intention of a user physically interacting with the humanoid robot iCub. Our goal is to allow the robot to infer the intention of the human partner during collaboration, by predicting the future intended trajectory: this capability is critical to design anticipatory behaviors that are crucial in human-robot collaborative scenarios, such as in co-manipulation, cooperative assembly or transportation. We propose an approach to endow the iCub with basic capabilities of intention recognition, based on Probabilistic Movement Primitives (ProMPs), a versatile method for representing, generalizing, and reproducing complex motor skills. The robot learns a set of motion primitives from several demonstrations, provided by the human via physical interaction. During training, we model the collaborative scenario using human demonstrations. During the reproduction of the collaborative task, we use the acquired knowledge to recognize the intention of the human partner. Using a few early observations of the state of the robot, we can not only infer the intention of the partner, but also complete the movement, even if the user breaks the physical interaction with the robot. We evaluate our approach in simulation and on the real iCub. In simulation, the iCub is driven by the user using the Geomagic Touch haptic device. In the real robot experiment, we directly interact with the iCub by grabbing and manually guiding the robot's arm. We realize two experiments on the real robot: one with simple reaching trajectories, and one inspired by collaborative object sorting. The software implementing our approach is open-source and available on the GitHub platform. Additionally, we provide tutorials and videos.

[1]  P. Fitts.  The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[2]  D. Chaffin,et al.  An investigation of fitts' law using a wide range of movement amplitudes. , 1976, Journal of motor behavior.

[3]  P. Fitts.  The information capacity of the human motor system in controlling the amplitude of movement. 1954. , 1992, Journal of experimental psychology. General.

[4]  Yoshifumi Nishida,et al.  Active understanding of human intention by a robot through monitoring of human behavior , 1994 .

[5]  Aude Billard,et al.  Learning human arm movements by imitation: : Evaluation of a biologically inspired connectionist architecture , 2000, Robotics Auton. Syst..

[6]  Eamonn Keogh.  Exact Indexing of Dynamic Time Warping , 2002, VLDB.

[7]  Guangyou Xu,et al.  Human action recognition with primitive-based coupled-HMM , 2002, Object recognition supported by user interaction for service robots.

[8]  Hilary Buxton,et al.  Learning and understanding dynamic scene activity: a review , 2003, Image Vis. Comput..

[9]  J. F. Soechting,et al.  Effect of target size on spatial and temporal characteristics of a pointing movement in man , 2004, Experimental Brain Research.

[10]  Yoram Singer,et al.  The Hierarchical Hidden Markov Model: Analysis and Applications , 1998, Machine Learning.

[11]  Svetha Venkatesh,et al.  Learning and detecting activities from movement trajectories using the hierarchical hidden Markov model , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[12]  David J. Fleet,et al.  Gaussian Process Dynamical Models , 2005, NIPS.

[13]  S. Schaal.  Dynamic Movement Primitives -A Framework for Motor Control in Humans and Humanoid Robotics , 2006 .

[14]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[15]  Rachid Alami,et al.  Toward Human-Aware Robot Task Planning , 2006, AAAI Spring Symposium: To Boldly Go Where No Human-Robot Team Has Gone Before.

[16]  Maya Cakmak,et al.  To Afford or Not to Afford: A New Formalization of Affordances Toward Affordance-Based Robot Control , 2007, Adapt. Behav..

[17]  Yiannis Demiris,et al.  Prediction of intent in robotics and multi-agent systems , 2007, Cognitive Processing.

[18]  G. Csibra,et al.  'Obsessed with goals': functions and mechanisms of teleological interpretation of actions in humans. , 2007, Acta psychologica.

[19]  Yiannis Demiris,et al.  Human-wheelchair collaboration through prediction of intention and adaptive assistance , 2008, 2008 IEEE International Conference on Robotics and Automation.

[20]  Guillaume Morel,et al.  How can human motion prediction increase transparency? , 2008, 2008 IEEE International Conference on Robotics and Automation.

[21]  Aude Billard,et al.  Dynamical System Modulation for Robot Learning via Kinesthetic Demonstrations , 2008, IEEE Transactions on Robotics.

[22]  Paul Evrard,et al.  Teaching physical collaborative tasks: object-lifting case study with a humanoid , 2009, 2009 9th IEEE-RAS International Conference on Humanoid Robots.

[23]  Giulio Sandini,et al.  Approximate optimal control for reaching and trajectory planning in a humanoid robot , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Guy Hoffman,et al.  Anticipation in Human-Robot Interaction , 2010, AAAI Spring Symposium: It's All in the Timing.

[25]  Giulio Sandini,et al.  An experimental evaluation of a novel minimum-jerk cartesian controller for humanoid robots , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Aude Billard,et al.  Learning Stable Nonlinear Dynamical Systems With Gaussian Mixture Models , 2011, IEEE Transactions on Robotics.

[27]  Abderrahmane Kheddar,et al.  Motion learning and adaptive impedance for robot control during physical interaction with humans , 2011, 2011 IEEE International Conference on Robotics and Automation.

[28]  Giulio Sandini,et al.  Computing robot internal/external wrenches by means of inertial, tactile and F/T sensors: Theory and implementation on the iCub , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[29]  Cynthia Breazeal,et al.  Improved human-robot team performance using Chaski, A human-inspired plan execution system , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[30]  Nikolaos G. Tsagarakis,et al.  Statistical dynamical systems for skills acquisition in humanoids , 2012, 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012).

[31]  Aude Billard,et al.  A dynamical system approach to realtime obstacle avoidance , 2012, Autonomous Robots.

[32]  Bernhard Schölkopf,et al.  Probabilistic Modeling of Human Movements for Intention Inference , 2012, Robotics: Science and Systems.

[33]  Giulio Sandini,et al.  Force feedback exploiting tactile and proximal force/torque sensing , 2012, Autonomous Robots.

[34]  Olivier Sigaud,et al.  Learning compact parameterized skills with a single regression , 2013, 2013 13th IEEE-RAS International Conference on Humanoid Robots (Humanoids).

[35]  Siddhartha S. Srinivasa,et al.  Generating Legible Motion , 2013, Robotics: Science and Systems.

[36]  G. Sandini,et al.  Robots can be perceived as goal-oriented agents , 2013 .

[37]  Jan Peters,et al.  Probabilistic Movement Primitives , 2013, NIPS.

[38]  Carme Torras,et al.  Learning Collaborative Impedance-Based Robot Behaviors , 2013, AAAI.

[39]  Jan Peters,et al.  A probabilistic approach to robot trajectory generation , 2013, 2013 13th IEEE-RAS International Conference on Humanoid Robots (Humanoids).

[40]  Jun Nakanishi,et al.  Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors , 2013, Neural Computation.

[41]  Nikos A. Aspragathos,et al.  Robot Assistance Selection for Large Object Manipulation with a Human , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[42]  Bernhard Schölkopf,et al.  Probabilistic movement modeling for intention inference in human–robot interaction , 2013, Int. J. Robotics Res..

[43]  Giulio Sandini,et al.  Communicative lifting actions in human-humanoid interaction , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[44]  Olivier Sigaud,et al.  Multiple task optimization using dynamical movement primitives for whole-body reactive control , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[45]  Pierre-Yves Oudeyer,et al.  Object Learning Through Active Exploration , 2014, IEEE Transactions on Autonomous Mental Development.

[46]  Jan Peters,et al.  Learning interaction for collaborative tasks with probabilistic movement primitives , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[47]  Mohamed Chetouani,et al.  Robot initiative in a team learning task increases the rhythm of interaction but not the perceived engagement , 2014, Front. Neurorobot..

[48]  Darwin G. Caldwell,et al.  A task-parameterized probabilistic model with minimal intervention control , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[49]  Oliver Kroemer,et al.  Interaction primitives for human-robot cooperation tasks , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[50]  Gonzalo Ferrer,et al.  Bayesian Human Motion Intentionality Prediction in urban environments , 2014, Pattern Recognit. Lett..

[51]  Siddhartha S. Srinivasa,et al.  Integrating human observer inferences into robot motion planning , 2014, Auton. Robots.

[52]  Yiannis Demiris,et al.  Learning assistance by demonstration , 2015, J. Hum. Robot Interact..

[53]  Jan Peters,et al.  Model-free Probabilistic Movement Primitives for physical interaction , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[54]  Jan Peters,et al.  Learning multiple collaborative tasks with a mixture of Interaction Primitives , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[55]  Jan Peters,et al.  Learning motor skills from partially observed movements executed at different speeds , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[56]  Abderrahmane Kheddar,et al.  Multi-contact walking pattern generation based on model preview control of 3D COM accelerations , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[57]  Gustavo E. A. P. A. Batista,et al.  Speeding Up All-Pairwise Dynamic Time Warping Matrix Calculation , 2016, SDM.

[58]  Sylvain Calinon,et al.  A tutorial on task-parameterized movement learning and retrieval , 2015, Intelligent Service Robotics.

[59]  Minoru Asada,et al.  Initiative in robot assistance during collaborative task execution , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[60]  Angelika Zube,et al.  Model Predictive Contact Control for Human-Robot Interaction , 2016 .

[61]  Stefan Schaal,et al.  A Probabilistic Representation for Dynamic Movement Primitives , 2016, ArXiv.

[62]  Anca D. Dragan,et al.  Enabling robots to communicate their objectives , 2017, Autonomous Robots.

[63]  Oliver Kroemer,et al.  Probabilistic movement primitives for coordination of multiple human–robot collaborative tasks , 2017, Auton. Robots.

[64]  Joseph Kim,et al.  Collaborative Planning with Encoding of Users' High-Level Strategies , 2017, AAAI.

[65]  Manuel Lopes,et al.  Learning Legible Motion from Human–Robot Interactions , 2017, International Journal of Social Robotics.

[66]  Jun Morimoto,et al.  Robot Learning , 2017, Encyclopedia of Machine Learning and Data Mining.

[67]  Mohamed Chetouani,et al.  Towards Engagement Models that Consider Individual Factors in HRI: On the Relation of Extroversion and Negative Attitude Towards Robots to Gaze and Speech During a Human–Robot Assembly Task , 2015, Int. J. Soc. Robotics.

[68]  Angelo Cangelosi,et al.  Affordances in Psychology, Neuroscience, and Robotics: A Survey , 2018, IEEE Transactions on Cognitive and Developmental Systems.