Human intention inference through interacting multiple model filtering

We present an algorithm to learn human arm motion from demonstrations and infer the goal location (intention) of human reaching actions. To capture the complexity of human arm reaching motion, an artificial neural network (ANN) is used to represent the arm motion dynamics. The trajectories of the arm motion for reaching operation are modeled as stable dynamic systems with contracting behavior towards the goal location. The ANN is trained subjected to contraction analysis constraints. To adapt the motion model learned from a few demonstrations to novel scenarios or multiple objects, we use an interacting multiple model framework. The multiple models are obtained by translating the origin of the contracting system to different known goal locations. The posterior probabilities of the models are calculated through interactive model matched filtering carried out using extended Kalman filters (EKFs). The correct model is chosen according to the posterior probabilities to infer the correct intention. Demonstrations and measurements are recorded using a Microsoft Kinect sensor and experimental results are presented to validate the proposed algorithm.

[1]  Darius Burschka,et al.  Predicting human intention in visual observations of hand/object interactions , 2013, 2013 IEEE International Conference on Robotics and Automation.

[2]  Jean-Jacques E. Slotine,et al.  On Contraction Analysis for Nonlinear Systems Analyzing stability differentially leads to a new perspective on nonlinear dynamic systems , 1999 .

[3]  Dmitry Berenson,et al.  Motion Planning for Human-Robot Collaborative Manipulation Tasks Using Prediction of Human Motion , 2014 .

[4]  Stefanos Nikolaidis,et al.  Efficient Model Learning from Joint-Action Demonstrations for Human-Robot Collaborative Tasks , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[5]  Andreas Krause,et al.  Robot navigation in dense human crowds: Statistical models and experimental studies of human–robot cooperation , 2015, Int. J. Robotics Res..

[6]  Carlos Morato,et al.  Toward Safe Human Robot Collaboration by Using Multiple Kinects Based Real-Time Human Tracking , 2014, J. Comput. Inf. Sci. Eng..

[7]  Brett R. Fajen,et al.  Behavioral dynamics of steering, obstacle avoidance, and route selection. , 2003 .

[8]  Roben A. Strikwerda Understanding Human Action: Social Explanation and the Vision of Social Science , 1991 .

[9]  Olaf Stursberg,et al.  Human arm motion modeling and long-term prediction for safe and efficient Human-Robot-Interaction , 2011, 2011 IEEE International Conference on Robotics and Automation.

[10]  Jos Elfring,et al.  Learning intentions for improved human motion prediction , 2013, 2013 16th International Conference on Advanced Robotics (ICAR).

[11]  Masayoshi Tomizuka,et al.  Ensuring safety in human-robot coexistence environment , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Antonio Bicchi,et al.  Measuring intent in human-robot cooperative manipulation , 2009, 2009 IEEE International Workshop on Haptic Audio visual Environments and Games.

[13]  Heinz Wörn,et al.  A novel approach to proactive human-robot cooperation , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[14]  Brett R Fajen,et al.  Behavioral dynamics of steering, obstacle avoidance, and route selection. , 2003, Journal of experimental psychology. Human perception and performance.

[15]  N. Z. Shor Class of global minimum bounds of polynomial functions , 1987 .

[16]  Shuzhi Sam Ge,et al.  Human–Robot Collaboration Based on Motion Intention Estimation , 2014, IEEE/ASME Transactions on Mechatronics.

[17]  Cong Wang,et al.  Fast planning of well conditioned trajectories for model learning , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Dmitry Berenson,et al.  Human-robot collaborative manipulation planning using early prediction of human motion , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Tanja Schultz,et al.  Combined intention, activity, and motion recognition for a humanoid household robot , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Bernhard Schölkopf,et al.  Probabilistic movement modeling for intention inference in human–robot interaction , 2013, Int. J. Robotics Res..

[21]  Dana Kulic,et al.  Estimating intent for human-robot interaction , 2003 .

[22]  Jean-Jacques E. Slotine,et al.  On Contraction Analysis for Non-linear Systems , 1998, Autom..

[23]  Stefan Schaal,et al.  Is imitation learning the route to humanoid robots? , 1999, Trends in Cognitive Sciences.

[24]  Aude Billard,et al.  Learning Stable Nonlinear Dynamical Systems With Gaussian Mixture Models , 2011, IEEE Transactions on Robotics.

[25]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[26]  Jodie A. Baird,et al.  Discerning intentions in dynamic human action , 2001, Trends in Cognitive Sciences.

[27]  David J. C. MacKay,et al.  A Practical Bayesian Framework for Backpropagation Networks , 1992, Neural Computation.

[28]  Uwe D. Hanebeck,et al.  A generic model for estimating user intentions in human-robot cooperation , 2005, ICINCO.

[29]  Y. Bar-Shalom,et al.  The interacting multiple model algorithm for systems with Markovian switching coefficients , 1988 .