Human arm motion modeling and long-term prediction for safe and efficient Human-Robot-Interaction

Modeling and predicting human behavior is indispensable when industrial robots interacting with human operators are to be manipulated safely and efficiently. One challenge is that human operators tend to follow different motion patterns, depending on their intention and the structure of the environment. This precludes the use of classical estimation techniques based on kinematic or dynamic models, especially for the purpose of long-term prediction. In this paper, we propose a method based on Hidden Markov Models to predict the region of the workspace that is possibly occupied by the human within a prediction horizon. In contrast to predictions in the form of single points such as most likely human positions as obtained from previous approaches, the regions obtained here may serve as safety constraints when the robot motion is planned or optimized. This way one avoids collisions with a probability not less than a predefined threshold. The practicability of our method is demonstrated by successfully and accurately predicting the motion of a human arm in two scenarios involving multiple motion patterns.

[1]  Armin Biess,et al.  A Computational Model for Redundant Human Three-Dimensional Pointing Movements: Integration of Independent Spatial and Temporal Motor Plans Simplifies Movement Dynamics , 2007, The Journal of Neuroscience.

[2]  Marjan A Admiraal,et al.  Modeling kinematics and dynamics of human arm movements. , 2004, Motor control.

[3]  Christian Laugier,et al.  Growing Hidden Markov Models: An Incremental Tool for Learning and Predicting Human and Vehicle Motion , 2009, Int. J. Robotics Res..

[4]  Mark L. Nagurka,et al.  Simulating Discrete and Rhythmic Multi-joint Human Arm Movements by Optimization of Nonlinear Performance Indices , 2006, Biological Cybernetics.

[5]  Olaf Stursberg,et al.  Efficient Representation and Computation of Reachable Sets for Hybrid Systems , 2003, HSCC.

[6]  Helge J. Ritter,et al.  An instantaneous topological mapping model for correlated stimuli , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[7]  Gunther Reissig,et al.  Computing Abstractions of Nonlinear Systems , 2009, IEEE Transactions on Automatic Control.

[8]  Alin Albu-Schäffer,et al.  Requirements for Safe Robots: Measurements, Analysis and New Insights , 2009, Int. J. Robotics Res..

[9]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[10]  Olaf Stursberg,et al.  Improving motion of robotic manipulators by an embedded optimizer , 2010, 2010 IEEE International Conference on Automation Science and Engineering.

[11]  Tieniu Tan,et al.  A system for learning statistical motion patterns , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Joseph J. LaViola,et al.  Double exponential smoothing: an alternative to Kalman filter-based predictive tracking , 2003, IPT/EGVE.

[13]  Geoffrey E. Hinton,et al.  A View of the Em Algorithm that Justifies Incremental, Sparse, and other Variants , 1998, Learning in Graphical Models.

[14]  Norman I. Badler,et al.  Real-Time Inverse Kinematics of the Human Arm , 1996, Presence: Teleoperators & Virtual Environments.

[15]  Antonio Bicchi,et al.  An atlas of physical human-robot interaction , 2008 .

[16]  M. Spong,et al.  Robot Modeling and Control , 2005 .

[17]  Olaf Stursberg,et al.  Optimal path planning in the workspace for articulated robots using mixed integer programming , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Olaf Stursberg,et al.  Increasing Reliability of Intelligent Manufacturing Systems by Adaptive Optimization and Safety Supervision , 2009 .

[19]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[20]  Wolfram Burgard,et al.  Learning motion patterns of persons for mobile service robots , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[21]  Wolfram Burgard,et al.  Learning Motion Patterns of People for Compliant Robot Motion , 2005, Int. J. Robotics Res..