Parallel Interacting Multiple Model-Based Human Motion Prediction for Motion Planning of Companion Robots

We propose in this paper an autonomous motion planning framework for companion robots to accompany humans in a socially desirable manner, which takes safety and comfort requirements into account. The overall framework consists of two parts: first, a novel parallel interacting multiple model-unscented Kalman filter (PIMM-UKF) approach is developed to simultaneously estimate human motion states and model mismatch, and then systematically predict the position and velocity of the human for a finite horizon. Second, based on the predicted human states, a nonlinear model predictive control (MPC) technique is utilized for the robot motion planning. The simulation results have demonstrated the superior performance in prediction using the PIMM-UKF approach. The effectiveness of the MPC planner is also shown by successfully facilitating the socially desirable companion behavior.

[1]  Tyler Ryan,et al.  LMI-Based Gain Synthesis for Simple Robust Quadrotor Control , 2013, IEEE Transactions on Automation Science and Engineering.

[2]  Francesco Borrelli,et al.  Vehicle inertial parameter identification using Extended and unscented Kalman Filters , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[3]  Christian Vollmer,et al.  Learning to navigate through crowded environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[4]  Yong Rui,et al.  Better proposal distributions: object tracking using unscented particle filter , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  Jake K. Aggarwal,et al.  Human Motion Analysis: A Review , 1999, Comput. Vis. Image Underst..

[6]  Jitendra Malik,et al.  Robust Multiple Car Tracking with Occlusion Reasoning , 1994, ECCV.

[7]  M. Horowitz.  HUMAN SPATIAL BEHAVIOR. , 1965, American journal of psychotherapy.

[8]  Illah R. Nourbakhsh,et al.  Human-robot teaming for search and rescue , 2005, IEEE Pervasive Computing.

[9]  Chang Liu,et al.  Interacting multiple model-based human motion prediction for motion planning of companion robots , 2015, SSRR.

[10]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[11]  S. Haykin.  Kalman Filtering and Neural Networks , 2001 .

[12]  E. Hall,et al.  Proxemics [and Comments and Replies] , 1968, Current Anthropology.

[13]  Rudolph van der Merwe,et al.  The unscented Kalman filter for nonlinear estimation , 2000, Proceedings of the IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium (Cat. No.00EX373).

[14]  Christian Laugier,et al.  From Proxemics Theory to Socially-Aware Navigation: A Survey , 2014, International Journal of Social Robotics.

[15]  John Folkesson,et al.  Unsupervised robot learning to predict person motion , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Jeffrey K. Uhlmann,et al.  Unscented filtering and nonlinear estimation , 2004, Proceedings of the IEEE.

[17]  Andreas Krause,et al.  Robot navigation in dense human crowds: Statistical models and experimental studies of human–robot cooperation , 2015, Int. J. Robotics Res..

[18]  Steven M. LaValle,et al.  RRT-connect: An efficient approach to single-query path planning , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[19]  Robin R. Murphy,et al.  Human-robot interactions during the robot-assisted urban search and rescue response at the World Trade Center , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[20]  Wolfram Burgard,et al.  Learning Motion Patterns of People for Compliant Robot Motion , 2005, Int. J. Robotics Res..

[21]  Rachid Alami,et al.  Human-aware robot navigation: A survey , 2013, Robotics Auton. Syst..

[22]  Maja J. Mataric,et al.  Autonomous human–robot proxemics: socially aware navigation based on interaction potential , 2016, Autonomous Robots.

[23]  Henrik I. Christensen,et al.  Autonomous person following for telepresence robots , 2013, 2013 IEEE International Conference on Robotics and Automation.

[24]  Christian Laugier,et al.  Probabilistic navigation in dynamic environment using Rapidly-exploring Random Trees and Gaussian processes , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Thiagalingam Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation , 2001 .

[26]  Gonzalo Ferrer,et al.  Robot social-aware navigation framework to accompany people walking side-by-side , 2016, Autonomous Robots.

[27]  Julien Diard,et al.  Proxemics models for human-aware navigation in robotics: Grounding interaction and personal space models in experimental data from psychology , 2014 .

[28]  Tomás Svoboda,et al.  Designing Intelligent Robots for Human-Robot Teaming in Urban Search and Rescue , 2012, AAAI Spring Symposium: Designing Intelligent Robots.

[29]  Sirish L. Shah,et al.  Evaluation of Adaptive Extended Kalman Filter Algorithms for State Estimation in Presence of Model-Plant Mismatch , 2013 .

[30]  R. Stephenson.  A and V , 1962, The British journal of ophthalmology.

[31]  Jianda Han,et al.  Disturbance estimation for RUAV using UKF with acceleration measurement , 2015, 2015 IEEE International Conference on Mechatronics and Automation (ICMA).

[32]  Thomas Bak,et al.  Trajectory planning for robots in dynamic human environments , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[33]  Vijay Kumar,et al.  Autonomous multi-floor indoor navigation with a computationally constrained MAV , 2011, 2011 IEEE International Conference on Robotics and Automation.

[34]  Vijay Kumar,et al.  Human-Robot Collaborative Topological Exploration for Search and Rescue Applications , 2014, DARS.

[35]  Zhenyu He,et al.  Single object tracking via robust combination of particle filter and sparse representation , 2015, Signal Process..

[36]  M. Baldassare.  Human Spatial Behavior , 1978 .

[37]  Derek Stanley Caveney.  Multiple model techniques in automotive estimation and control , 2004 .

[38]  Manfred Morari,et al.  Model predictive control: Theory and practice - A survey , 1989, Autom..