Improvements in pedestrian movement prediction by considering multiple intentions in a Multi-Hypotheses filter

Fully automated vehicles and mobile robots have to operate in a shared environment with pedestrians in the future. To minimize the risk for pedestrians, it is very important to track them in a precise way. One important information source is the intention of the pedestrian. For the integration of the intention information with conventional tracking algorithms, a Multi-Hypotheses filter is proposed, using a generalized potential field, which can be modeled using pedestrian movements. As the intention of the person is unknown, different hypotheses for the intention of the pedestrian are considered. The Multi-Hypotheses filter is used for the prediction of pedestrian trajectories and compared with a simple Kalman filter. The evaluation is performed in dependence on the free parameters, which are the prediction time, the tracking time and the measurement quality (modeled by additional additive white Gaussian noise). The proposed approach is evaluated using real camera data from a simple scenario in the Edinburgh Informatics Forum. For evaluation, the root mean square error and a confidence score, which is based on the normalized entropy, are considered. The Multi-Hypotheses based prediction outperforms the simple Kalman filter over the whole range of measurement quality, prediction and tracking time horizons in the case of the root mean square error and in the case of the confidence score.

[1]  Hao Tang,et al.  Reliable Prediction System Based on Support Vector Regression with Genetic Algorithms , 2009, 2009 Fifth International Conference on Natural Computation.

[2]  Wolfram Burgard,et al.  Probabilistic Robotics (Intelligent Robotics and Autonomous Agents) , 2005 .

[3]  Sebastian Houben,et al.  Arbitrary object localization and tracking via multiple-camera surveillance system embedded in a parking garage , 2015, Electronic Imaging.

[4]  Christophe F. Wakim,et al.  A Markovian model of pedestrian behavior , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[5]  Antonella Ferrara,et al.  Onboard Sensor-Based Collision Risk Assessment to Improve Pedestrians' Safety , 2007, IEEE Transactions on Vehicular Technology.

[6]  Chris R. Drane Positioning Systems: A Unified Approach , 1992 .

[7]  Jun Liu,et al.  Generic application driven situation awareness via ontological situation recognition , 2016, 2016 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA).

[8]  Serge P. Hoogendoorn,et al.  Controlled experiments to derive walking behaviour , 2002 .

[9]  Jörn Thielecke,et al.  Pedestrian Tracking using a Generalized Potential Field Approach , 2017, VISIGRAPP.

[10]  Helbing,et al.  Social force model for pedestrian dynamics. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[11]  Satoshi Kagami,et al.  A probabilistic model of human motion and navigation intent for mobile robot path planning , 2000, 2009 4th International Conference on Autonomous Robots and Agents.

[12]  David Hsu,et al.  Intention-aware online POMDP planning for autonomous driving in a crowd , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[13]  Markus Hiller,et al.  Multiple intention tracking by a generalizec potential field approach , 2017, 2017 Sensor Data Fusion: Trends, Solutions, Applications (SDF).

[14]  Wolfram Burgard,et al.  Improved Techniques for Grid Mapping With Rao-Blackwellized Particle Filters , 2007, IEEE Transactions on Robotics.

[15]  Hirotake Yamazoe,et al.  Remote gaze estimation with a single camera based on facial-feature tracking without special calibration actions , 2008, ETRA.

[16]  Darin T. Dunham Tracking Multiple Targets in Cluttered Environments with the Probabilistic Multi-Hypothesis Tracking Filter , 1997 .

[17]  Emilio Frazzoli,et al.  Intention-Aware Motion Planning , 2013, WAFR.

[18]  Mi-Gyung Cho,et al.  A Short-Term Prediction Model for Forecasting Traffic Information Using Bayesian Network , 2008, 2008 Third International Conference on Convergence and Hybrid Information Technology.

[19]  Thomas B. Schön,et al.  Marginalized particle filters for mixed linear/nonlinear state-space models , 2005, IEEE Transactions on Signal Processing.

[20]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[21]  Koichi Hashimoto,et al.  Learning human motion intention with 3D Convolutional Neural Network , 2017, 2017 IEEE International Conference on Mechatronics and Automation (ICMA).