Intent-Aware Conditional Generative Adversarial Network for Pedestrian Path Prediction

Learning to understand human behaviors and forecast their motions is a prerequisite for an automated car to navigate in urban traffic safely and efficiently. When pedestrians interact with a vehicle, they follow specific motion patterns based on their intentions. This work presents a conditional generative adversarial network based architecture that explicitly model human intention as a conditional variable to robustly learn the multi-modal nature of pedestrian motion for accurate future trajectory prediction. The generator in our framework uses a LSTM encoder-decoder conditioned on human intention for motion prediction while the discriminator consisting of a LSTM classifier learns to distinguish whether a predicted trajectory is consistent with a given intention. Through experiments on two real-world datasets, it demonstrates that our proposed architecture outperforms state-of-the-art methods in terms of the average displacement error of predicted positions. Additionally, qualitative analysis shows that our model is capable of predicting a multi-modal distribution with respect to human intentions.

[1]  Song-Chun Zhu,et al.  Modeling and Inferring Human Intents and Latent Functional Objects for Trajectory Prediction , 2016, ArXiv.

[2]  Song-Chun Zhu,et al.  Learning and Inferring “Dark Matter” and Predicting Human Intents and Trajectories in Videos , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Roland Siegwart,et al.  Feature Relevance Estimation for Learning Pedestrian Behavior at Crosswalks , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[4]  Enrico Pagello,et al.  A mobile robot for transport applications in hospital domain with safe human detection algorithm , 2009, 2009 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[5]  C. G. Keller,et al.  Will the Pedestrian Cross? A Study on Pedestrian Path Prediction , 2014, IEEE Transactions on Intelligent Transportation Systems.

[6]  Hannes Sommer,et al.  A Data-driven Model for Interaction-Aware Pedestrian Motion Prediction in Object Cluttered Environments , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Gonzalo Ferrer,et al.  Bayesian Human Motion Intentionality Prediction in urban environments , 2014, Pattern Recognit. Lett..

[8]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[9]  Vladimir Pavlovic,et al.  Learning Switching Linear Models of Human Motion , 2000, NIPS.

[10]  Wolfram Burgard,et al.  Learning Motion Patterns of People for Compliant Robot Motion , 2005, Int. J. Robotics Res..

[11]  Stefano Soatto,et al.  Intent-aware long-term prediction of pedestrian motion , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Simon Osindero,et al.  Conditional Generative Adversarial Nets , 2014, ArXiv.

[13]  Gonzalo Ferrer,et al.  Behavior estimation for a complete framework for human motion prediction in crowded environments , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[14]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[15]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[16]  Sridha Sridharan,et al.  Soft + Hardwired Attention: An LSTM Framework for Human Trajectory Prediction and Abnormal Event Detection , 2017, Neural Networks.

[17]  Chung Choo Chung,et al.  Sequence-to-Sequence Prediction of Vehicle Trajectory via LSTM Encoder-Decoder Architecture , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[18]  Daniel Cremers,et al.  SPENCER: A Socially Aware Service Robot for Passenger Guidance and Help in Busy Airports , 2015, FSR.

[19]  G. Srinivasaraghavan,et al.  Human Trajectory Prediction using Spatially aware Deep Attention Models , 2017, ArXiv.

[20]  Julian F. P. Kooij,et al.  Supplemental Material Context-based Pedestrian Path Prediction , 2014 .

[21]  Martial Hebert,et al.  Activity Forecasting , 2012, ECCV.

[22]  Mark Reynolds,et al.  SS-LSTM: A Hierarchical LSTM Model for Pedestrian Trajectory Prediction , 2018, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[23]  Dariu Gavrila,et al.  UvA-DARE ( Digital Academic Repository ) Pedestrian Path Prediction with Recursive Bayesian Filters : A Comparative Study , 2013 .

[24]  Siddhartha S. Srinivasa,et al.  Planning-based prediction for pedestrians , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Eike Rehder,et al.  Goal-Directed Pedestrian Prediction , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[26]  Roland Siegwart,et al.  A data-driven approach for pedestrian intention estimation , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).