Analysis and Prediction of Pedestrian Crosswalk Behavior during Automated Vehicle Interactions

For safe navigation around pedestrians, automated vehicles (AVs) need to plan their motion by accurately predicting pedestrians’ trajectories over long time horizons. Current approaches to AV motion planning around crosswalks predict only for short time horizons (1-2 s) and are based on data from pedestrian interactions with human-driven vehicles (HDVs). In this paper, we develop a hybrid systems model that uses pedestrians’ gap acceptance behavior and constant velocity dynamics for long-term pedestrian trajectory prediction when interacting with AVs. Results demonstrate the applicability of the model for long-term (> 5 s) pedestrian trajectory prediction at crosswalks. Further, we compared measures of pedestrian crossing behaviors in the immersive virtual environment (when interacting with AVs) to that in the real world (results of published studies of pedestrians interacting with HDVs), and found similarities between the two. These similarities demonstrate the applicability of the hybrid model of AV interactions developed from an immersive virtual environment (IVE) for real-world scenarios for both AVs and HDVs.

[1]  Jonathan P. How,et al.  Learning in the Curbside Coordinate Frame for a Transferable Pedestrian Trajectory Prediction Model , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[2]  Ronald B Gibbons,et al.  The Reality of Virtual Reality: A Comparison of Pedestrian Behavior in Real and Virtual Environments , 2018 .

[3]  C. G. Keller,et al.  Will the Pedestrian Cross? A Study on Pedestrian Path Prediction , 2014, IEEE Transactions on Intelligent Transportation Systems.

[4]  Rikard Fredriksson,et al.  Communicating Intent of Automated Vehicles to Pedestrians , 2018, Front. Psychol..

[5]  Miguel Ángel Sotelo,et al.  Pedestrian Path, Pose, and Intention Prediction Through Gaussian Process Dynamical Models and Pedestrian Activity Recognition , 2019, IEEE Transactions on Intelligent Transportation Systems.

[6]  Saeid Nahavandi,et al.  Towards trusted autonomous vehicles from vulnerable road users perspective , 2017, 2017 Annual IEEE International Systems Conference (SysCon).

[7]  Matthew Johnson-Roberson,et al.  Bio-LSTM: A Biomechanically Inspired Recurrent Neural Network for 3-D Pedestrian Pose and Gait Prediction , 2018, IEEE Robotics and Automation Letters.

[8]  Tarak Gandhi,et al.  Pedestrian Protection Systems: Issues, Survey, and Challenges , 2007, IEEE Transactions on Intelligent Transportation Systems.

[9]  P. Vedagiri,et al.  Models for pedestrian gap acceptance behaviour analysis at unprotected mid-block crosswalks under mixed traffic conditions , 2015 .

[10]  Martial Hebert,et al.  Activity Forecasting , 2012, ECCV.

[11]  Shuchisnigdha Deb,et al.  Pedestrians’ Receptivity Toward Fully Automated Vehicles: Research Review and Roadmap for Future Research , 2018, IEEE Transactions on Human-Machine Systems.

[12]  Brian C. Williams,et al.  Hybrid estimation of complex systems , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  Stefano Soatto,et al.  Intent-aware long-term prediction of pedestrian motion , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[14]  Bon K. Sy,et al.  Information Theory & Statistics , 2004 .

[15]  Dariu Gavrila,et al.  Context-Based Path Prediction for Targets with Switching Dynamics , 2018, International Journal of Computer Vision.

[16]  Martin T. Pietrucha,et al.  FIELD STUDIES OF PEDESTRIAN WALKING SPEED AND START-UP TIME , 1996 .

[17]  Adam Millard-Ball,et al.  Pedestrians, Autonomous Vehicles, and Cities , 2016 .

[18]  John Platt,et al.  Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods , 1999 .

[19]  Stefania Bandini,et al.  Towards Modelling Pedestrian-Vehicle Interactions: Empirical Study on Urban Unsignalized Intersection , 2016, ArXiv.

[20]  Klaus Bengler,et al.  Analyses of pedestrian behavior on mid-block unsignalized crosswalk comparing Chinese and German cases , 2015 .

[21]  Martin Lauer,et al.  A Literature Review on the Prediction of Pedestrian Behavior in Urban Scenarios , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[22]  Dinesh Manocha,et al.  PORCA: Modeling and Planning for Autonomous Driving Among Many Pedestrians , 2018, IEEE Robotics and Automation Letters.

[23]  Sebastian Thrun,et al.  Discriminative Training of Kalman Filters , 2005, Robotics: Science and Systems.

[24]  Antonio M. López,et al.  Is the Pedestrian going to Cross? Answering by 2D Pose Estimation , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[25]  Chih-Jen Lin,et al.  Feature Ranking Using Linear SVM , 2008, WCCI Causation and Prediction Challenge.

[26]  Nicolas Guéguen,et al.  A pedestrian’s stare and drivers’ stopping behavior: A field experiment at the pedestrian crossing , 2015 .

[27]  John K. Tsotsos,et al.  Understanding Pedestrian Behavior in Complex Traffic Scenes , 2018, IEEE Transactions on Intelligent Vehicles.

[28]  Silvio Savarese,et al.  Social LSTM: Human Trajectory Prediction in Crowded Spaces , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  George Yannis,et al.  A critical assessment of pedestrian behaviour models , 2009 .

[30]  Matthew Johnson-Roberson,et al.  Real-Time Certified Probabilistic Pedestrian Forecasting , 2017, IEEE Robotics and Automation Letters.

[31]  Roland Siegwart,et al.  A data-driven approach for pedestrian intention estimation , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[32]  Wendy Ju,et al.  Ghost driver: A field study investigating the interaction between pedestrians and driverless vehicles , 2016, 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[33]  Katherine M. Tsui,et al.  Trust in AV: An Uncertainty Reduction Model of AV-Pedestrian Interactions , 2018, HRI.

[34]  John K. Tsotsos,et al.  Autonomous Vehicles That Interact With Pedestrians: A Survey of Theory and Practice , 2018, IEEE Transactions on Intelligent Transportation Systems.

[35]  George Yannis,et al.  Pedestrian gap acceptance for mid-block street crossing , 2013 .

[36]  Lionel P. Robert,et al.  The future of pedestrian-automated vehicle interactions , 2019, XRDS.

[37]  Joost C. F. de Winter,et al.  Interaction between pedestrians and automated vehicles: A Wizard of Oz experiment , 2018, Transportation Research Part F: Traffic Psychology and Behaviour.