Agreeing to cross: How drivers and pedestrians communicate

The contribution of this paper is twofold. The first is a novel dataset for studying behaviors of traffic participants while crossing. Our dataset contains more than 650 samples of pedestrian behaviors in various street configurations and weather conditions. These examples were selected from approx. 240 hours of driving in the city, suburban and rural roads. The second contribution is an analysis of our data from the point of view of joint attention. We identify what types of non-verbal communication cues road users use at the point of crossing, their responses, and under what circumstances the crossing event takes place. It was found that in more than 90% of the cases pedestrians gaze at the approaching cars prior to crossing in non-signalized crosswalks. The crossing action, however, depends on additional factors such as time to collision, explicit driver's reaction or structure of the crosswalk.

[1]  Ernst D. Dickmanns,et al.  An integrated spatio-temporal approach to automatic visual guidance of autonomous vehicles , 1990, IEEE Trans. Syst. Man Cybern..

[2]  C. Michaels,et al.  To Cross or Not to Cross: The Effect of Locomotion on Street-Crossing Behavior , 1996 .

[3]  Satish V. Ukkusuri,et al.  Modeling of Motorist-Pedestrian Interaction at Uncontrolled Mid-block Crosswalks , 2003 .

[4]  Sebastian Thrun,et al.  Stanley: The robot that won the DARPA Grand Challenge , 2006, J. Field Robotics.

[5]  Sebastian Thrun,et al.  A Personal Account of the Development of Stanley, the Robot That Won the DARPA Grand Challenge , 2006, AI Mag..

[6]  Sarah Schmidt,et al.  Pedestrians at the kerb – Recognising the action intentions of humans , 2009 .

[7]  Dariu Gavrila,et al.  Monocular Pedestrian Detection: Survey and Experiments , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Linda Ng Boyle,et al.  The Interaction of Cognitive Load and Attention-Directing Cues in Driving , 2009, Hum. Factors.

[9]  Luc Van Gool,et al.  You'll never walk alone: Modeling social behavior for multi-target tracking , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[10]  Mike McDonald,et al.  Study of pedestrians' gap acceptance behavior when they jaywalk outside crossing facilities , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[11]  Nobuyuki Uchida,et al.  An investigation of factors contributing to major crash types in Japan based on naturalistic driving data , 2010 .

[12]  A. Tom,et al.  Gender differences in pedestrian rule compliance and visual search at signalized and unsignalized crossroads. , 2011, Accident; analysis and prevention.

[13]  Pietro Perona,et al.  Pedestrian Detection: An Evaluation of the State of the Art , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Emilio Frazzoli,et al.  Intention-Aware Pedestrian Avoidance , 2012, ISER.

[15]  Andreas Geiger,et al.  Vision meets robotics: The KITTI dataset , 2013, Int. J. Robotics Res..

[16]  Feng Jiang,et al.  Pedestrian behavior analysis using 110-car naturalistic driving data in USA , 2013 .

[17]  Keiichi Yamada,et al.  Estimating driver awareness of pedestrians from driving behavior based on a probabilistic model , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[18]  Nagui M Rouphail,et al.  Event-Based Modeling of Driver Yielding Behavior to Pedestrians at Two-Lane Roundabout Approaches , 2013, Transportation research record.

[19]  Dariu Gavrila,et al.  Context-Based Pedestrian Path Prediction , 2014, ECCV.

[20]  Silvio Savarese,et al.  Understanding Collective Activitiesof People from Videos , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  N. Lubbe,et al.  Drivers’ comfort boundaries in pedestrian crossings: A study in driver braking characteristics as a function of pedestrian walking speed , 2015 .

[22]  Raphael H. Grzebieta,et al.  The Australian naturalistic driving study: From beginnings to launch , 2015 .

[23]  Changxu Wu,et al.  The estimation of vehicle speed and stopping distance by pedestrians crossing streets in a naturalistic traffic environment , 2015 .

[24]  Nicolas Guéguen,et al.  A pedestrian’s stare and drivers’ stopping behavior: A field experiment at the pedestrian crossing , 2015 .

[25]  Rainer Stiefelhagen,et al.  Pedestrian intention recognition using Latent-dynamic Conditional Random Fields , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[26]  Bernhard Friedrich,et al.  The Effect of Autonomous Vehicles on Traffic , 2016 .

[27]  Tom Michael Gasser.  Fundamental and Special Legal Questions for Autonomous Vehicles , 2016 .

[28]  Wuhong Wang,et al.  Analysis of the Influence of Pedestrians’ eye Contact on Drivers’ Comfort Boundary During the Crossing Conflict , 2016 .

[29]  John K. Tsotsos,et al.  Joint Attention in Autonomous Driving (JAAD) , 2016, ArXiv.

[30]  Marco Gamba,et al.  BORIS: a free, versatile open‐source event‐logging software for video/audio coding and live observations , 2016 .

[31]  Fabian Kröger,et al.  Automated Driving in Its Social, Historical and Cultural Contexts , 2016 .

[32]  Nicole van Nes,et al.  The study design of UDRIVE: the naturalistic driving study across Europe for cars, trucks and scooters , 2016 .

[33]  Ingo Wolf.  The Interaction Between Humans and Autonomous Agents , 2016 .