Autonomous Vehicles with Visual Signals for Pedestrians: Experiments and Design Recommendations

Autonomous Vehicles (AV) will transform transportation, but also the interaction between vehicles and pedestrians. In the absence of a driver, it is not clear how an AV can communicate its intention to pedestrians. One option is to use visual signals. To advance their design, we conduct four human-participant experiments and evaluate six representative AV visual signals for visibility, intuitiveness, persuasiveness, and usability at pedestrian crossings. Based on the results, we distill twelve practical design recommendations for AV visual signals, with focus on signal pattern design and placement. Moreover, the paper advances the methodology for experimental evaluation of visual signals, including lab, closed-course, and public road tests using an autonomous vehicle. In addition, the paper also reports insights on pedestrian crosswalk behaviours and the impacts of pedestrian trust towards AVs on the behaviors. We hope that this work will constitute valuable input to the ongoing development of international standards for AV lamps, and thus help mature automated driving in general.

[1]  J. Kerridge,et al.  Human Movement Behaviour in Urban Spaces: Implications for the Design and Modelling of Effective Pedestrian Environments , 2004 .

[2]  Rikard Fredriksson,et al.  Will There Be New Communication Needs When Introducing Automated Vehicles to the Urban Context , 2017 .

[3]  John Cohen,et al.  The Risk Taken in Crossing a Road , 1955 .

[4]  Matúš Šucha,et al.  Road users’ strategies and communication: driver-pedestrian interaction , 2014 .

[5]  Wendy Ju,et al.  Ghost driver: A field study investigating the interaction between pedestrians and driverless vehicles , 2016, 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[6]  Jin Zhu,et al.  Architecture Design and Implementation of an Autonomous Vehicle , 2018, IEEE Access.

[7]  Nicolas Guéguen,et al.  A pedestrian’s stare and drivers’ stopping behavior: A field experiment at the pedestrian crossing , 2015 .

[8]  Jacques M. B. Terken,et al.  Pedestrian Interaction with Vehicles: Roles of Explicit and Implicit Communication , 2017, AutomotiveUI.

[9]  J. D. Mollon,et al.  Vision out of the corner of the eye , 2011, Vision Research.

[10]  W. A. Harrell,et al.  Gap Acceptance by Pedestrians , 1992 .

[11]  K. Moutoussis,et al.  Functional segregation and temporal hierarchy of the visual perceptive systems , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[12]  Nicholas Pennycooke AEVITA : designing biomimetic vehicle-to-pedestrian communication protocols for autonomously operating & parking on-road electric vehicles , 2012 .

[13]  T. Levine,et al.  Eta Squared, Partial Eta Squared, and Misreporting of Effect Size in Communication Research , 2002 .

[14]  Katherine M. Tsui,et al.  Trust in AV: An Uncertainty Reduction Model of AV-Pedestrian Interactions , 2018, HRI.

[15]  I. Rentschler,et al.  Peripheral vision and pattern recognition: a review. , 2011, Journal of vision.

[16]  Ralf Risser,et al.  Pedestrian-driver communication and decision strategies at marked crossings. , 2017, Accident; analysis and prevention.

[17]  W. Andrew Harrell,et al.  Factors influencing pedestrian cautiousness in crossing streets , 1991 .

[18]  Sowmya Somanath,et al.  Communicating Awareness and Intent in Autonomous Vehicle-Pedestrian Interaction , 2018, CHI.

[19]  Tobias Lagström,et al.  AVIP - Autonomous vehicles' interaction with pedestrians - An investigation of pedestrian-driver communication and development of a vehicle external interface , 2016 .

[20]  Stefanie M. Faas,et al.  Yielding Light Signal Evaluation for Self-driving Vehicle and Pedestrian Interaction , 2019, IHSED.

[21]  Aurélie Dommes,et al.  The role of perceptual, cognitive, and motor abilities in street‐crossing decisions of young and older pedestrians , 2011, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[22]  R. L. Moore Pedestrian Choice and Judgment , 1953 .

[23]  Malte Risto,et al.  Human-Vehicle Interfaces: The Power of Vehicle Movement Gestures in Human Road User Coordination , 2017 .

[24]  Kerstin Dautenhahn,et al.  Getting to know Pepper: Effects of people's awareness of a robot's capabilities on their trust in the robot , 2018, HAI.

[25]  A. Tom,et al.  Gender differences in pedestrian rule compliance and visual search at signalized and unsignalized crossroads. , 2011, Accident; analysis and prevention.

[26]  Peter Boyce,et al.  Automotive Lighting and Human Vision , 2007 .

[27]  Aolei Yang,et al.  Survey of Indoor Positioning Technologies and Systems , 2014 .

[28]  Natasha Merat,et al.  Filtration analysis of pedestrian-vehicle interactions for autonomous vehicle control , 2018 .

[29]  John K. Tsotsos,et al.  Autonomous Vehicles That Interact With Pedestrians: A Survey of Theory and Practice , 2018, IEEE Transactions on Intelligent Transportation Systems.

[30]  Michael P. Clamann,et al.  Evaluation of Vehicle-to-Pedestrian Communication Displays for Autonomous Vehicles , 2017 .

[31]  Jonas Andersson,et al.  Evaluating interactions with non-existing automated vehicles: three Wizard of Oz approaches , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[32]  D. Yagil Beliefs, motives and situational factors related to pedestrians' self-reported behavior at signal-controlled crossings , 2000 .

[33]  Angelos Amditis,et al.  Naturalistic Observation of Interactions Between Car Drivers and Pedestrians in High Density Urban Settings , 2018, Advances in Intelligent Systems and Computing.

[34]  Stephen M. Casner,et al.  The challenges of partially automated driving , 2016, Commun. ACM.

[35]  I. Hyman,et al.  Did you see the unicycling clown? Inattentional blindness while walking and talking on a cell phone , 2009 .

[36]  L Ellis King,et al.  PEDESTRIAN GAP-ACCEPTANCE , 1970 .

[37]  W A Harrell,et al.  Precautionary Street Crossing by Elderly Pedestrians , 1991, International journal of aging & human development.

[38]  Patrizia Marti,et al.  Perceiving While Being Perceived , 2022 .

[39]  Kenneth R. Agent,et al.  TRAFFIC ACCIDENT INVESTIGATION , 1993 .

[40]  晓天 渐入费解 Mercedes-Benz F015 Luxury in Motion , 2015 .

[41]  Tanja Fuest,et al.  Crossing the Street Across the Globe: A Study on the Effects of eHMI on Pedestrians in the US, Germany and China , 2019, HCI.

[42]  Feng Jiang,et al.  Pedestrian behavior analysis using 110-car naturalistic driving data in USA , 2013 .

[43]  R. R. Blake,et al.  Status factors in pedestrain violation of traffic signals. , 1955, Journal of abnormal psychology.

[44]  Gill,et al.  Automated vehicles: the coming of the next disruptive technology , 2015 .

[45]  Kerstin Dautenhahn,et al.  Would You Trust a (Faulty) Robot? Effects of Error, Task Type and Personality on Human-Robot Cooperation and Trust , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[46]  Wuhong Wang,et al.  Analysis of the Influence of Pedestrians’ eye Contact on Drivers’ Comfort Boundary During the Crossing Conflict , 2016 .

[47]  Kin K. Leung,et al.  A Survey of Indoor Localization Systems and Technologies , 2017, IEEE Communications Surveys & Tutorials.

[48]  Sarah Schmidt,et al.  Pedestrians at the kerb – Recognising the action intentions of humans , 2009 .

[49]  Erik Poll,et al.  A Standard Driven Software Architecture for Fully Autonomous Vehicles , 2018, 2018 IEEE International Conference on Software Architecture Companion (ICSA-C).

[50]  Carol Holland,et al.  The effect of age, gender and driver status on pedestrians' intentions to cross the road in risky situations. , 2007, Accident; analysis and prevention.