Towards Inclusive External Communication of Autonomous Vehicles for Pedestrians with Vision Impairments

People with vision impairments (VIP) are among the most vulnerable road users in traffic. Autonomous vehicles are believed to reduce accidents but still demand some form of external communication signaling relevant information to pedestrians. Recent research on the design of vehicle-pedestrian communication (VPC) focuses strongly on concepts for a non-disabled population. Our work presents an inclusive user-centered design for VPC, beneficial for both vision impaired and seeing pedestrians. We conducted a workshop with VIP (N=6), discussing current issues in road traffic and comparing communication concepts proposed by literature. A thematic analysis unveiled two important themes: number of communicating vehicles and content (affecting duration). Subsequently, we investigated these in a second user study in virtual reality (N=33, 8 VIP) comparing the VPC between groups of abilities. We found that trust and understanding is enhanced and cognitive load reduced when all relevant vehicles communicate; high content messages also reduce cognitive load.

[1]  Sowmya Somanath,et al.  AV-Pedestrian Interaction Design Using a Pedestrian Mixed Traffic Simulator , 2019, Conference on Designing Interactive Systems.

[2]  Denis Lalanne,et al.  Pedestrians and Visual Signs of Intent , 2019, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[3]  Klaus Bengler,et al.  External HMIs and Their Effect on the Interaction Between Pedestrians and Automated Vehicles , 2018, IHSI.

[4]  Muztaba Fuad,et al.  Comparison of Child and Adult Pedestrian Perspectives of External Features on Autonomous Vehicles Using Virtual Reality Experiment , 2019, AHFE.

[5]  Alex S. Taylor,et al.  "I can do everything but see!" -- How People with Vision Impairments Negotiate their Abilities in Social Contexts , 2018, CHI.

[6]  Lawrence D. Rosenblum,et al.  Are hybrid cars too quiet , 2009 .

[7]  Shuchisnigdha Deb,et al.  Pedestrian Perception of Autonomous Vehicles with External Interacting Features , 2018, Advances in Intelligent Systems and Computing.

[8]  Berry Eggen,et al.  The Impact of Vehicle Appearance and Vehicle Behavior on Pedestrian Interaction with Autonomous Vehicles , 2017, AutomotiveUI.

[9]  Takeo Igarashi,et al.  Adjunct Proceedings of the 10th International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications , 2018 .

[10]  Tobias Lagström,et al.  AVIP - Autonomous vehicles' interaction with pedestrians - An investigation of pedestrian-driver communication and development of a vehicle external interface , 2016 .

[11]  Joost C. F. de Winter,et al.  Survey on eHMI concepts: The effect of text, color, and perspective , 2019, Transportation Research Part F: Traffic Psychology and Behaviour.

[12]  Alireza Talebpour,et al.  Influence of connected and autonomous vehicles on traffic flow stability and throughput , 2016 .

[13]  Jonas Andersson,et al.  Designing for social experiences with and within autonomous vehicles – exploring methodological directions , 2018, Design Science.

[14]  Florence March,et al.  2016 , 2016, Affair of the Heart.

[15]  Shirin E Hassan,et al.  Are normally sighted, visually impaired, and blind pedestrians accurate and reliable at making street crossing decisions? , 2012, Investigative ophthalmology & visual science.

[16]  Jelte E Bos,et al.  Motion sickness symptoms in a ship motion simulator: effects of inside, outside, and no view. , 2005, Aviation, space, and environmental medicine.

[17]  Raphael Zimmermann,et al.  First Step into Visceral Interaction with Autonomous Vehicles , 2017, AutomotiveUI.

[18]  Chao Wang,et al.  Interface Concepts for Intent Communication from Autonomous Vehicles to Vulnerable Road Users , 2018, AutomotiveUI.

[19]  Natasha Merat,et al.  What externally presented information do VRUs require when interacting with fully Automated Road Transport Systems in shared space? , 2018, Accident; analysis and prevention.

[20]  Daniel W. Carruth,et al.  Investigating pedestrian suggestions for external features on fully autonomous vehicles: A virtual reality experiment , 2018, Transportation Research Part F: Traffic Psychology and Behaviour.

[21]  Sowmya Somanath,et al.  Communicating Awareness and Intent in Autonomous Vehicle-Pedestrian Interaction , 2018, CHI.

[22]  Daniel J. Fagnant,et al.  Preparing a Nation for Autonomous Vehicles: Opportunities, Barriers and Policy Recommendations , 2015 .

[23]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[24]  Athanasios Koutsoklenis,et al.  Olfactory Cues Used for Wayfinding in Urban Environments by Individuals with Visual Impairments , 2011 .

[25]  John K. Tsotsos,et al.  Understanding Pedestrian Behavior in Complex Traffic Scenes , 2018, IEEE Transactions on Intelligent Vehicles.

[26]  Santosha K. Dwivedy,et al.  Advancements in the field of autonomous underwater vehicle , 2019, Ocean Engineering.

[27]  Manfred Tscheligi,et al.  Three Strategies for Autonomous Car-to-Pedestrian Communication: A Survival Guide , 2017, HRI.

[28]  Frederick Lippman,et al.  Blindness and vision impairment , 2008 .

[29]  Andreas Riener,et al.  How Should Automated Vehicles Interact with Pedestrians?: A Comparative Analysis of Interaction Concepts in Virtual Reality , 2019, AutomotiveUI.

[30]  Jonas Andersson,et al.  Children's Views on Identification and Intention Communication of Self-driving Vehicles , 2017, IDC.

[31]  Hassan A. Karimi,et al.  Context-aware obstacle detection for navigation by visually impaired , 2017, Image Vis. Comput..

[32]  Amy Hurst,et al.  "just let the cane hit it": how the blind and sighted see navigation differently , 2014, ASSETS.

[33]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[34]  Enrico Tronci.  1997 , 1997, Les 25 ans de l’OMC: Une rétrospective en photos.

[35]  Edgar Brunner,et al.  Nonparametric analysis of longitudinal data in factorial experiments , 2012 .

[36]  C. Routledge,et al.  What makes life meaningful for theists and atheists? , 2019 .

[37]  John van der Kamp,et al.  Visual timing and adaptive behavior in a road-crossing simulation study. , 2005, Accident; analysis and prevention.

[38]  Moritz Körber,et al.  Theoretical Considerations and Development of a Questionnaire to Measure Trust in Automation , 2018, Advances in Intelligent Systems and Computing.

[39]  Azra Habibovic,et al.  SAV2P: Exploring the Impact of an Interface for Shared Automated Vehicles on Pedestrians' Experience , 2017, AutomotiveUI.

[40]  Krzysztof Z. Gajos,et al.  Ability-Based Design: Concept, Principles and Examples , 2011, TACC.

[41]  Ingunn Moser.  ON BECOMING DISABLED AND ARTICULATING ALTERNATIVES , 2005 .

[42]  Michael P. Clamann,et al.  Evaluation of Vehicle-to-Pedestrian Communication Displays for Autonomous Vehicles , 2017 .

[43]  Takeo Igarashi,et al.  Eyes on a Car: an Interface Design for Communication between an Autonomous Car and a Pedestrian , 2017, AutomotiveUI.

[44]  Robert Gray,et al.  A Comparison of Tactile, Visual, and Auditory Warnings for Rear-End Collision Prevention in Simulated Driving , 2008, Hum. Factors.

[45]  Sarah Schmidt,et al.  Pedestrians at the kerb – Recognising the action intentions of humans , 2009 .

[46]  Abdelsalam Helal,et al.  RFID information grid for blind navigation and wayfinding , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[47]  Jacob O. Wobbrock,et al.  In the shadow of misperception: assistive technology use and social interactions , 2011, CHI.

[48]  Ann Blandford,et al.  Confessions from a grounded theory PhD: experiences and lessons learnt , 2011, CHI.

[49]  John A. Albertini,et al.  Deafness and Hearing Loss , 2010 .

[50]  G. Edwards,et al.  Understanding Risk in Daily Life of Diverse Persons with Physical and Sensory Impairments , 2019 .

[51]  Paul E. Ponchillia,et al.  Street crossing by sighted and blind pedestrians at a modern roundabout , 2005 .

[52]  Erin Brady,et al.  Interdependence as a Frame for Assistive Technology Research and Design , 2018, ASSETS.

[53]  Peter Thomas,et al.  Pedestrian Decision-Making Responses to External Human-Machine Interface Designs for Autonomous Vehicles , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[54]  James M. Coughlan,et al.  Crosswatch: A Camera Phone System for Orienting Visually Impaired Pedestrians at Traffic Intersections , 2008, ICCHP.

[55]  Girish Chowdhary,et al.  Intent Communication between Autonomous Vehicles and Pedestrians , 2017, ArXiv.

[56]  Paul Ralph,et al.  Grounded Theory in Software Engineering Research: A Critical Review and Guidelines , 2016, 2016 IEEE/ACM 38th International Conference on Software Engineering (ICSE).

[57]  Riender Happee,et al.  External Human-Machine Interfaces on Automated Vehicles: Effects on Pedestrian Crossing Decisions , 2019, Hum. Factors.

[58]  Jean Toner.  Small is not too Small , 2009 .

[59]  Mark Colley,et al.  For a better (simulated) world: considerations for VR in external communication research , 2019, AutomotiveUI.

[60]  Shaun K. Kane,et al.  The Invisible Work of Accessibility: How Blind Employees Manage Accessibility in Mixed-Ability Workplaces , 2015, ASSETS.

[61]  Alex Fridman,et al.  To Walk or Not to Walk: Crowdsourced Assessment of External Vehicle-to-Pedestrian Displays , 2017, ArXiv.

[62]  Abdelsalam Helal,et al.  Drishti: an integrated navigation system for visually impaired and disabled , 2001, Proceedings Fifth International Symposium on Wearable Computers.

[63]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[64]  K. Naghshineh,et al.  The Use of Traffic Sounds to Make Street Crossings by Persons who are Visually Impaired , 1997 .

[65]  Johnny Saldaña,et al.  The Coding Manual for Qualitative Researchers , 2009 .

[66]  Gretchen A. Stevens,et al.  Magnitude, temporal trends, and projections of the global prevalence of blindness and distance and near vision impairment: a systematic review and meta-analysis. , 2017, The Lancet. Global health.

[67]  Paulo Henrique Trombetta Zannin,et al.  Evaluation of noise pollution in urban traffic hubs—Noise maps and measurements , 2015 .

[68]  John K. Tsotsos,et al.  Autonomous Vehicles That Interact With Pedestrians: A Survey of Theory and Practice , 2018, IEEE Transactions on Intelligent Transportation Systems.

[69]  Matthias Beggiato,et al.  An experimental study to investigate design and assessment criteria: What is important for communication between pedestrians and automated vehicles? , 2019, Applied ergonomics.

[70]  Melissa Cefkin,et al.  Evaluation of an Autonomous Vehicle External Communication System Concept: A Survey Study , 2017 .

[71]  Annette Werner,et al.  New Colours for Autonomous Driving: An Evaluation of Chromaticities for the External Lighting Equipment of Autonomous Vehicles , 2018 .

[72]  Jacques M. B. Terken,et al.  Pedestrian Interaction with Vehicles: Roles of Explicit and Implicit Communication , 2017, AutomotiveUI.

[73]  Amy Hurst,et al.  "Pray before you step out": describing personal and situational blind navigation behaviors , 2013, ASSETS.

[74]  Robin Brewer,et al.  Understanding the Power of Control in Autonomous Vehicles for People with Vision Impairment , 2018, ASSETS.

[75]  Cristina Olaverri-Monreal,et al.  P2V and V2P communication for Pedestrian warning on the basis of Autonomous Vehicles , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[76]  Yahui Wang,et al.  To Cross or Not to Cross: Urgency-Based External Warning Displays on Autonomous Vehicles to Improve Pedestrian Crossing Safety , 2018, AutomotiveUI.

[77]  Peter Gregor,et al.  “User sensitive inclusive design”— in search of a new paradigm , 2000, CUU '00.

[78]  Daniel Hepperle,et al.  Hybrid City Lighting - Improving Pedestrians' Safety through Proactive Street Lighting , 2015, 2015 International Conference on Cyberworlds (CW).

[79]  Jonas Schmidtler,et al.  Passing through the Bottleneck - The Potential of External Human-Machine Interfaces , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[80]  Meredith Ringel Morris,et al.  Closing the Gap: Designing for the Last-Few-Meters Wayfinding Problem for People with Visual Impairments , 2019, ASSETS.

[81]  Meredith Ringel Morris,et al.  Enabling People with Visual Impairments to Navigate Virtual Reality with a Haptic and Auditory Cane Simulation , 2018, CHI.

[82]  Gerd Bruder,et al.  Estimation of Detection Thresholds for Redirected Walking Techniques , 2010, IEEE Transactions on Visualization and Computer Graphics.

[83]  Rikard Fredriksson,et al.  Will There Be New Communication Needs When Introducing Automated Vehicles to the Urban Context , 2017 .

[84]  Marcelo H. Ang,et al.  Pedestrian Notification Methods in Autonomous Vehicles for Multi-Class Mobility-on-Demand Service , 2016, HAI.