Driver error or designer error: Using the Perceptual Cycle Model to explore the circumstances surrounding the fatal Tesla crash on 7th May 2016

Abstract “Human error” is often implicated as a causal factor in accident investigation yet very little is done to understand ‘why’ such errors occur in the first place. This paper uses the principles of Schema Theory and the Perceptual Cycle Model (PCM) to further explore the circumstances surrounding the fatal Tesla crash in May 2016 in which the driver was fatally injured using team-PCM representations. The preliminary National Highway Traffic Safety Administration accident investigation concluded that the driver of the Tesla Model S was at fault. However, the analysis presented in this paper argues that rather than “driver error”, the underlying cause of this tragic incident could be in fact more akin to a “designer error” implicating the design of the Autopilot feature itself. This is in line with the National Transportation Safety Boards more recent announcement that suggests systems design may have contributed to the crash. It would therefore appear that the drivers expectation of system functionality may not have matched the real life capabilities of the system. This is likely to be a product of inappropriate mental models relating to system function.

[1]  Raja Parasuraman,et al.  Humans and Automation: Use, Misuse, Disuse, Abuse , 1997, Hum. Factors.

[2]  N. Stanton,et al.  The explanatory power of Schema Theory: theoretical foundations and future applications in Ergonomics , 2013, Ergonomics.

[3]  M. Endsley Autonomous Driving Systems: A Preliminary Naturalistic Study of the Tesla Model S , 2017 .

[4]  N A Stanton,et al.  Using social network analysis and agent-based modelling to explore information flow using common operational pictures for maritime search and rescue operations , 2013, Ergonomics.

[5]  Neville A Stanton,et al.  Predicting pilot error: testing a new methodology and a multi-methods and analysts approach. , 2009, Applied ergonomics.

[6]  Victoria A Banks,et al.  Keep the driver in control: Automating automobiles of the future. , 2016, Applied ergonomics.

[7]  John A. Groeger Memory and Remembering: Everyday Memory in Context , 1997 .

[8]  D E Maurino,et al.  Human factors and aviation safety: what the industry has, what the industry needs. , 2000, Ergonomics.

[9]  Guy H. Walker,et al.  Trust in vehicle technology , 2016 .

[10]  R. J. B. The Child's Conception of the World , 1929, Nature.

[11]  Guy H. Walker,et al.  State-of-science: situation awareness in individuals, teams and systems , 2017, Ergonomics.

[12]  R. B. Stammers,et al.  Bartlett and the future of ergonomics , 2008, Ergonomics.

[13]  Neville A Stanton,et al.  The process of processing: exploring the validity of Neisser's perceptual cycle model with accounts from critical decision-making in the cockpit , 2015, Ergonomics.

[14]  John K. Pollard,et al.  Humans and Intelligent Vehicles: The Hope, the Help, and the Harm , 2016, IEEE Transactions on Intelligent Vehicles.

[15]  Victoria A Banks,et al.  Is partially automated driving a bad idea? Observations from an on-road study. , 2018, Applied ergonomics.

[16]  R. Happee,et al.  A human factors perspective on automated driving , 2017 .

[17]  Linden J. Ball,et al.  Internal representations, external representations and ergonomics: towards a theoretical integration , 2009 .

[18]  Raja Parasuraman,et al.  Performance Consequences of Automation-Induced 'Complacency' , 1993 .

[19]  Sidney Dekker,et al.  The Field Guide to Understanding 'Human Error' , 2014 .

[20]  James L. Szalma,et al.  A Meta-Analysis of Factors Influencing the Development of Trust in Automation , 2016, Hum. Factors.

[21]  Mark S. Young,et al.  What price ergonomics? , 1999, Nature.

[22]  J. Schooler,et al.  Vigilance impossible: Diligence, distraction, and daydreaming all lead to failures in a practical monitoring task , 2015, Consciousness and Cognition.

[23]  Neville A. Stanton,et al.  Detection of new in-path targets by drivers using Stop & Go Adaptive Cruise Control. , 2011, Applied ergonomics.

[24]  M. S. Mayzner,et al.  Cognition And Reality , 1976 .

[25]  Neville A Stanton,et al.  Exploring the psychological factors involved in the Ladbroke Grove rail accident. , 2011, Accident; analysis and prevention.

[26]  James Reason,et al.  Human Error , 1990 .

[27]  N. Mackworth In Search of Vigilance , 2013 .

[28]  Linda Ng Boyle,et al.  Safety implications of providing real-time feedback to distracted drivers. , 2007, Accident; analysis and prevention.

[29]  Joachim Meyer,et al.  Matters of Ethics, Trust, and Potential Liability for Autonomous Systems , 2016 .

[30]  D. Norman Categorization of action slips. , 1981 .

[31]  J. Mandler Stories, Scripts, and Scenes: Aspects of Schema Theory , 1984 .

[32]  Raja Parasuraman,et al.  Monitoring an Automated System for a Single Failure: Vigilance and Task Complexity Effects , 1996 .

[33]  Mark S. Young,et al.  Driving automation: Learning from aviation about design philosophies , 2007 .

[34]  A. Chapanis The Chapanis Chronicles: 50 Years of Human Factors Research, Education, and Design , 1999 .

[35]  Neville A. Stanton,et al.  Sub-systems on the road to vehicle automation: Hands and feet free but not 'mind' free driving , 2014 .

[36]  John R. Fedota,et al.  Neuroergonomics and human error , 2010 .

[37]  Nadine B. Sarter,et al.  How in the World Did We Ever Get into That Mode? Mode Error and Awareness in Supervisory Control , 1995, Hum. Factors.

[38]  F. Bartlett,et al.  Remembering: A Study in Experimental and Social Psychology , 1932 .

[39]  D. Woods,et al.  Behind Human Error , 2010 .

[40]  N. Stanton,et al.  All for one and one for all: Representing teams as a collection of individuals and an individual collective using a network perceptual cycle approach , 2014 .

[41]  Katja Kircher,et al.  Tactical Driving Behavior With Different Levels of Automation , 2014, IEEE Transactions on Intelligent Transportation Systems.

[42]  Roberta Calderwood,et al.  Critical decision method for eliciting knowledge , 1989, IEEE Trans. Syst. Man Cybern..

[43]  Guy H. Walker,et al.  Genotype and phenotype schemata and their role in distributed situation awareness in collaborative systems , 2009 .

[44]  Donald A. Norman,et al.  The Human Side of Automation , 2015 .

[45]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004 .

[46]  Erik Hollnagel,et al.  Joint Cognitive Systems: Foundations of Cognitive Systems Engineering , 2005 .

[47]  Thomas B. Sheridan Big Brother As Driver: New Demands and Problems for the Man at the Wheel1 , 1970 .

[48]  N A Stanton,et al.  Distributed situation awareness in dynamic systems: theoretical development and application of an ergonomics methodology , 2006, Ergonomics.

[49]  Neville A. Stanton,et al.  Why Did the Pilots Shut Down the Wrong Engine? Explaining Errors in Context Using Schema Theory and the Perceptual Cycle Model , 2012 .

[50]  Neville A Stanton,et al.  Cognitive compatibility of motorcyclists and car drivers. , 2011, Accident; analysis and prevention.

[51]  S. Dekker What is rational about killing a patient with an overdose? Enlightenment, continental philosophy and the role of the human subject in system failure , 2011, Ergonomics.

[52]  Neville A. Stanton,et al.  Take-Over Time in Highly Automated Vehicles , 2018, Driver Reactions to Automated Vehicles.

[53]  Neville A Stanton,et al.  Distributed situation awareness , 2016 .

[54]  Mark S. Young,et al.  A proposed psychological model of driving automation , 2000 .

[55]  S. Shladover The Truth about "Self-Driving" Cars. , 2016, Scientific American.

[56]  D. E. Embrey,et al.  SHERPA: A systematic human error reduction and prediction approach , 2013 .

[57]  Neville A Stanton,et al.  What is on your mind? Using the perceptual cycle model and critical decision method to understand the decision-making process in the cockpit , 2013, Ergonomics.

[58]  J Rasmussen,et al.  Human error and the problem of causality in analysis of accidents. , 1990, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[59]  Mark S. Young,et al.  Cooperation between drivers and automation: implications for safety , 2009 .

[60]  Mark S. Young,et al.  Drive-by-wire: The case of driver workload and reclaiming control with adaptive cruise control , 1997 .

[61]  Guy H. Walker,et al.  What really is going on? Review of situation awareness models for individuals and teams , 2008 .

[62]  Neville A. Stanton,et al.  Human error taxonomies applied to driving: A generic driver error taxonomy and its implications for intelligent transport systems , 2009 .

[63]  Neville A. Stanton,et al.  Distributed Cognition on the road: Using EAST to explore future road transportation systems. , 2018, Applied ergonomics.

[64]  N. Stanton,et al.  What could they have been thinking? How sociotechnical system design influences cognition: a case study of the Stockwell shooting , 2011, Ergonomics.

[65]  Guy H. Walker,et al.  The psychology of driving automation: a discussion with Professor Don Norman , 2007 .

[66]  John Annett,et al.  A note on the validity and reliability of ergonomics methods , 2002 .

[67]  Neville A. Stanton,et al.  From fly-by-wire to drive-by-wire: Safety implications of automation in vehicles , 1996 .

[68]  Neville A. Stanton,et al.  Takeover Time in Highly Automated Vehicles: Noncritical Transitions to and From Manual Control , 2017, Hum. Factors.

[69]  Bart van Arem,et al.  Psychological constructs in driving automation: a consensus model and critical comment on construct proliferation , 2016 .

[70]  Neville A. Stanton,et al.  Discovering Driver-vehicle Coordination Problems in Future Automated Control Systems: Evidence from Verbal Commentaries☆ , 2015 .

[71]  H. Head STUDIES IN NEUROLOGY , 1921 .

[72]  Wesley Kumfer,et al.  A Human Factors Perspective on Ethical Concerns of Vehicle Automation , 2016 .

[73]  P. Hancock,et al.  In search of vigilance: the problem of iatrogenically created psychological phenomena. , 2013, The American psychologist.

[74]  Neville A. Stanton,et al.  Analysis of driver roles: modelling the changing role of the driver in automated driving systems using EAST , 2019, Theoretical Issues in Ergonomics Science.

[75]  Neville A. Stanton,et al.  The crash at Kerang: Investigating systemic and psychological factors leading to unintentional non-compliance at rail level crossings. , 2013, Accident; analysis and prevention.