A human centric framework for the analysis of automated driving systems based on meaningful human control

ABSTRACT The future adoption of automated vehicles poses many challenges, with one of the more important being the preservation of control over vehicles that are no longer (fully) operated by drivers. There is consensus that vehicles should not perform actions that are unacceptable to humans. In this paper, we introduce the concept of Meaningful Human Control (MHC) as a function of a framework of the Automated Driving System (ADS). This framework is constructed through the core components that make up the ADS, primarily considered within the categories of the vehicle and driver. Identification of these components and the chain of control allow traceability of MHC to be performed, and aids vehicle manufacturers, software developers, other vehicle component designers, and vehicle- and driver licensing authorities to address many challenges related to the design and preservation of human control in automated vehicles. Operationalisation of MHC is discussed in the paper including a suggested approach that should aid understanding and the application of the concept. Four application examples are given and recommendations are made in regard to vehicle design, human machine interaction, transition of control, driver training, vehicle approval, and other topics. The framework and presented concept also allow researchers to identify areas to perform more explicit and relevant research and develop models that can be applied to perform projections of future impacts.

[1]  J. Rotter.  Generalized expectancies for internal versus external control of reinforcement. , 1966, Psychological monographs.

[2]  E. A. Fleishman,et al.  Development of a Taxonomy of Human Performance: Validation Study of Ability Scales for Classifying Human Tasks , 1971 .

[3]  J A Michon.  Dealing with danger , 1979 .

[4]  A. Tellegen,et al.  An alternative "description of personality": the big-five factor structure. , 1990, Journal of personality and social psychology.

[5]  D. McMillen,et al.  Alcohol, personality traits, and high risk driving: a comparison of young, drinking driver groups. , 1992, Addictive behaviors.

[6]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[7]  Joseph E LeDoux.  The Emotional Brain: The Mysterious Underpinnings of Emotional Life , 1996 .

[8]  Mustapha Mouloua,et al.  Effects of Adaptive Task Allocation on Monitoring of Automated Systems , 1996, Hum. Factors.

[9]  D. Bernstein.  Essentials of Psychology , 1998 .

[10]  D. Parker,et al.  Dimensions of driver anger, aggressive and highway code violations and their mediation by safety orientation in UK drivers , 1998 .

[11]  Alex Pentland,et al.  Modeling and Prediction of Human Behavior , 1999, Neural Computation.

[12]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[13]  J. Fischer,et al.  Review: Précis of Responsibility and Control: A Theory of Moral Responsibility , 1998 .

[14]  Sumit Ghosh.  Intelligent Transportation Systems , 2000 .

[15]  Mark S. Young,et al.  A proposed psychological model of driving automation , 2000 .

[16]  Dick de Waard,et al.  Behavioural impacts of Advanced Driver Assistance Systems - an overview. , 2001 .

[17]  R. S. Lynch,et al.  Driving anger: correlates and a test of state-trait theory , 2001 .

[18]  S Kato,et al.  A cooperative driving system with automated vehicles and inter-vehicle communications in Demo 2000 , 2001, ITSC 2001. 2001 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.01TH8585).

[19]  G. Matthews.  Towards a transactional ergonomics for driver stress and fatigue , 2002 .

[20]  Ali Emadi,et al.  Handbook of Automotive Power Electronics and Motor Drives , 2005 .

[21]  Kazuo Furuta,et al.  An inference method of team situation awareness based on mutual awareness , 2005, Cognition, Technology & Work.

[22]  Linda Ng Boyle,et al.  Driver stress as influenced by driving maneuvers and roadway conditions , 2007 .

[23]  Guy H. Walker,et al.  What really is going on? Review of situation awareness models for individuals and teams , 2008 .

[24]  John D. Lee,et al.  Driver Distraction : Theory, Effects, and Mitigation , 2008 .

[25]  Sumit Ghosh,et al.  Intelligent Transportation Systems: Smart and Green Infrastructure Design , 2010 .

[26]  Kilian G. Seeber.  Cognitive load in simultaneous interpreting: Existing theories — new models , 2011 .

[27]  E. Frazzoli,et al.  Utilizing the infrastructure to assist autonomous vehicles in a mobility on demand context , 2012, TENCON 2012 IEEE Region 10 Conference.

[28]  Scott Andrews.  Vehicular Communications Requirements and Challenges , 2012 .

[29]  Sebastian Thrun,et al.  Autonomous Driving: Context and State-of-the-Art , 2012 .

[30]  Angelos Amditis,et al.  3 Sensing and Actuation in Intelligent Vehicles , 2012 .

[31]  A. Eskanda,et al.  12 Energy and Powertrain Systems in Intelligent Automobiles , 2012 .

[32]  Samer H. Hamdar,et al.  Interrupted versus uninterrupted flow: a safety propensity index for driver behavior. , 2013, Accident; analysis and prevention.

[33]  J. Hoven.  Value Sensitive Design and Responsible Innovation , 2013 .

[34]  Klaus Bengler,et al.  Potential Individual Differences Regarding Automation Effects in Automated Driving , 2014, Interacción '14.

[35]  Marie‐Pierre Pacaux‐Lemoine.  Human–Machine Cooperation Principles to Support Life‐Critical Systems Management , 2014 .

[36]  Natasha Merat,et al.  Transition to manual: driver behaviour when resuming control from a highly automated vehicle , 2014 .

[37]  Chris Hendrickson,et al.  Potential Impacts of Vehicle Automation on Design, Infrastructure and Investment Decisions - A State DOT Perspective , 2015 .

[38]  Natasha Merat,et al.  Driver Inattention During Vehicle Automation: How Does Driver Engagement Affect Resumption Of Control? , 2015 .

[39]  K. Bengler,et al.  Vigilance Decrement and Passive Fatigue Caused by Monotony in Automated Driving , 2015 .

[40]  Markos Papageorgiou,et al.  Traffic flow optimisation in presence of vehicle automation and communication systems – Part II: Optimal control for multi-lane motorways , 2015 .

[41]  W Vlakveld,et al.  Transition of control in highly automated vehicles: a literature review , 2015 .

[42]  Bart van Arem,et al.  Psychological constructs in driving automation: a consensus model and critical comment on construct proliferation , 2016 .

[43]  Rosa Blanco,et al.  Better Together: Cooperative Technologies Will Be Vital to the Development of Highly Autonomous Vehicles Operating in Complex Urban Environments , 2016 .

[44]  Akira Ishii,et al.  Driving skill classification in curve driving scenes using machine learning , 2016, Journal of Modern Transportation.

[45]  David A. Abbink,et al.  Shared control is the sharp end of cooperation: Towards a common framework of joint action, shared control and human machine cooperation , 2016 .

[46]  Thompson Chengeta.  DEFINING THE EMERGING NOTION OF “ MEANINGFUL HUMAN CONTROL ” IN WEAPON SYSTEMS , 2017 .

[47]  Neville A. Stanton,et al.  Take-Over Time in Highly Automated Vehicles , 2018, Driver Reactions to Automated Vehicles.

[48]  Zhenji Lu,et al.  How much time do drivers need to obtain situation awareness? A laboratory-based study of automated driving. , 2017, Applied ergonomics.

[49]  Neville A. Stanton,et al.  Driving Performance After Self-Regulated Control Transitions in Highly Automated Vehicles , 2017, Hum. Factors.

[50]  Jakob Axelsson,et al.  Safety in Vehicle Platooning: A Systematic Literature Review , 2017, IEEE Transactions on Intelligent Transportation Systems.

[51]  Birgitta Thorslund,et al.  Driver behaviour and driver experience of partial and fully automated truck platooning – a simulator study , 2017 .

[52]  Marcelo H. Ang,et al.  Perception, Planning, Control, and Coordination for Autonomous Vehicles , 2017 .

[53]  J. W. C. van Lint,et al.  Will Automated Vehicles Negatively Impact Traffic Flow , 2017 .

[54]  Frederik Naujoks,et al.  Understanding and Applying the Concept of “Driver Availability” in Automated Driving , 2017 .

[55]  Jianmin Wang,et al.  Act like a Human: Teach an Autonomous Vehicle to Deal with Traffic Encounters , 2018, IHSI.

[56]  J. van den Hoven,et al.  Meaningful Human Control over Autonomous Systems: A Philosophical Account , 2018, Frontiers in robotics and AI.

[57]  S. Shaheen,et al.  Shared Automated Mobility and Public Transport , 2018 .

[58]  Jeroen van den Hoven,et al.  Meaningful Human Control over Autonomous Systems: A Philosophical Account , 2018, Front. Robot. AI.

[59]  Giulio Mecacci,et al.  Full platoon control in Truck Platooning: A Meaningful Human Control perspective , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[60]  Haneen Farah,et al.  Infrastructure for Automated and Connected Driving: State of the Art and Future Research Directions , 2018 .

[61]  B. van Arem,et al.  Evaluation and modelling of the traffic flow effects of truck platooning , 2019, Transportation Research Part C: Emerging Technologies.

[62]  Bart van Arem,et al.  Gaps in the Control of Automated Vehicles on Roads , 2020, IEEE Intelligent Transportation Systems Magazine.