A Conceptual Control System Description of Cooperative and Automated Driving in Mixed Urban Traffic With Meaningful Human Control for Design and Evaluation

The introduction of automated vehicles means that some or all operational control over these vehicles is diverted away from a human driver to a technological system. The concept of Meaningful Human Control (MHC) was derived to address control issues over automated systems, allowing a system to explicitly consider human intentions and reasons. Applying MHC to technological systems, such as automated driving is a real challenge, and the main focus of this article. An approach with mathematical elaboration has been developed that offers a first quantifiable operationalisation of MHC for the traffic domain and for use with automated vehicles. A major contribution lies in the taxonomification of control for MHC in the broader traffic environment, including consideration of the driver, the vehicle, the traffic environment, considering behaviour, moral standards and societal values, which are considered in a case study. The demonstration case shows the validity of the developed approach for an automated vehicle overtaking a cyclist on an urban street. This article is one of the first to operationalise MHC to such a level of detail and opens the door to further development of the concept for technological implementation.

[1]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[2]  Bruno Siciliano,et al.  Autonomy in surgical robots and its meaningful human control , 2019, Paladyn J. Behav. Robotics.

[3]  Thompson Chengeta.  DEFINING THE EMERGING NOTION OF “ MEANINGFUL HUMAN CONTROL ” IN WEAPON SYSTEMS , 2017 .

[4]  Samyeul Noh,et al.  Decision-Making Framework for Automated Driving in Highway Environments , 2018, IEEE Transactions on Intelligent Transportation Systems.

[5]  Sven Beiker,et al.  Road Vehicle Automation 4 , 2015 .

[6]  Andreas Theodorou,et al.  Towards ethical and socio-legal governance in AI , 2020, Nature Machine Intelligence.

[7]  J. Hoven.  Value Sensitive Design and Responsible Innovation , 2013 .

[8]  Giuseppe Contissa,et al.  The Ethical Knob: ethically-customisable automated vehicles and the law , 2017, Artificial Intelligence and Law.

[9]  Andreas Theodorou,et al.  Robot transparency, trust and utility , 2016, Connect. Sci..

[10]  Sven Nyholm,et al.  The Ethics of Accident-Algorithms for Self-Driving Cars: an Applied Trolley Problem? , 2016, Ethical Theory and Moral Practice.

[11]  Ondřej Přibyl,et al.  Automated vehicles in smart urban environment: A review , 2017, 2017 Smart City Symposium Prague (SCSP).

[12]  Francesco Biondi,et al.  Human–Vehicle Cooperation in Automated Driving: A Multidisciplinary Review and Appraisal , 2019, Int. J. Hum. Comput. Interact..

[13]  Jilles Smids,et al.  Automated cars meet human drivers: responsible human-robot coordination and the ethics of mixed traffic , 2018, Ethics and Information Technology.

[14]  Jakob Axelsson,et al.  Safety in Vehicle Platooning: A Systematic Literature Review , 2017, IEEE Transactions on Intelligent Transportation Systems.

[15]  S. D. Sio.  Meaningful human control as reason-responsiveness: the case of dual-mode vehicles , 2019 .

[16]  Penny Duquenoy,et al.  The Information Society: Innovation, Legitimacy, Ethics and Democracy In honor of Professor Jacques Berleur s.j. - Proceedings of the Conference "Information Society: Governance, Ethics and Social Consequences", University of Namur, Belgium 22-23 May 2006 , 2007, The Information Society.

[17]  F. Santoni De Sio,et al.  Ethics and Self-driving Cars: A White Paper on Responsible Innovation in Automated Driving Systems , 2016 .

[18]  Alan Borning,et al.  Value Sensitive Design and Information Systems , 2020, The Ethics of Information Technologies.

[19]  Stephen M. Casner,et al.  The challenges of partially automated driving , 2016, Commun. ACM.

[20]  Jeroen van den Hoven,et al.  ICT and Value Sensitive Design , 2006, The Information Society.

[21]  J. Bryson,et al.  How Society Can Maintain Human-Centric Artificial Intelligence , 2019, Translational Systems Sciences.

[22]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[23]  Jeroen van den Hoven,et al.  Meaningful Human Control over Autonomous Systems: A Philosophical Account , 2018, Front. Robot. AI.

[24]  Marjan P. Hagenzieker,et al.  Interactions between cyclists and automated vehicles: Results of a photo experiment* , 2019, Journal of Transportation Safety & Security.

[25]  Haneen Farah,et al.  Interactions between vulnerable road users and automated vehicles: A synthesis of literature and framework for future research , 2017 .

[26]  Patrick Lin.  Why Ethics Matters for Autonomous Cars , 2016 .

[27]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[28]  Bart van Arem,et al.  A human centric framework for the analysis of automated driving systems based on meaningful human control , 2019, Theoretical Issues in Ergonomics Science.

[29]  Bart van Arem,et al.  Human behaviour with automated driving systems: a quantitative framework for meaningful human control , 2019, Theoretical Issues in Ergonomics Science.

[30]  Artificial intelligence: From ethics to policy , 2020 .

[31]  Bart van Arem,et al.  Gaps in the Control of Automated Vehicles on Roads , 2020, IEEE Intelligent Transportation Systems Magazine.

[32]  Francesco Borrelli,et al.  Control of Connected and Automated Vehicles: State of the Art and Future Challenges , 2018, Annu. Rev. Control..

[33]  John A. Michon,et al.  A critical view of driver behavior models: What do we know , 1985 .

[34]  W. Marsden.  I and J , 2012 .

[35]  David A. Abbink,et al.  Shared control is the sharp end of cooperation: Towards a common framework of joint action, shared control and human machine cooperation , 2016 .