Enabling quantitative analysis of situation awareness: system architecture for autonomous vehicle handover studies

A key research domain within self-driving vehicle technology is system safety. Current development efforts target Level 3 autonomy, where the vehicle controls both lateral and transversal motion of the dynamic driving task, while the driver is permitted to divert its attention, as long as s/he is able to react properly to a handover request. Situation awareness, describing the cognitive capabilities of the driver in that given instant, has become a key metric of a safe handover process. This paper proposes an experimental setup for handover studies using the CARLA driving simulator alongside the master console of the da Vinci Surgical System. This surgical master console offers a built-in display in a setup particularly suitable for the analysis of situation awareness, controllers and foot pedals. Steering wheel-like behavior of the arms was achieved using impedance control. The presented solution is open-source, and available at https://github.com/ABC-iRobotics/dvrk_carla.

[1]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation , 1984, 1984 American Control Conference.

[2]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[3]  Tamás Haidegger,et al.  Handover Process of Autonomous Vehicles – Technology and Application Challenges , 2019, Acta Polytechnica Hungarica.

[4]  Tamas Haidegger,et al.  Highly Automated Vehicles and Self-Driving Cars [Industry Tutorial] , 2018, IEEE Robotics & Automation Magazine.

[5]  J. Kuipers.  Quaternions and Rotation Sequences , 1998 .

[6]  Michael Weber,et al.  Autonomous driving: investigating the feasibility of car-driver handover assistance , 2015, AutomotiveUI.

[7]  Tamás Péter,et al.  Combined Mathematical Modeling of Different Transport Networks, Considerations and Complex Analysis , 2017 .

[8]  Imre J. Rudas,et al.  Situation Awareness and System Trust Affecting Handover Processes in Self-Driving Cars up to Level 3 Autonomy , 2019, 2019 IEEE International Work Conference on Bioinspired Intelligence (IWOBI).

[9]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[10]  Kaufui Wong,et al.  A Review of Additive Manufacturing , 2012 .

[11]  Todd Litman,et al.  Autonomous Vehicle Implementation Predictions: Implications for Transport Planning , 2015 .

[12]  Victoria A Banks,et al.  Is partially automated driving a bad idea? Observations from an on-road study. , 2018, Applied ergonomics.

[13]  Ravishankar K. Iyer,et al.  Hands Off the Wheel in Autonomous Vehicles?: A Systems Perspective on over a Million Miles of Field Data , 2018, 2018 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN).

[14]  Victoria A. Banks,et al.  Driver error or designer error: Using the Perceptual Cycle Model to explore the circumstances surrounding the fatal Tesla crash on 7th May 2016 , 2017, Safety Science.

[15]  David D. Ward,et al.  ISO 26262 safety cases: Compliance and assurance , 2011 .

[16]  Peter Kazanzides,et al.  An open-source research kit for the da Vinci® Surgical System , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Guy H. Walker,et al.  Measuring Situation Awareness in complex systems: Comparison of measures study , 2009 .

[18]  Mica R. Endsley,et al.  Situation awareness global assessment technique (SAGAT) , 1988, Proceedings of the IEEE 1988 National Aerospace and Electronics Conference.

[19]  Alessandro D’Ausilio,et al.  Arduino: A low-cost multipurpose lab equipment , 2011, Behavior Research Methods.

[20]  David B. Kaber,et al.  The effects of level of automation and adaptive automation on human performance, situation awareness and workload in a dynamic control task , 2004 .

[21]  Graham. Parkhurst,et al.  Handover issues in autonomous driving: A literature review , 2016 .

[22]  Imre J. Rudas,et al.  Origins of surgical robotics: From space to the operating room , 2016 .

[23]  Imre J. Rudas,et al.  Assessment and Standardization of Autonomous Vehicles , 2018, 2018 IEEE 22nd International Conference on Intelligent Engineering Systems (INES).

[24]  Peter Kazanzides,et al.  FPGA-Based Velocity Estimation for Control of Robots with Low-Resolution Encoders , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[25]  Germán Ros,et al.  CARLA: An Open Urban Driving Simulator , 2017, CoRL.

[26]  Saeid Nahavandi,et al.  Towards trusted autonomous vehicles from vulnerable road users perspective , 2017, 2017 Annual IEEE International Systems Conference (SysCon).

[27]  Peter Kazanzides,et al.  Software Architecture of the Da Vinci Research Kit , 2017, 2017 First IEEE International Conference on Robotic Computing (IRC).