Systems-Theoretic Safety Assessment of Teleoperated Road Vehicles

Teleoperation is becoming an essential feature in automated vehicle concepts, as it will help the industry overcome challenges facing automated vehicles today. Teleoperation follows the idea to get humans back into the loop for certain rare situations the automated vehicle cannot resolve. Teleoperation therefore has the potential to expand the operational design domain and increase the availability of automated vehicles. This is especially relevant for concepts with no backup driver inside the vehicle. While teleoperation resolves certain issues an automated vehicle will face, it introduces new challenges in terms of safety requirements. While safety and regulatory approval is a major research topic in the area of automated vehicles, it is rarely discussed in the context of teleoperated road vehicles. The focus of this paper is to systematically analyze the potential hazards of teleoperation systems. An appropriate hazard analysis method (STPA) is chosen from literature and applied to the system at hand. The hazard analysis is an essential part in developing a safety concept (e.g., according to ISO26262) and thus far has not been discussed for teleoperated road vehicles.

[1]  Markus Lienkamp,et al.  Human-machine interaction as key technology for driverless driving - A trajectory-based shared autonomy control approach , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[2]  Frederic Emanuel Chucholowski.  Evaluation of Display Methods for Teleoperation of Road Vehicles , 2016 .

[3]  S Stefan Lichiardopol,et al.  A Survey on Teleoperation , 2007 .

[4]  Frank Diermeyer,et al.  An Adaptable and Immersive Real Time Interface for Resolving System Limitations of Automated Vehicles with Teleoperation , 2019, 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC).

[5]  Martin Höst,et al.  Hazard analysis of collision avoidance system using STPA , 2014, ISCRAM.

[6]  Azra Habibovic,et al.  A Head-Mounted Display to Support Teleoperations of Shared Automated Vehicles , 2017, International Conference on Automotive User Interfaces and Interactive Vehicular Applications.

[7]  Kaleb McDowell,et al.  The Effects of Time Lag on Driving Performance and a Possible Mitigation , 2010, IEEE Transactions on Robotics.

[8]  John Thomas,et al.  Integration of Multiple Active Safety Systems using STPA , 2015 .

[9]  Nancy G. Leveson,et al.  Engineering a Safer World: Systems Thinking Applied to Safety , 2012 .

[10]  Morayo Adedjouma,et al.  Using STPA in an ISO 26262 Compliant Process , 2016, SAFECOMP.

[11]  Jens Rasmussen,et al.  Skills, rules, and knowledge; signals, signs, and symbols, and other distinctions in human performance models , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[12]  Naveen Mohan,et al.  Applying systems-theoretic process analysis in the context of cooperative driving , 2016, 2016 11th IEEE Symposium on Industrial Embedded Systems (SIES).

[13]  James L. Adams.  AN INVESTIGATION OF THE EFFECTS OF THE TIME LAG DUE TO LONG TRANSMISSION DISTANCES UPON REMOTE CONTROL. PHASE II - VEHICLE EXPERIMENTS. PHASE III - CONCLUSIONS. , 1961 .

[14]  Markus Lienkamp,et al.  A System Design for Teleoperated Road Vehicles , 2013, ICINCO.

[15]  Markus Lienkamp,et al.  Predictive Haptic Feedback for Safe Lateral Control of Teleoperated Road Vehicles in Urban Areas , 2016, 2016 IEEE 83rd Vehicular Technology Conference (VTC Spring).

[16]  荒木孝昌,et al.  Head-mounted display , 2015 .

[17]  Markus Maurer,et al.  Safety Analysis Based on Systems Theory Applied to an Unmanned Protective Vehicle , 2017 .

[18]  E. Donges.  ASPEKTE DER AKTIVEN SICHERHEIT BEI DER FUEHRUNG VON PERSONENKRAFTWAGEN , 1982 .

[19]  Liviu Iftode,et al.  Investigating Remote Driving over the LTE Network , 2017, AutomotiveUI.

[20]  Hagen Böhmert,et al.  Missing no Interaction—Using STPA for Identifying Hazardous Interactions of Automated Driving Systems , 2018 .

[21]  Markus Lienkamp,et al.  Enhancing telepresence during the teleoperation of road vehicles using HMD-based mixed reality , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[22]  Charles E. Thorpe,et al.  Collaborative control: a robot-centric model for vehicle teleoperation , 2001 .

[23]  Frank Diermeyer,et al.  Longtime Effects of Videoquality, Videocanvases and Displays on Situation Awareness during Teleoperation of Automated Vehicles* , 2020, 2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[24]  Frank Diermeyer,et al.  Steer with Me: A Predictive, Potential Field-Based Control Approach for Semi-Autonomous, Teleoperated Road Vehicles , 2020, 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC).

[25]  Simon Hoffmann,et al.  Concept of a Control Center for an Automated Vehicle Fleet , 2020, 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC).

[26]  John P. Thomas,et al.  Extending and automating a systems-theoretic hazard analysis for requirements generation and analysis , 2013 .

[27]  Edmund Donges,et al.  Driver Behavior Models , 2015 .

[28]  Markus Lienkamp,et al.  Teleoperated Road Vehicles – The "Free Corridor" as a Safety Strategy Approach , 2014 .

[29]  William R. Ferrell,et al.  Remote manipulation with transmission delay. , 1965 .

[30]  Markus Lienkamp,et al.  Teleoperated Driving, a Key Technology for Automated Driving? Comparison of Actual Test Drives with a Head Mounted Display and Conventional Monitors* , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[31]  Markus Lienkamp,et al.  Interactive path planning for teleoperated road vehicles in urban environments , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[32]  Thomas B. Sheridan,et al.  Remote Manipulative Control with Transmission Delay , 1963 .

[33]  Ryosuke Abe.  Introducing autonomous buses and taxis: Quantifying the potential benefits in Japanese transportation systems , 2019, Transportation Research Part A: Policy and Practice.

[34]  Michel Parent,et al.  Computer-aided teleoperation of an urban vehicle , 1997, 1997 8th International Conference on Advanced Robotics. Proceedings. ICAR'97.

[35]  Dajiang Suo,et al.  Integrating STPA into ISO 26262 Process for Requirement Development , 2017 .

[36]  Uwe Becker,et al.  On Functional Safety of Vehicle Actuation Systems in the Context of Automated Driving , 2016 .

[37]  Nancy G. Leveson,et al.  An Integrated Approach to Requirements Development and Hazard Analysis , 2015 .

[38]  Heiner Bubb.  Fahrerassistenz - primär ein Beitrag zum Komfort oder für die Sicherheit? , 2003 .

[39]  Simon Hoffmann,et al.  Sensor and Actuator Latency during Teleoperation of Automated Vehicles , 2020, 2020 IEEE Intelligent Vehicles Symposium (IV).