Increasing Safety by Combining Multiple Declarative Rules in Robotic Perception Systems

Advanced cyber-physical systems such as mobile, networked robots are increasingly finding use in everyday society. A critical aspect of mobile robotics is the ability to react to a dynamically changing environment, which imposes significant requirements on the robot perception system. The perception system is key to maintaining safe navigation and operation for the robot and is often considered a safety-critical aspect of the system as a whole. To allow the system to operate in a public area the perception system thus has to be certified. The key issue that we address is how to have safety-compliant systems while keeping implementation transparency high and complexity low. In this paper we present an evaluation of different methods for modelling combinations of simple explicit computer vision rules designed to increase the trustworthiness of the perception system. We utilise the best-performing method, focusing on keeping the models of the perception pipeline transparent and understandable. We find that it is possible to improve the safety of the system with some performance cost, depending on the acceptable risk level.

[1]  Robin R. Murphy,et al.  Handling Sensing Failures in Autonomous Mobile Robots , 1999, Int. J. Robotics Res..

[2]  Mark Goadrich,et al.  The relationship between Precision-Recall and ROC curves , 2006, ICML.

[3]  Ali Farhadi,et al.  Predicting Failures of Vision Systems , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Helen Gill,et al.  Cyber-Physical Systems , 2019, 2019 IEEE International Conference on Mechatronics (ICM).

[5]  Ali Farhadi,et al.  Towards Transparent Systems: Semantic Characterization of Failure Modes , 2014, ECCV.

[6]  Karsten Berns,et al.  Safe Automotive Software , 2011, KES.

[7]  Peter Liggesmeyer,et al.  Improving Safety-Critical Systems by Visual Analysis , 2011, VLUDS.

[8]  Dirk Kraft,et al.  Declarative Rule-based Safety for Robotic Perception Systems , 2017 .

[9]  Gautam Biswas,et al.  Distributed Diagnosis in Formations of Mobile Robots , 2007, IEEE Transactions on Robotics.

[10]  Kenneth A. Loparo,et al.  Verification and Validation Methodology of Real-Time Adaptive Neural Networks for Aerospace Applications , 2004 .

[11]  Yang Liu,et al.  An introduction to decision tree modeling , 2004 .

[12]  Jason Yosinski,et al.  Deep neural networks are easily fooled: High confidence predictions for unrecognizable images , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Tim Kelly,et al.  Establishing Safety Criteria for Artificial Neural Networks , 2003, KES.

[14]  Karsten Berns,et al.  On Software Quality-motivated Design of a Real-time Framework for Complex Robot Control Systems , 2013, Electron. Commun. Eur. Assoc. Softw. Sci. Technol..

[15]  Dirk Kraft,et al.  Explicit Image Quality Detection Rules for Functional Safety in Computer Vision , 2017, VISIGRAPP.

[16]  Takaya Saito,et al.  The Precision-Recall Plot Is More Informative than the ROC Plot When Evaluating Binary Classifiers on Imbalanced Datasets , 2015, PloS one.

[17]  Maryline Chetto,et al.  A concept of dynamically reconfigurable real-time vision system for autonomous mobile robotics , 2008, Int. J. Autom. Comput..

[18]  Udo Frese,et al.  Special issue on robot vision: what is robot vision? , 2015, Journal of Real-Time Image Processing.

[19]  David A. Landgrebe,et al.  A survey of decision tree classifier methodology , 1991, IEEE Trans. Syst. Man Cybern..

[20]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Stefan Hanenberg,et al.  Experience report: studying the readability of a domain specific language , 2018, SAC.

[22]  Peter Christiansen,et al.  Using Deep Learning to Challenge Safety Standard for Highly Autonomous Machines in Agriculture , 2016, J. Imaging.

[23]  Matthieu Roy,et al.  Safety Trigger Conditions for Critical Autonomous Systems , 2012, 2012 IEEE 18th Pacific Rim International Symposium on Dependable Computing.

[24]  Tim Kelly,et al.  Safety Lifecycle for Developing Safety Critical Artificial Neural Networks , 2003, SAFECOMP.

[25]  Yan Liu,et al.  Application of Neural Networks in High Assurance Systems: A Survey , 2010, Applications of Neural Networks in High Assurance Systems.

[26]  Marco Kuhrmann,et al.  On the Use of Safety Certification Practices in Autonomous Field Robot Software Development: A Systematic Mapping Study , 2015, PROFES.

[27]  Amedeo Santosuosso,et al.  Robots, market and civil liability: A European perspective , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[28]  Erica Klarreich Learning securely , 2016, Commun. ACM.

[29]  Fanny Dufossé,et al.  Specifying Safety Monitors for Autonomous Systems Using Model-Checking , 2014, SAFECOMP.