Declarative Rule-based Safety for Robotic Perception Systems

Mobile robots are used across many domains from personal care to agriculture. Working in dynamic open-ended environments puts high constraints on the robot perception system, which is critical for the safety of the system as a whole. To achieve the required safety levels the perception system needs to be certified, but no specific standards exist for computer vision systems, and the concept of safe vision systems remains largely unexplored. In this paper we present a novel domain-specific language that allows the programmer to express image quality detection rules for enforcing safety constraints. The language allows developers to increase trustworthiness in the robot perception system, which we argue would increase compliance with safety standards. We demonstrate the usage of the language to improve reliability in a perception pipeline and evaluate it against manually written rules on embedded hardware. The language allows the vision expert to concisely express the safety-related constraints and thereby bridging the gap between domain experts and certification authorities.

[1]  Dirk Kraft,et al.  Explicit Image Quality Detection Rules for Functional Safety in Computer Vision , 2017, VISIGRAPP.

[2]  Rong Wang,et al.  Learning models for predicting recognition performance , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[3]  Yongdae Kim,et al.  Rocking Drones with Intentional Sound Noise on Gyroscopic Sensors , 2015, USENIX Security Symposium.

[4]  Georgios C. Anagnostopoulos,et al.  Knowledge-Based Intelligent Information and Engineering Systems , 2003, Lecture Notes in Computer Science.

[5]  Alessandro De Luca,et al.  Collision detection and reaction: A contribution to safe physical Human-Robot Interaction , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Carl E. Landwehr,et al.  Basic concepts and taxonomy of dependable and secure computing , 2004, IEEE Transactions on Dependable and Secure Computing.

[7]  Jonathan Petit,et al.  Remote Attacks on Automated Vehicles Sensors : Experiments on Camera and LiDAR , 2015 .

[8]  Ali Farhadi,et al.  Predicting Failures of Vision Systems , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Tim Kelly,et al.  Establishing Safety Criteria for Artificial Neural Networks , 2003, KES.

[10]  Debasish Ghosh,et al.  DSLs in Action , 2010 .

[11]  Maryline Chetto,et al.  A concept of dynamically reconfigurable real-time vision system for autonomous mobile robotics , 2008, Int. J. Autom. Comput..

[12]  Dirk Kraft,et al.  Safety Computer Vision Rules for Improved Sensor Certification , 2017, 2017 First IEEE International Conference on Robotic Computing (IRC).

[13]  Hassen Salhi,et al.  Provably safe navigation for mobile robots with limited field-of-views in dynamic environments , 2012, Auton. Robots.

[14]  Douglas C. Schmidt,et al.  Guest Editor's Introduction: Model-Driven Engineering , 2006, Computer.

[15]  Herman Bruyninckx,et al.  A model-based approach to software deployment in robotics , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Boris Werthessen,et al.  Driver assistance system , 2015 .

[17]  Kjeld Jensen,et al.  Towards Rule-Based Dynamic Safety Monitoring for Mobile Robots , 2014, SIMPAR.

[18]  Matthieu Roy,et al.  Safety Trigger Conditions for Critical Autonomous Systems , 2012, 2012 IEEE 18th Pacific Rim International Symposium on Dependable Computing.

[19]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[20]  Jason Yosinski,et al.  Deep neural networks are easily fooled: High confidence predictions for unrecognizable images , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Yongdae Kim,et al.  Illusion and Dazzle: Adversarial Optical Channel Exploits Against Lidars for Automotive Applications , 2017, CHES.

[22]  Marco Kuhrmann,et al.  On the Use of Safety Certification Practices in Autonomous Field Robot Software Development: A Systematic Mapping Study , 2015, PROFES.

[23]  Yoji Yamada,et al.  Risk Assessment and Functional Safety Analysis to Design Safety Function of a Human-Cooperative Robot , 2012 .

[24]  Makis Stamatelatos,et al.  Fault tree handbook with aerospace applications , 2002 .

[25]  Sebastian Wrede,et al.  A Survey on Domain-specific Modeling and Languages in Robotics , 2016 .

[26]  Björn Åstrand,et al.  Safety Standard for Mobile Robots - A Proposal for 3D Sensors , 2011, ECMR.

[27]  Khoorosh Khodabandehloo Analyses of robot systems using fault and event trees: case studies , 1996 .

[28]  Chen Yan Can You Trust Autonomous Vehicles : Contactless Attacks against Sensors of Self-driving Vehicle , 2016 .

[29]  Holger Voos,et al.  Declarative Specification of Robot Perception Architectures , 2014, SIMPAR.

[30]  Robin R. Murphy,et al.  Follow-up analysis of mobile robot failures , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[31]  Oliver Zendel,et al.  CV-HAZOP: Introducing Test Data Validation for Computer Vision , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[32]  Maxim Bierbach,et al.  Camera-Monitor Systems as a Replacement for Exterior Mirrors in Cars and Trucks , 2016 .

[33]  Soon-Young Yang,et al.  Remote control system of industrial field robot , 2008, 2008 6th IEEE International Conference on Industrial Informatics.

[34]  International Organization for Standardization. International Standard 3950-1984(E). Dentistry--designation system for teeth and areas of the oral cavity. , 1985, Australian dental journal.

[35]  Rachid Alami,et al.  A Verifiable and Correct-by-Construction Controller for Robots in Human Environments , 2015, HRI.

[36]  Karsten Berns,et al.  On Software Quality-motivated Design of a Real-time Framework for Complex Robot Control Systems , 2013, Electron. Commun. Eur. Assoc. Softw. Sci. Technol..

[37]  Fridtjof Stein The challenge of putting vision algorithms into a car , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[38]  Heiko Behrens,et al.  Xtext: implement your language faster than the quick and dirty way , 2010, SPLASH/OOPSLA Companion.

[39]  Gerhard Fischer,et al.  Meta-design , 2004, Commun. ACM.

[40]  Christian Schlegel,et al.  Model-driven engineering and run-time model-usage in service robotics , 2011, GPCE '11.

[41]  Peter Christiansen,et al.  Towards a DSL for Perception-Based Safety Systems , 2016, ArXiv.

[42]  Karsten Berns,et al.  Safe Automotive Software , 2011, KES.

[43]  Christoph Lüth,et al.  Guaranteeing functional safety: design for provability and computer-aided verification , 2011, Autonomous Robots.

[44]  Emery D. Berger Software Needs Seatbelts and Airbags , 2012, ACM Queue.

[45]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[46]  Robin R. Murphy,et al.  Handling Sensing Failures in Autonomous Mobile Robots , 1999, Int. J. Robotics Res..

[47]  Amedeo Santosuosso,et al.  Robots, market and civil liability: A European perspective , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[48]  Paulo Tabuada,et al.  Non-invasive Spoofing Attacks for Anti-lock Braking Systems , 2013, CHES.

[49]  Mandalay Grems,et al.  Standards , 1987, CACM.

[50]  Luciano Lavagno,et al.  Embedded Systems , 2005, Embedded Systems Handbook.

[51]  D. W. Zimmerman Teacher’s Corner: A Note on Interpretation of the Paired-Samples t Test , 1997 .

[52]  Patrick Doherty,et al.  Bridging the sense-reasoning gap: DyKnow - Stream-based middleware for knowledge processing , 2010, Adv. Eng. Informatics.

[53]  Gautam Biswas,et al.  Distributed Diagnosis in Formations of Mobile Robots , 2007, IEEE Transactions on Robotics.

[54]  Nataliya Yakymets,et al.  Model-driven safety assessment of robotic systems , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[55]  Kenneth A. Loparo,et al.  Verification and Validation Methodology of Real-Time Adaptive Neural Networks for Aerospace Applications , 2004 .

[56]  Udo Frese,et al.  Special issue on robot vision: what is robot vision? , 2015, Journal of Real-Time Image Processing.

[57]  Sanja Dogramadzi,et al.  Environmental Hazard Analysis - a Variant of Preliminary Hazard Analysis for Autonomous Mobile Robots , 2014, J. Intell. Robotic Syst..

[58]  Kjeld Jensen,et al.  Rule-based Dynamic Safety Monitoring for Mobile Robots , 2016 .