Verification of Continuous and Hybrid Systems ARCH-COMP 2019 Category Report : Falsification ∗

This report presents the results from the 2019 friendly competition in the ARCH workshop for the falsification of temporal logic specifications over Cyber-Physical Systems. We describe the organization of the competition and how it differs from previous years. We give background on the participating teams and tools and discuss the selected benchmarks and results. The benchmarks are available on the ARCH website, as well as in the competition’s gitlab repository. The main outcome of the 2019 competition is a common benchmark repository, and an initial base-line for falsification, with results from multiple tools, which will facilitate comparisons and tracking of the state-of-the-art in falsification in the future.

[1]  S. Sastry,et al.  Towars a Theory of Stochastic Hybrid Systems , 2000, HSCC.

[2]  Dejan Nickovic,et al.  Monitoring Temporal Properties of Continuous Signals , 2004, FORMATS/FTRTFT.

[3]  Ron Koymans,et al.  Specifying real-time properties with metric temporal logic , 1990, Real-Time Systems.

[4]  George J. Pappas,et al.  Robustness of Temporal Logic Specifications , 2006, FATES/RV.

[5]  Sriram Sankaranarayanan,et al.  S-TaLiRo: A Tool for Temporal Logic Falsification for Hybrid Systems , 2011, TACAS.

[6]  Kenneth R. Butts,et al.  Powertrain control verification benchmark , 2014, HSCC.

[7]  Houssam Abbas,et al.  Benchmarks for Temporal Logic Requirements for Automotive Systems , 2014, ARCH@CPSWeek.

[8]  Alex Graves,et al.  Asynchronous Methods for Deep Reinforcement Learning , 2016, ICML.

[9]  Fabiano Daher Adegas,et al.  Hybrid Modelling of a Wind Turbine , 2016, ARCH@CPSWeek.

[10]  Georgios E. Fainekos,et al.  ARCH-COMP17 Category Report: Preliminary Results on the Falsification Benchmarks , 2017, ARCH@CPSWeek.

[11]  Dejan Nickovic,et al.  Specification-Based Monitoring of Cyber-Physical Systems: A Survey on Theory, Tools and Applications , 2018, Lectures on Runtime Verification.

[12]  Jianye Hao,et al.  Falsification of Cyber-Physical Systems Using Deep Reinforcement Learning , 2018, IEEE Transactions on Software Engineering.

[13]  Gidon Ernst,et al.  Two-Layered Falsification of Hybrid Systems Guided by Monte Carlo Tree Search , 2018, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[14]  Stanley Bak,et al.  Verification Challenges in F-16 Ground Collision Avoidance and Other Automated Maneuvers , 2018, ARCH@ADHS.

[15]  Gidon Ernst,et al.  ARCH-COMP18 Category Report: Results on the Falsification Benchmarks , 2018, ARCH@ADHS.

[16]  Georgios Fainekos,et al.  Gray-box adversarial testing for control systems with machine learning components , 2018, HSCC.

[17]  Gidon Ernst,et al.  Fast Falsification of Hybrid Systems using Probabilistically Adaptive Input , 2018, QEST.