dtControl: decision tree learning algorithms for controller representation

Decision tree learning is a popular classification technique most commonly used in machine learning applications. Recent work has shown that decision trees can be used to represent provably-correct controllers concisely. Compared to representations using lookup tables or binary decision diagrams, decision trees are smaller and more explainable. We present dtControl, an easily extensible tool for representing memoryless controllers as decision trees. We give a comprehensive evaluation of various decision tree learning algorithms applied to 10 case studies arising out of correct-by-construction controller synthesis. These algorithms include two new techniques, one for using arbitrary linear binary classifiers in the decision tree learning, and one novel approach for determinizing controllers during the decision tree construction. In particular the latter turns out to be extremely efficient, yielding decision trees with a single-digit number of decision nodes on 5 of the case studies.

[1]  Paulo Tabuada,et al.  Verification and Control of Hybrid Systems , 2009 .

[2]  Jan Kretínský,et al.  dtControl: decision tree learning algorithms for controller representation , 2020, HSCC.

[3]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[4]  Kim G. Larsen,et al.  Uppaal Stratego , 2015, TACAS.

[5]  Kim G. Larsen,et al.  SOS: Safe, Optimal and Small Strategies for Hybrid Markov Decision Processes , 2019, QEST.

[6]  Christoph H. Lampert,et al.  Strategy Representation by Decision Trees with Linear Classifiers , 2019, QEST.

[7]  Antoine Girard,et al.  CoSyMA: a tool for controller synthesis using multi-scale abstractions , 2013, HSCC '13.

[8]  Christopher M. Bishop,et al.  Classification and regression , 1997 .

[9]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[10]  Larry D. Pyeatt,et al.  Decision Tree Function Approximation in Reinforcement Learning , 1999 .

[11]  Kim G. Larsen,et al.  Safe and Optimal Adaptive Cruise Control , 2015, Correct System Design.

[12]  Christopher M. Bishop,et al.  Pattern recognition and machine learning, 5th Edition , 2007, Information science and statistics.

[13]  Enrico Macii,et al.  Algebric Decision Diagrams and Their Applications , 1997, ICCAD '93.

[14]  Robin J. Evans,et al.  Feedback Control Under Data Rate Constraints: An Overview , 2007, Proceedings of the IEEE.

[15]  Gunther Reissig,et al.  State space grids for low complexity abstractions , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[16]  P. Madhusudan,et al.  Synthesizing Piece-Wise Functions by Learning Classifiers , 2016, TACAS.

[17]  Majid Zamani,et al.  SCOTS: A Tool for the Synthesis of Symbolic Controllers , 2016, HSCC.

[18]  Majid Zamani,et al.  Compositional Synthesis of Symbolic Models for Networks of Switched Systems , 2019, IEEE Control Systems Letters.

[19]  Eibe Frank,et al.  Logistic Model Trees , 2003, Machine Learning.

[20]  Majid Zamani,et al.  Invariance Feedback Entropy of Uncertain Control Systems , 2017, IEEE Transactions on Automatic Control.

[21]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[22]  Krishnendu Chatterjee,et al.  Counterexample Explanation by Learning Small Strategies in Markov Decision Processes , 2015, CAV.

[23]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[24]  Simon Kasif,et al.  OC1: A Randomized Induction of Oblique Decision Trees , 1993, AAAI.

[25]  Gunther Reissig,et al.  Feedback Refinement Relations for the Synthesis of Symbolic Controllers , 2015, IEEE Transactions on Automatic Control.

[26]  Enrico Macii,et al.  Algebraic decision diagrams and their applications , 1993, Proceedings of 1993 International Conference on Computer Aided Design (ICCAD).

[27]  Calin Belta,et al.  Formal Methods for Discrete-Time Dynamical Systems , 2017 .

[28]  Krishnendu Chatterjee,et al.  Strategy Representation by Decision Trees in Reactive Synthesis , 2018, TACAS.

[29]  Majid Zamani,et al.  QUEST: A Tool for State-Space Quantization-Free Synthesis of Symbolic Controllers , 2017, QEST.

[30]  Harry Zhang,et al.  The Optimality of Naive Bayes , 2004, FLAIRS.

[31]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[32]  Marco Caccamo,et al.  Software Fault Tolerance for Cyber-Physical Systems via Full System Restart , 2020, ACM Trans. Cyber Phys. Syst..

[33]  Antoine Girard,et al.  Low-Complexity Quantized Switching Controllers using Approximate Bisimulation , 2012, ArXiv.

[34]  Manuel Mazo,et al.  PESSOA: A Tool for Embedded Controller Synthesis , 2010, CAV.

[35]  Majid Zamani,et al.  pFaces: an acceleration ecosystem for symbolic control , 2019, HSCC.

[36]  Paulo Tabuada,et al.  Verification and Control of Hybrid Systems - A Symbolic Approach , 2009 .

[37]  Paul E. Utgoff,et al.  Perceptron Trees : A Case Study in ybrid Concept epresentations , 1999 .

[38]  Kim G. Larsen,et al.  Guaranteed Control Synthesis for Continuous Systems in Uppaal Tiga , 2018, CyPhy/WESE.

[39]  Manuel Mazo,et al.  Optimal Symbolic Controllers Determinization for BDD storage , 2018, ADHS.

[40]  Mykel J. Kochenderfer,et al.  Deep Neural Network Compression for Aircraft Collision Avoidance Systems , 2018, Journal of Guidance, Control, and Dynamics.

[41]  Michael Luttenberger,et al.  Quantitative Implementation Strategies for Safety Controllers , 2017, ArXiv.

[42]  Ioannis T. Christou,et al.  An Evolving Oblique Decision Tree Ensemble Architecture for Continuous Learning Applications , 2007, AIAI.

[43]  Randal E. Bryant,et al.  Graph-Based Algorithms for Boolean Function Manipulation , 1986, IEEE Transactions on Computers.