Sampling-based Reachability Analysis: A Random Set Theory Approach with Adversarial Sampling

Reachability analysis is at the core of many applications, from neural network verification, to safe trajectory planning of uncertain systems. However, this problem is notoriously challenging, and current approaches tend to be either too restrictive, too slow, too conservative, or approximate and therefore lack guarantees. In this paper, we propose a simple yet effective sampling-based approach to perform reachability analysis for arbitrary dynamical systems. Our key novel idea consists of using random set theory to give a rigorous interpretation of our method, and prove that it returns sets which are guaranteed to converge to the convex hull of the true reachable sets. Additionally, we leverage recent work on robust deep learning and propose a new adversarial sampling approach to robustify our algorithm and accelerate its convergence. We show that our method is faster and less conservative than other approaches, present results for approximate reachability analysis of neural networks and robust trajectory optimization of high-dimensional uncertain nonlinear systems, and discuss future applications.

[1]  Davide Scaramuzza,et al.  A General Framework for Uncertainty Estimation in Deep Learning , 2020, IEEE Robotics and Automation Letters.

[2]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[3]  Jonathon Shlens,et al.  Explaining and Harnessing Adversarial Examples , 2014, ICLR.

[4]  Paul Rolland,et al.  Lipschitz constant estimation of Neural Networks via sparse polynomial optimization , 2020, ICLR.

[5]  John Lygeros,et al.  Performance Bounds for the Scenario Approach and an Extension to a Class of Non-Convex Programs , 2013, IEEE Transactions on Automatic Control.

[6]  A. Rodr'iguez-Casal,et al.  A fully data-driven method for estimating the shape of a point cloud , 2014, 1404.7397.

[7]  A. Tsybakov,et al.  Minimax theory of image reconstruction , 1993 .

[8]  I. Molchanov Theory of Random Sets , 2005 .

[9]  Daniel Cohen-Or,et al.  Three-dimensional distance field metamorphosis , 1998, TOGS.

[10]  Jinfeng Yi,et al.  Evaluating the Robustness of Neural Networks: An Extreme Value Theory Approach , 2018, ICLR.

[11]  Matthew Johnson-Roberson,et al.  Reachable Sets for Safe, Real-Time Manipulator Trajectory Design , 2020, RSS 2020.

[12]  Sergey Levine,et al.  Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks , 2017, ICML.

[13]  Stephen P. Boyd,et al.  OSQP: an operator splitting solver for quadratic programs , 2017, Mathematical Programming Computation.

[14]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[15]  Emilio Frazzoli,et al.  Incremental Search Methods for Reachability Analysis of Continuous and Hybrid Systems , 2004, HSCC.

[16]  Deren Han,et al.  Comparison of several fast algorithms for projection onto an ellipsoid , 2017, J. Comput. Appl. Math..

[17]  Hao Su,et al.  A Point Set Generation Network for 3D Object Reconstruction from a Single Image , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Claire J. Tomlin,et al.  An Efficient Reachability-Based Framework for Provably Safe Autonomous Navigation in Unknown Environments , 2019, 2019 IEEE 58th Conference on Decision and Control (CDC).

[19]  Holger Voos,et al.  A Real-Time Approach for Chance-Constrained Motion Planning With Dynamic Obstacles , 2020, IEEE Robotics and Automation Letters.

[20]  Mo Chen,et al.  Hamilton-Jacobi reachability: A brief overview and recent advances , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[21]  Victor Picheny,et al.  Fast Parallel Kriging-Based Stepwise Uncertainty Reduction With Application to the Identification of an Excursion Set , 2014, Technometrics.

[22]  Nikolai Matni,et al.  Robust Guarantees for Perception-Based Control , 2019, L4DC.

[23]  Marco Pavone,et al.  Evaluating Trajectory Collision Probability through Adaptive Importance Sampling for Safe Motion Planning , 2016, Robotics: Science and Systems.

[24]  Yuanyuan Shi,et al.  Optimal Control Via Neural Networks: A Convex Approach , 2018, ICLR.

[25]  David Fridovich-Keil,et al.  A Classification-based Approach for Approximate Reachability , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[26]  Francesco Borrelli,et al.  Sample-Based Learning Model Predictive Control for Linear Uncertain Systems , 2019, 2019 IEEE 58th Conference on Decision and Control (CDC).

[27]  Juraj Kabzan,et al.  Cautious Model Predictive Control Using Gaussian Process Regression , 2017, IEEE Transactions on Control Systems Technology.

[28]  J. Lygeros,et al.  Neural approximation of PDE solutions: An application to reachability computations , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[29]  Csaba Szepesvári,et al.  Improved Algorithms for Linear Stochastic Bandits , 2011, NIPS.

[30]  B. Ripley,et al.  Finding the edge of a Poisson forest , 1977, Journal of Applied Probability.

[31]  Torsten Koller,et al.  Learning-based Model Predictive Control for Safe Exploration and Reinforcement Learning , 2019, ArXiv.

[32]  Bastien Berret,et al.  Efficient computation of optimal open-loop controls for stochastic systems , 2020, Autom..

[33]  Igor Gilitschenski,et al.  Sampling-Based Approximation Algorithms for Reachability Analysis with Provable Guarantees , 2018, Robotics: Science and Systems.

[34]  Samy Bengio,et al.  Adversarial examples in the physical world , 2016, ICLR.

[35]  Murat Arcak,et al.  Estimating Reachable Sets with Scenario Optimization , 2020, L4DC.

[36]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[37]  Lei Xu,et al.  Input Convex Neural Networks : Supplementary Material , 2017 .

[38]  Riccardo Bonalli,et al.  Chance-Constrained Sequential Convex Programming for Robust Trajectory Optimization , 2020, 2020 European Control Conference (ECC).

[39]  Manfred Morari,et al.  Efficient and Accurate Estimation of Lipschitz Constants for Deep Neural Networks , 2019, NeurIPS.

[40]  Jun Zhu,et al.  Boosting Adversarial Attacks with Momentum , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[41]  Peng Sun,et al.  Computation of Minimum Volume Covering Ellipsoids , 2002, Oper. Res..

[42]  Marco Pavone,et al.  Meta-Learning Priors for Efficient Online Bayesian Regression , 2018, WAFR.

[43]  Anca D. Dragan,et al.  Probabilistically Safe Robot Planning with Confidence-Based Human Predictions , 2018, Robotics: Science and Systems.

[44]  Komei Fukuda,et al.  Exact volume computation for polytopes: a practical study , 1996 .

[45]  Sylvia L. Herbert,et al.  Reachability-Based Safety Guarantees using Efficient Initializations , 2019, 2019 IEEE 58th Conference on Decision and Control (CDC).

[46]  Russ Tedrake,et al.  R3T: Rapidly-exploring Random Reachable Set Tree for Optimal Kinodynamic Planning of Nonlinear Hybrid Systems , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[47]  Eddy Ilg,et al.  Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstruction , 2020, ECCV.

[48]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[49]  Ali-akbar Agha-mohammadi,et al.  Deep Learning Tubes for Tube MPC , 2020, RSS 2020.

[50]  Lukas Hewing,et al.  On Simulation and Trajectory Prediction with Gaussian Process Dynamics , 2020, L4DC.