Sound Probabilistic Numerical Error Analysis

Numerical software uses floating-point arithmetic to implement real-valued algorithms which inevitably introduces roundoff errors. Additionally, in an effort to reduce energy consumption, approximate hardware introduces further errors. As errors are propagated through a computation, the result of the approximated floating-point program can be vastly different from the real-valued ideal one. Previous work on soundly bounding (roundoff) errors has focused on worst-case absolute error analysis. However, not all inputs and not all errors are equally likely such that these methods can lead to overly pessimistic error bounds.

[1]  Heiko Becker,et al.  Daisy - Framework for Analysis and Optimization of Numerical Programs (Tool Paper) , 2018, TACAS.

[2]  Jiqiang Guo,et al.  Stan: A Probabilistic Programming Language. , 2017, Journal of statistical software.

[3]  Eric Goubault,et al.  Discrete Choice in the Presence of Numerical Uncertainties , 2018, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[4]  Dan Grossman,et al.  EnerJ: approximate data types for safe and general low-power computation , 2011, PLDI '11.

[5]  Qiang Xu,et al.  Approximate Computing: A Survey , 2016, IEEE Design & Test.

[6]  David R. Lester,et al.  Improved bound for stochastic formal correctness of numerical algorithms , 2010, Innovations in Systems and Software Engineering.

[7]  Sriram Sankaranarayanan,et al.  Uncertainty Propagation Using Probabilistic Affine Forms and Concentration of Measure Inequalities , 2016, TACAS.

[8]  Christophe Denis,et al.  Numerical 'health check' for scientific codes: the CADNA approach , 2007, Comput. Phys. Commun..

[9]  Dan Grossman,et al.  Expressing and verifying probabilistic assertions , 2014, PLDI.

[10]  Ian Briggs,et al.  Rigorous Estimation of Floating-Point Round-Off Errors with Symbolic Taylor Expansions , 2015, FM.

[11]  Jean Goubault-Larrecq,et al.  A generalization of p-boxes to affine arithmetic , 2011, Computing.

[12]  Viktor Kuncak,et al.  Towards a Compiler for Reals , 2014, ACM Trans. Program. Lang. Syst..

[13]  Sumit Gulwani,et al.  Static analysis for probabilistic programs: inferring whole program properties from finitely many paths , 2013, PLDI.

[14]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[15]  Scott Ferson,et al.  Constructing Probability Boxes and Dempster-Shafer Structures , 2003 .

[16]  Mariano M. Moscato,et al.  Automatic Estimation of Verified Floating-Point Round-Off Errors via Static Analysis , 2017, SAFECOMP.

[17]  Florent de Dinechin,et al.  Assisted verification of elementary functions using Gappa , 2006, SAC.

[18]  Matthieu Martel,et al.  Improving the numerical accuracy of programs by automatic transformation , 2017, International Journal on Software Tools for Technology Transfer.

[19]  Eric Goubault,et al.  Static Analysis of Finite Precision Computations , 2011, VMCAI.

[20]  Zhendong Su,et al.  Perturbing numerical calculations for statistical analysis of floating-point program (in)stability , 2010, ISSTA '10.

[21]  George A. Constantinides,et al.  Certified Roundoff Error Bounds Using Semidefinite Programming , 2015, ACM Trans. Math. Softw..

[22]  Martin C. Rinard,et al.  Chisel: reliability- and accuracy-aware optimization of approximate computational kernels , 2014, OOPSLA.

[23]  Eva Darulova,et al.  On sound relative error bounds for floating-point arithmetic , 2017, 2017 Formal Methods in Computer Aided Design (FMCAD).

[24]  Christian Keil Lurupa - Rigorous Error Bounds in Linear Programming , 2005, Algebraic and Numerical Algorithms and Computer-assisted Proofs.

[25]  Jorge Stolfi,et al.  Affine Arithmetic: Concepts and Applications , 2004, Numerical Algorithms.

[26]  Chung-Kil Hur,et al.  R2: An Efficient MCMC Sampler for Probabilistic Programs , 2014, AAAI.

[27]  Timon Gehr,et al.  PSI: Exact Symbolic Inference for Probabilistic Programs , 2016, CAV.

[28]  Kurt Mehlhorn,et al.  Certifying and repairing solutions to large LPs how good are LP-solvers? , 2003, SODA '03.