Constraint Reasoning for Differential Models

The basic motivation of this work was the integration of biophysical models within the interval constraints framework for decision support. Comparing the major features of biophysical models with the expressive power of the existing interval constraints framework, it was clear that the most important inadequacy was related with the representation of differential equations. System dynamics is often modelled through differential equations but there was no way of expressing a differential equation as a constraint and integrate it within the constraints framework. Consequently, the goal of this work is focussed on the integration of ordinary differential equations within the interval constraints framework, which for this purpose is extended with the new formalism of Constraint Satisfaction Differential Problems. Such framework allows the specification of ordinary differential equations, together with related information, by means of constraints, and provides efficient propagation techniques for pruning the domains of their variables. This enabled the integration of all such information in a single constraint whose variables may subsequently be used in other constraints of the model. The specific method used for pruning its variable domains can then be combined with the pruning methods associated with the other constraints in an overall propagation algorithm for reducing the bounds of all model variables. The application of the constraint propagation algorithm for pruning the variable domains, that is, the enforcement of local-consistency, turned out to be insufficient to support decision in practical problems that include differential equations. The domain pruning achieved is not, in general, sufficient to allow safe decisions and the main reason derives from the non-linearity of the differential equations. Consequently, a complementary goal of this work proposes a new strong consistency criterion, Global Hull-consistency, particularly suited to decision support with differential models, by presenting an adequate trade-of between domain pruning and computational effort. Several alternative algorithms are proposed for enforcing Global Hull-consistency and, due to their complexity, an effort was made to provide implementations able to supply any-time pruning results. Since the consistency criterion is dependent on the existence of canonical solutions, it is proposed a local search approach that can be integrated with constraint propagation in continuous domains and, in particular, with the enforcing algorithms for anticipating the finding of canonical solutions. The last goal of this work is the validation of the approach as an important contribution for the integration of biophysical models within decision support. Consequently, a prototype application that integrated all the proposed extensions to the interval constraints framework is developed and used for solving problems in different biophysical domains.

[1]  P. Henrici Discrete Variable Methods in Ordinary Differential Equations , 1962 .

[2]  Pedro Barahona,et al.  A Causal-Functional Model Applied to EMG Diagnosis , 1997, AIME.

[3]  Pascal Van Hentenryck,et al.  A Constraint Satisfaction Approach to Parametric Differential Equations , 2001, IJCAI.

[4]  Nedialko S. Nedialkov,et al.  An Interval Hermite-Obreschkoff Method for Computing Rigorous Bounds on the Solution of an Initial Value Problem for an Ordinary Differential Equation , 1998, SCAN.

[5]  Philip E. Gill,et al.  Practical optimization , 1981 .

[6]  Nedialko S. Nedialkov,et al.  Validated solutions of initial value problems for ordinary differential equations , 1999, Appl. Math. Comput..

[7]  E. Hairer,et al.  Solving ordinary differential equations I (2nd revised. ed.): nonstiff problems , 1993 .

[8]  Pedro Barahona,et al.  Integrating Deep Biomedical Models into Medical Decision Support Systems: An Interval Constraint Approach , 1999, AIMDM.

[9]  David L. Waltz,et al.  Generating Semantic Descriptions From Drawings of Scenes With Shadows , 1972 .

[10]  Hélène Collavizza,et al.  A Note on Partial Consistencies over Continuous Domains , 1998, CP.

[11]  G. Alefeld,et al.  Introduction to Interval Computation , 1983 .

[12]  Jon G. Rokne,et al.  Computer Methods for the Range of Functions , 1984 .

[13]  R. Lohner Einschliessung der Lösung gewöhnlicher Anfangs- und Randwertaufgaben und Anwendungen , 1988 .

[14]  J. Stoer,et al.  Numerical treatment of ordinary differential equations by extrapolation methods , 1966 .

[15]  David A. McAllester,et al.  Solving Polynomial Systems Using a Branch and Prune Approach , 1997 .

[16]  Eldon Hansen,et al.  Topics in Interval Analysis , 1969 .

[17]  Frédéric Benhamou,et al.  Automatic Generation of Numerical Redundancies for Non-Linear Constraint Solving , 1997, Reliab. Comput..

[18]  Kaj Madsen,et al.  Automatic Validation of Numerical Solutions , 1997 .

[19]  Nedialko S. Nedialkov,et al.  A New Perspective on the Wrapping Effect in Interval Methods for Initial Value Problems for Ordinary Differential Equations , 2001, Perspectives on Enclosure Methods.

[20]  Olivier Lhomme,et al.  Consistency Techniques for Numeric CSPs , 1993, IJCAI.

[21]  Eero Hyvönen,et al.  Constraint Reasoning Based on Interval Arithmetic: The Tolerance Propagation Approach , 1992, Artif. Intell..

[22]  Pedro Barahona,et al.  Constraint Reasoning with Differential Equations , 2004 .

[23]  Kaj Madsen,et al.  Use of a Real-Valued Local Minimum in Parallel Interval Global Optimization , 1994 .

[24]  Eldon Hansen,et al.  A globally convergent interval method for computing and bounding real roots , 1978 .

[25]  N. Nedialkov,et al.  ODE Software that Computes Guaranteed Bounds on the Solution , 2000 .

[26]  Pascal Van Hentenryck,et al.  Consistency Techniques in Ordinary Differential Equations , 1998, CP.

[27]  Robert Rihm Implicit Methods for Enclosing Solutions of ODEs , 1998, J. Univers. Comput. Sci..

[28]  Pascal Van Hentenryck,et al.  Multistep Filtering Operators for Ordinary Differential Equations , 1999, CP.

[29]  Pedro Barahona,et al.  Constraint Reasoning in Deep Biomedical Models , 2003, AIME.

[30]  Anthony V. Fiacco,et al.  Nonlinear programming;: Sequential unconstrained minimization techniques , 1968 .

[31]  Hélène Collavizza,et al.  Comparing Partial Consistencies , 1998, SCAN.

[32]  Pascal Van Hentenryck,et al.  Optimal Pruning in Parametric Differential Equations , 2001, CP.

[33]  R. Fletcher,et al.  A New Approach to Variable Metric Algorithms , 1970, Comput. J..

[34]  Arnaud Gotlieb,et al.  Boosting the Interval Narrowing Algorithm , 1996, JICSLP.

[35]  Eric Monfroy,et al.  Improved bounds on the complexity of kB-consistency , 2001, IJCAI.

[36]  Begnaud Francis Hildebrand,et al.  Introduction to numerical analysis: 2nd edition , 1987 .

[37]  Ulrich W. Kulisch,et al.  PASCAL-XSC , 1992, Springer Berlin Heidelberg.

[38]  Eugene C. Freuder Synthesizing constraint expressions , 1978, CACM.

[39]  Pascal Van Hentenryck,et al.  CLP(Intervals) Revisited , 1994, ILPS.

[40]  Pedro Barahona,et al.  Maintaining Global Hull Consistency with Local Search for Continuous CSPs , 2002, COCOS.

[41]  Roger Fletcher,et al.  A Rapidly Convergent Descent Method for Minimization , 1963, Comput. J..

[42]  Hélène Collavizza,et al.  Extending Consistent Domains of Numeric CSP , 1999, IJCAI.

[43]  S. Skelboe Computation of rational interval functions , 1974 .

[44]  John D. Pryce,et al.  An Effective High-Order Interval Method for Validating Existence and Uniqueness of the Solution of an IVP for an ODE , 2001, Reliab. Comput..

[45]  James M. Ortega,et al.  Iterative solution of nonlinear equations in several variables , 2014, Computer science and applied mathematics.

[46]  E. Hansen,et al.  Bounding solutions of systems of equations using interval analysis , 1981 .

[47]  Pedro Barahona,et al.  An Interval Constraint Approach to Handle Parametric Ordinary Differential Equations for Decision Support , 1999, CP.

[48]  Rudolf Krawczyk,et al.  Newton-Algorithmen zur Bestimmung von Nullstellen mit Fehlerschranken , 1969, Computing.

[49]  Jon G. Rokne,et al.  New computer methods for global optimization , 1988 .

[50]  Pascal Van Hentenryck,et al.  A Constraint Satisfaction Approach to a Circuit Design Problem , 1996, J. Glob. Optim..

[51]  Frédéric Benhamou,et al.  Programming in CLP(BNR) , 1993, PPCP.

[52]  C. G. Broyden A Class of Methods for Solving Nonlinear Simultaneous Equations , 1965 .

[53]  C. M. Reeves,et al.  Function minimization by conjugate gradients , 1964, Comput. J..

[54]  William S. Havens,et al.  HIERARCHICAL ARC CONSISTENCY FOR DISJOINT REAL INTERVALS IN CONSTRAINT LOGIC PROGRAMMING , 1992, Comput. Intell..

[55]  Pascal Van Hentenryck,et al.  Numerica: A Modeling Language for Global Optimization , 1997, IJCAI.

[56]  G. Alefeld,et al.  Intervallrechnung über den komplexen Zahlen und einige Anwendungen , 1968 .

[57]  Pedro Barahona,et al.  Applying Constraint Programming to Protein Structure Determination , 1999, CP.

[58]  J. Lambert Numerical Methods for Ordinary Differential Systems: The Initial Value Problem , 1991 .

[59]  Uri M. Ascher,et al.  Computer methods for ordinary differential equations and differential-algebraic equations , 1998 .

[60]  Yasuo Fujii,et al.  An interval arithmetic method for global optimization , 1979, Computing.

[61]  Frédéric Benhamou,et al.  Applying Interval Arithmetic to Real, Integer, and Boolean Constraints , 1997, J. Log. Program..

[62]  Pedro Barahona,et al.  Constraint Satisfaction Differential Problems , 2003, CP.

[63]  Martin Berz,et al.  Verified Integration of ODEs and Flows Using Differential Algebraic Methods on High-Order Taylor Models , 1998, Reliab. Comput..

[64]  L. Shampine,et al.  Computer solution of ordinary differential equations : the initial value problem , 1975 .

[65]  Pedro Barahona,et al.  Handling Differential Equations with Constraints for Decision Support , 2000, FroCoS.

[66]  Krzysztof R. Apt,et al.  The Essence of Constraint Propagation , 1998, Theor. Comput. Sci..

[67]  Ugo Montanari,et al.  Networks of constraints: Fundamental properties and applications to picture processing , 1974, Inf. Sci..

[68]  Boi Faltings,et al.  Consistency techniques for continuous constraints , 1996, Constraints.

[69]  Frédéric Benhamou,et al.  Combining Local Consistency, Symbolic Rewriting and Interval Methods , 1996, AISMC.

[70]  Peter Jeavons,et al.  Constructing Constraints , 1998, CP.

[71]  Ernest Davis,et al.  Constraint Propagation with Interval Labels , 1987, Artif. Intell..

[72]  Ramon E. Moore Methods and applications of interval analysis , 1979, SIAM studies in applied mathematics.

[73]  Frédéric Benhamou,et al.  Heterogeneous Constraint Solving , 1996, ALP.

[74]  Pedro Barahona,et al.  PSICO: Solving Protein Structures with Constraint Programming and Optimization , 2002, Constraints.

[75]  Frédéric Goualard Langages et environnements en programmation par contraintes d'intervalles , 2000 .

[76]  M. H. van Emden,et al.  Interval arithmetic: From principles to implementation , 2001, JACM.

[77]  N. Nedialkov,et al.  Computing rigorous bounds on the solution of an initial value problem for an ordinary differential equation , 1999 .

[78]  John E. Dennis,et al.  Numerical methods for unconstrained optimization and nonlinear equations , 1983, Prentice Hall series in computational mathematics.

[79]  G. D. Byrne,et al.  VODE: a variable-coefficient ODE solver , 1989 .

[80]  Frédéric Goualard,et al.  Revising Hull and Box Consistency , 1999, ICLP.

[81]  J. H. Wilkinson,et al.  Handbook for Automatic Computation: Linear Algebra (Grundlehren Der Mathematischen Wissenschaften, Vol 186) , 1986 .

[82]  M. H. van Emden,et al.  A Unified Framework for Interval Constraints and Interval Arithmetic , 1998, CP.

[83]  Martin Berz,et al.  Verified High-Order Integration of DAEs and Higher-Order ODEs , 2001 .

[84]  Philip E. Gill,et al.  Numerical methods for constrained optimization , 1974 .

[85]  Arnaud Gotlieb,et al.  Dynamic Optimization of Interval Narrowing Algorithms , 1998, J. Log. Program..

[86]  L. Shampine,et al.  Numerical Solution of Ordinary Differential Equations. , 1995 .

[87]  Pedro Barahona,et al.  Global Hull Consistency with Local Search for Continuous Constraint Solving , 2001, EPIA.