On the Fundamental Tautology of Validating Data-Driven Models and Simulations

Recent advances in Dynamic Data Driven Application Systems (DDDAS) facilitated by the present level of computational technologies, as well as advances in data-driven modeling and simulation, impose the need for a critical evaluation of paradigms underlying Qualification, Validation and Verification (QV&V). This paper discusses the fundamental irrelevance of conventional validation procedures with respect to data-driven models and simulations. This inherent property of data-driven models and simulations makes the data-driven approaches extremely desirable from a reliability perspective. An informal comparison of the logical flow of traditional and evolved QV&V demonstrates the tautological nature of data-driven model validation. A brief epistemological review of the origins of traditional and evolved QV&V is also presented.

[1]  TIMOTHY G. TRUCANO,et al.  Guidelines for Sandia ASCI Verification and Validation Plans - Content and Format: Version 1.0 , 1999 .

[2]  William L. Oberkampf,et al.  Guide for the verification and validation of computational fluid dynamics simulations , 1998 .

[3]  Elias N. Houstis,et al.  Agent-Based Simulation of Data-Driven Fire Propagation Dynamics , 2004, International Conference on Computational Science.

[4]  Charbel Farhat,et al.  On a data-driven environment for multiphysics applications , 2005, Future Gener. Comput. Syst..

[5]  M. Resnik,et al.  Aspects of Scientific Explanation. , 1966 .

[6]  Charbel Farhat,et al.  DDEMA: A Data Driven Environment for Multiphysics Applications , 2003, International Conference on Computational Science.

[7]  Stephen Gilmore,et al.  Evaluating the Performance of Skeleton-Based High Level Parallel Programs , 2004, International Conference on Computational Science.

[8]  L. See.  A Historical Introduction to the Philosophy of Science , 1993 .

[9]  P. Thagard,et al.  Computational Philosophy of Science , 1988 .

[10]  Paul F. Anderson,et al.  Marketing, Scientific Progress, and Scientific Method , 1983 .

[11]  Zaira P. Marioli-Riga,et al.  Recent Advances in Composite Materials , 2003 .

[12]  Frederica Darema,et al.  Dynamic Data Driven Applications Systems: A New Paradigm for Application Simulations and Measurements , 2004, International Conference on Computational Science.

[13]  R. Persaud.  Philosophy of science , 1992, The Lancet.

[14]  S. Toulmin,et al.  Philosophy of Science , 1970, The British Journal for the History of Science.

[15]  S. G. Lambrakos,et al.  Analysis of processes involving heat deposition using constrained optimisation , 2002 .

[16]  Jack Dongarra,et al.  Computational Science — ICCS 2003 , 2003, Lecture Notes in Computer Science.

[17]  J. G. Michopoulos,et al.  Computational and Mechatronic Automation of Multiphysics Research for Structural and Material Systems , 2003 .

[18]  E. Sosa,et al.  Epistemology : the classic readings , 1999 .