Ongoing verification of a multiphysics community code: FLASH

When developing a complex, multi‐authored code, daily testing on multiple platforms and under a variety of conditions is essential. It is therefore necessary to have a regression test suite that is easily administered and configured, as well as a way to easily view and interpret the test suite results. We describe the methodology for verification of FLASH, a highly capable multiphysics scientific application code with a wide user base. The methodology uses a combination of unit and regression tests and an in‐house testing software that is optimized for operation under limited resources. Although our practical implementations do not always comply with theoretical regression‐testing research, our methodology provides a comprehensive verification of a large scientific code under resource constraints.Copyright © 2013 John Wiley & Sons, Ltd.

[1]  Gregg Rothermel,et al.  Prioritizing test cases for regression testing , 2000, ISSTA '00.

[2]  J. ZuHone,et al.  A PARAMETER SPACE EXPLORATION OF GALAXY CLUSTER MERGERS. I. GAS MIXING AND THE GENERATION OF CLUSTER ENTROPY , 2010, 1004.3820.

[3]  Klaus Weide,et al.  FLASH magnetohydrodynamic simulations of shock-generated magnetic field experiments , 2012 .

[4]  Sean M. Couch,et al.  ASPHERICAL CORE-COLLAPSE SUPERNOVAE IN RED SUPERGIANTS POWERED BY NONRELATIVISTIC JETS , 2008, 0812.3918.

[5]  D. Lamb,et al.  Three-Dimensional Simulations of the Deflagration Phase of the Gravitationally Confined Detonation Model of Type Ia Supernovae , 2007 .

[6]  John C. Cherniavsky,et al.  Validation, Verification, and Testing of Computer Software , 1982, CSUR.

[7]  Gregg Rothermel,et al.  A safe, efficient regression test selection technique , 1997, TSEM.

[8]  I. Foster,et al.  Terascale Turbulence Computation on BG / L Using the FLASH 3 Code , 2006 .

[9]  B. Fryxell,et al.  FLASH: An Adaptive Mesh Hydrodynamics Code for Modeling Astrophysical Thermonuclear Flashes , 2000 .

[10]  V. G. Weirs,et al.  On Validating an Astrophysical Simulation Code , 2002, astro-ph/0206251.

[11]  Robert L. Kelsey,et al.  Creating a flexible environment for testing scientific software , 2004, SPIE Defense + Commercial Sensing.

[12]  Marc J. Balcer,et al.  The category-partition method for specifying and generating fuctional tests , 1988, CACM.

[13]  Enrico Ramirez-Ruiz,et al.  HYDRODYNAMICAL SIMULATIONS TO DETERMINE THE FEEDING RATE OF BLACK HOLES BY THE TIDAL DISRUPTION OF STARS: THE IMPORTANCE OF THE IMPACT PARAMETER AND STELLAR STRUCTURE , 2012, 1206.2350.

[14]  Alan C. Calder,et al.  Kelvin–Helmholtz instabilities as the source of inhomogeneous mixing in nova explosions , 2011, Nature.

[15]  Andrew Siegel,et al.  Extensible component-based architecture for FLASH, a massively parallel, multiphysics simulation code , 2009, Parallel Comput..

[16]  Myra B. Cohen,et al.  Configuration-aware regression testing: an empirical study of sampling and prioritization , 2008, ISSTA '08.

[17]  Michael D. Ernst,et al.  Improving test suites via operational abstraction , 2003, 25th International Conference on Software Engineering, 2003. Proceedings..

[18]  Brad Gallagher,et al.  Terascale turbulence computation using the FLASH3 application framework on the IBM Blue Gene/L system , 2008, IBM J. Res. Dev..

[19]  Bertrand Meyer,et al.  Seven Principles of Software Testing , 2008, Computer.

[20]  E. Tasker,et al.  A test suite for quantitative comparison of hydrodynamic codes in astrophysics , 2008, 0808.1844.

[21]  Klaus Weide,et al.  Modeling HEDLA magnetic field generation experiments on laser facilities , 2013 .