Reproducible and Replicable Computational Fluid Dynamics: It’s Harder Than You Think

Completing a full replication study of the authors’ previously published findings on bluff-body aerodynamics was harder than they thought, despite them having good reproducible-research practices, such as sharing their code and data openly. Here’s what they learned from three years, four computational fluid dynamics codes, and hundreds of runs.

[1]  W. Marsden.  I and J , 2012 .

[2]  R. Peng.  Reproducible Research in Computational Science , 2011, Science.

[3]  A. BarbaLorena,et al.  Reproducibility PI Manifesto , 2012 .

[4]  R. Sani,et al.  Résumé and remarks on the open boundary condition minisymposium , 1994 .

[5]  Michael Zingale,et al.  A comparative study of the turbulent Rayleigh-Taylor instability using high-resolution three-dimensional numerical simulations: The Alpha-Group collaboration , 2004 .

[6]  Boyce E. Griffith,et al.  A unified mathematical framework and an adaptive numerical method for fluid-structure interaction with rigid, deforming, and elastic bodies , 2013, J. Comput. Phys..

[7]  A. BarbaLorena,et al.  Lift and drag coefficient versus angle of attack for a flying snake cross-section , 2013 .

[8]  Edward N. Tinoco,et al.  Summary of Data from the Fifth Computational Fluid Dynamics Drag Prediction Workshop , 2014 .

[9]  J. Ioannidis.  Why Most Published Research Findings Are False , 2019, CHANCE.

[10]  Matthias Schwab,et al.  Making scientific computations reproducible , 2000, Comput. Sci. Eng..

[11]  J. Quirk.  A Contribution to the Great Riemann Solver Debate , 1994 .

[12]  Tim Colonius,et al.  The immersed boundary method: A projection approach , 2007, J. Comput. Phys..

[13]  E. C. Nelson,et al.  Early Computing at Los Alamos , 1982, Annals of the History of Computing.

[14]  C. Williamson.  Vortex Dynamics in the Cylinder Wake , 1996 .

[15]  Christopher L. Rumsey,et al.  Overview and Summary of the Second AIAA High-Lift Prediction Workshop , 2015 .

[16]  J. Brooks.  Why most published research findings are false: Ioannidis JP, Department of Hygiene and Epidemiology, University of Ioannina School of Medicine, Ioannina, Greece , 2008 .

[17]  Pavlos P. Vlachos,et al.  Lift and wakes of flying snakes , 2013, 1309.2969.

[18]  N. D. Cardwell,et al.  Aerodynamics of the flying snake Chrysopelea paradisi: how a bluff body cross-sectional shape contributes to gliding performance , 2014, Journal of Experimental Biology.

[19]  Limare Nicolas,et al.  Reproducible Research in Computational Science — Santiago 2013-04-15 , 2013 .