Practices in source code sharing in astrophysics

Abstract While software and algorithms have become increasingly important in astronomy, the majority of authors who publish computational astronomy research do not share the source code they develop, making it difficult to replicate and reuse the work. In this paper we discuss the importance of sharing scientific source code with the entire astrophysics community, and propose that journals require authors to make their code publicly available when a paper is published. That is, we suggest that a paper that involves a computer program not be accepted for publication unless the source code becomes publicly available. The adoption of such a policy by editors, editorial boards, and reviewers will improve the ability to replicate scientific results, and will also make computational astronomy methods more available to other researchers who wish to apply them to their data.

[1]  Andrew Hopkins,et al.  The Completeness and Reliability of Threshold and False-discovery Rate Source Extraction Algorithms for Compact Continuum Sources , 2011, Publications of the Astronomical Society of Australia.

[2]  Darrel C. Ince,et al.  The case for open computer programs , 2012, Nature.

[3]  Alice Allen,et al.  Using the Astrophysics Source Code Library , 2013 .

[4]  Keith Shortridge,et al.  Bring out your codes! Bring out your codes! (Increasing Software Visibility and Re-use) , 2012, ArXiv.

[5]  Keith Shortridge Talking Amongst Ourselves - Communication in the Astronomical Software Community , 2009 .

[6]  Alice Allen,et al.  The Astrophysics Source Code Library: An Update , 2012 .

[7]  Lior Shamir,et al.  Practices in Code Discoverability , 2012 .

[8]  Nicolas Pinto,et al.  Why is Real-World Visual Object Recognition Hard? , 2008, PLoS Comput. Biol..

[9]  M. Brescia,et al.  Inside Catalogs: A Comparison of Source Extraction Software , 2012, 1212.0564.

[10]  Nicolas Pinto,et al.  How far can you get with a modern face recognition test set using only simple features? , 2009, CVPR.

[11]  A. J. Batista-Leyva,et al.  On the interpretation of , 2004 .

[12]  Tatiana Baidyk,et al.  Improved method of handwritten digit recognition tested on MNIST database , 2004, Image Vis. Comput..

[13]  Pietro Perona,et al.  One-shot learning of object categories , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Victoria Stodden,et al.  RunMyCode.org: A novel dissemination and collaboration platform for executing published computational results , 2012, 2012 IEEE 8th International Conference on E-Science.

[15]  Nick Barnes Publish your computer code: it is good enough , 2010, Nature.

[16]  Lior Shamir,et al.  Practices in Code Discoverability: Astrophysics Source Code Library , 2012 .

[17]  Niels Keiding,et al.  Reproducible research and the substantive context. , 2010, Biostatistics.

[18]  S. Goodman,et al.  Reproducible Research: Moving toward Research the Public Can Really Trust , 2007, Annals of Internal Medicine.

[19]  Lior Shamir,et al.  Evaluation of Face Datasets as Tools for Assessing the Performance of Face Recognition Methods , 2008, International Journal of Computer Vision.

[20]  E. Bertin,et al.  SExtractor: Software for source extraction , 1996 .

[21]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  K. Abazajian,et al.  THE SEVENTH DATA RELEASE OF THE SLOAN DIGITAL SKY SURVEY , 2008, 0812.0649.

[23]  L Shamir,et al.  Assessing the efficacy of low‐level image content descriptors for computer‐based fluorescence microscopy image analysis , 2011, Journal of microscopy.

[24]  Andy Harter,et al.  Parameterisation of a stochastic model for human face identification , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[25]  A. M. Burton,et al.  100% Accuracy in Automatic Face Recognition , 2008, Science.

[26]  Alison L. Coil,et al.  Astronomical Software Wants To Be Free: A Manifesto , 2009, 0903.3971.

[27]  Roger D Peng,et al.  Reproducible research and Biostatistics. , 2009, Biostatistics.

[28]  Ian M. Mitchell,et al.  Best Practices for Scientific Computing , 2012, PLoS biology.

[29]  L. Ho,et al.  Detailed structural decomposition of galaxy images , 2002, astro-ph/0204182.