Reproducible research in signal processing

What should we do to raise the quality of signal processing publications to an even higher level? We believe it to be crucial to maintain the precision in describing our work in publications, ensured through a high-quality reviewing process. We also believe that if the experiments are performed on a large data set, the algorithm is compared to the state-of-the-art methods, the code and/or data are well documented and available online, we will all benefit and make it easier to build upon each other's work. It is a clear win-win situation for our community: we will have access to more and more algorithms and can spend time inventing new things rather than recreating existing ones.

[1]  Donald E. Knuth,et al.  Literate Programming , 1984, Comput. J..

[2]  Jon F. Claerbout,et al.  Electronic documents give reproducible research a new meaning: 62nd Ann , 1992 .

[3]  David L. Donoho,et al.  WaveLab and Reproducible Research , 1995 .

[4]  Matthias Schwab,et al.  Making scientific computations reproducible , 2000, Comput. Sci. Eng..

[5]  S. Lawrence.  Free online availability substantially increases a paper's impact , 2001, Nature.

[6]  Hrishikesh D. Vinod,et al.  Care and feeding of reproducible econometrics , 2001 .

[7]  Friedrich Leisch,et al.  Sweave: Dynamic Generation of Statistical Reports Using Literate Data Analysis , 2002, COMPSTAT.

[8]  Sabine Süsstrunk,et al.  Superresolution images reconstructed from aliased images , 2003, Visual Communications and Image Processing.

[9]  Steve Hitchcock,et al.  The effect of open access and downloads ('hits') on citation impact: a bibliography of studies , 2004 .

[10]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[11]  Andrea Ridolfi.  Power spectra of random spikes and related complex signals , 2005 .

[12]  Fernando Pérez-González,et al.  Pushing Science into Signal Processing , 2005 .

[13]  M. Barni,et al.  Pushing science into signal processing [my turn] , 2005, IEEE Signal Processing Magazine.

[14]  Helen Pearson.  Image manipulation: CSI: cell biology , 2005, Nature.

[15]  Aykut Hocanin,et al.  An FIR Notch Filter for Adaptive Filtering of a Sinusoid in Correlated Noise , 2006, EURASIP J. Adv. Signal Process..

[16]  Sabine Süsstrunk,et al.  A Frequency Domain Approach to Registration of Aliased Images with Application to Super-resolution , 2006, EURASIP J. Adv. Signal Process..

[17]  Moe Z. Win,et al.  Ultrawide bandwidth signals as shot noise: a unifying approach , 2006, IEEE Journal on Selected Areas in Communications.

[18]  P. Vandewalle.  Super-resolution from unregistered aliased images , 2006 .

[19]  F. Dominici,et al.  Reproducible epidemiologic research. , 2006, American journal of epidemiology.

[20]  Tim Brody,et al.  Evaluating Research Impact through Open Access to Scholarly Communication , 2006 .

[21]  Jelena Kovacevic,et al.  A multiresolution approach to automated classification of protein subcellular location images , 2007, BMC Bioinformatics.

[22]  Johan A. K. Suykens,et al.  State-of-the-Art and Evolution in Public Data Sets and Competitions for System Identification, Time Series Prediction and Pattern Recognition , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[23]  Pina Marziliano,et al.  Reproducible Research: A Case Study of Sampling Signals with Finite Rate of Innovation , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[24]  Sergey Fomel,et al.  Reproducible Computational Experiments using Scons , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[25]  Fernando Pérez-González,et al.  Putting Reproducible Signal Processing into Practice: A Case Study in Watermarking , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[26]  Andrea Ridolfi,et al.  Experiences with Reproducible Research in Various Facets of Signal Processing Research , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[27]  Laurence Meylan,et al.  Model of retinal local adaptation for the tone mapping of color filter array images. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[28]  Jelena Kovacevic,et al.  How to Encourage and Publish Reproducible Research , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[29]  Heather A. Piwowar,et al.  Sharing Detailed Research Data Is Associated with Increased Citation Rate , 2007, PloS one.

[30]  Joos Vandewalle,et al.  Super-Resolution From Unregistered and Totally Aliased Signals Using Subspace Methods , 2007, IEEE Transactions on Signal Processing.

[31]  M. Vetterli,et al.  Groebner basis methods for multichannel sampling with unknown offsets , 2008 .

[32]  Achim Zeileis,et al.  On reproducible econometric research , 2009 .

[33]  Sergey Fomel,et al.  Guest Editors' Introduction: Reproducible Research , 2009, Comput. Sci. Eng..

[34]  Victoria Stodden,et al.  The Legal Framework for Reproducible Scientific Research: Licensing and Copyright , 2009, Computing in Science & Engineering.