Using the IPOL Journal for Online Reproducible Research in Remote Sensing

Reproducible research is needed to ensure that scientific results in the literature are reliable, unbiased, and verifiable by others. The journal Image Processing On Line (IPOL) publishes reproducible articles since 2010. This means publishing an algorithm by a literary description, a pseudocode, its source code, a series of test examples, an online facility allowing to test the code on this data and other data submitted by the user, and finally an experimental archive. In this work, we discuss how to publish and review reproducible research in the specific discipline of remote sensing. We put a special emphasis on the construction and proper documentation of public datasets. We show case studies of remote sensing articles publicly available in IPOL, which demonstrate the feasibility of reproducible research in this area. The methods and their application are explained, along with details on how the datasets were built and made available for evaluation, comparison, and scoring to eventually help establish a reliable state-of-the-art of the discipline. Finally, we give specific recommendations for authors and editors willing to publish reproducible research in remote sensing.

[1]  Hassan Foroosh,et al.  Extension of phase correlation to subpixel registration , 2002, IEEE Trans. Image Process..

[2]  Sidharth Misra,et al.  L-Band RFI as Experienced During Airborne Campaigns in Preparation for SMOS , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Luis Guanter,et al.  Ready-to-Use Methods for the Detection of Clouds, Cirrus, Snow, Shadow, Water and Clear Sky Pixels in Sentinel-2 MSI Images , 2016, Remote. Sens..

[4]  Natalia Manola,et al.  An Infrastructure for Managing EC Funded Research Output: The OpenAIRE Project , 2010 .

[5]  Sergey Fomel,et al.  Guest Editors' Introduction: Reproducible Research , 2009, Comput. Sci. Eng..

[6]  Jean-Michel Morel,et al.  International Conference on Computational Science , ICCS 2011 The IPOL Initiative : Publishing and Testing Algorithms on Line for Reproducible Research in Image Processing , 2011 .

[7]  David L Donoho,et al.  An invitation to reproducible computational research. , 2010, Biostatistics.

[8]  Pascal Monasse,et al.  The IPOL Demo System: A Scalable Architecture of Microservices for Reproducible Research , 2016, RRPR@ICPR.

[9]  Carl Boettiger,et al.  An introduction to Docker for reproducible research , 2014, OPSR.

[10]  Thibaud Briand,et al.  Optimization of Image B-spline Interpolation for GPU Architectures , 2019, Image Process. Line.

[11]  Timo Balz,et al.  Reproducibility and Replicability in SAR Remote Sensing , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[12]  James D. Herbsleb,et al.  Ecosystem-level determinants of sustained activity in open-source projects: a case study of the PyPI ecosystem , 2018, ESEC/SIGSOFT FSE.

[13]  Jean-Michel Morel,et al.  Farman Institute 3D Point Sets - High Precision 3D Data Sets , 2011, Image Process. Line.

[14]  Pascal Monasse,et al.  IPOL: A new journal for fully reproducible research; analysis of four years development , 2015, NTMS.

[15]  Daniel J. Blankenberg,et al.  Galaxy: a platform for interactive large-scale genome analysis. , 2005, Genome research.

[16]  Jean-Michel Morel,et al.  RELATIVE RADIOMETRIC NORMALIZATION USING SEVERAL AUTOMATICALLY CHOSEN REFERENCE IMAGES FOR MULTI-SENSOR, MULTI-TEMPORAL SERIES , 2020 .

[17]  Nicolas Vayatis,et al.  A Data Set for the Study of Human Locomotion with Inertial Measurements Units , 2019, Image Process. Line.

[18]  Rafael Grompone von Gioi,et al.  Temporal Repetition Detector for Time Series of Spectrally Limited Satellite Imagers , 2020, Image Process. Line.

[19]  Alejandro C. Frery,et al.  A Badging System for Reproducibility and Replicability in Remote Sensing Research , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[20]  Miguel Colom,et al.  Extending IPOL to New Data Types and Machine-Learning Applications , 2018, RRPR.

[21]  Bertrand Kerautret,et al.  An Overview of Platforms for Reproducible Research and Augmented Publications , 2018, RRPR.