Insights into CODE-DE – Germany’s Copernicus data and exploitation platform

ABSTRACT This article presents and analyses the modular architecture and capabilities of CODE-DE (Copernicus Data and Exploitation Platform – Deutschland, www.code-de.org), the integrated German operational environment for accessing and processing Copernicus data and products, as well as the methodology to establish and operate the system. Since March 2017, CODE-DE has been online with access to Sentinel-1 and Sentinel-2 data, to Sentinel-3 data shortly after this time, and since March 2019 with access to Sentinel-5P data. These products are available and accessed by 1,682 registered users as of March 2019. During this period 654,895 products were downloaded and a global catalogue was continuously updated, featuring a data volume of 814 TByte based on a rolling archive concept supported by a reload mechanism from a long-term archive. Since November 2017, the element for big data processing has been operational, where registered users can process and analyse data themselves specifically assisted by methods for value-added product generation. Utilizing 195,467 core and 696,406 memory hours, 982,948 products of different applications were fully automatically generated in the cloud environment and made available as of March 2019. Special features include an improved visualization of available Sentinel-2 products, which are presented within the catalogue client at full 10 m resolution.

[1]  C. Woodcock,et al.  Improvement and expansion of the Fmask algorithm: cloud, cloud shadow, and snow detection for Landsats 4–7, 8, and Sentinel 2 images , 2015 .

[2]  Zhongmei Zhang,et al.  Application research of Hadoop resource monitoring system based on Ganglia and Nagios , 2013, 2013 IEEE 4th International Conference on Software Engineering and Service Science.

[3]  Ferran Gascon,et al.  Sen2Cor for Sentinel-2 , 2017, Remote Sensing.

[4]  Holger Daedelow,et al.  RapidEye Science Archive: Remote Sensing Data for the German Scientific Community , 2013 .

[5]  Luc Filion,et al.  Using Atlassian tools for efficient requirements management: An industrial case study , 2017, 2017 Annual IEEE International Systems Conference (SysCon).

[6]  Carsten Brockmann,et al.  Calvalus: Full-mission EO cal/val, processing and exploitation services , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[7]  Peter Baumann,et al.  rasdaman: Spatio-temporal datacubes on steroids , 2018, SIGSPATIAL/GIS.

[8]  Bringfried Pflug,et al.  Validation of a new atmospheric correction software using AERONET reference data PACO: Python-based Atmospheric COrrection , 2018 .

[9]  Klaus Dengler,et al.  The EOC Geoservice: Standardized Access to Earth Observation Data Sets and Value Added Products , 2013 .

[10]  Tobias Storch,et al.  Towards a critical design of an operational ground segment for an Earth observation mission , 2013 .

[11]  Michael Eineder,et al.  DLR’s Activities to Support the GEO Supersite Initiative with TerraSAR-X Data , 2011 .

[12]  Stephan Kiemle,et al.  Big data management in Earth Observation: the German Satellite Data Archive at DLR , 2014 .

[13]  Hairong Kuang,et al.  The Hadoop Distributed File System , 2010, 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST).

[14]  Annoni Alessandro,et al.  INSPIRE: An Innovative Approach to the Development of Spatial Data Infrastructures in Europe Concepts , 2007 .

[15]  E. Mikusch,et al.  SRTM/X-SAR: products and processing facility , 2001, IGARSS 2001. Scanning the Present and Resolving the Future. Proceedings. IEEE 2001 International Geoscience and Remote Sensing Symposium (Cat. No.01CH37217).

[16]  Josef Aschbacher,et al.  ESA’s Earth Observation Strategy and Copernicus , 2017 .

[17]  Thomas Esch,et al.  Exploiting big earth data from space – first experiences with the timescan processing chain , 2018 .

[18]  Matthias Drusch,et al.  Sentinel-2: ESA's Optical High-Resolution Mission for GMES Operational Services , 2012 .

[19]  P. Kempeneers,et al.  Optimizing Sentinel-2 image selection in a Big Data context , 2017 .

[20]  Tobias Storch,et al.  Code-De - the German Operational Environment for Accessing and Processing Copernicus Sentinel Products , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[21]  Derek Rogge,et al.  Building an exposed soil composite processor (SCMaP) for mapping spatial and temporal characteristics of soils with Landsat imagery (1984–2014) , 2018 .

[22]  Natascha Oppelt,et al.  Multi-sensor satellite and in situ monitoring of phytoplankton development in a eutrophic-mesotrophic lake. , 2018, The Science of the total environment.

[23]  Barbara Borgia,et al.  Open Source DataHubSystem: from Sentinels data access to an agnostic data distribution tool , 2018 .

[24]  Peter Regner,et al.  SNAP (Sentinel Application Platform) and the ESA Sentinel 3 Toolbox , 2015 .

[25]  Christoph Reck,et al.  German Copernicus Data Access and Exploitation Platform , 2016 .

[26]  Tobias Storch,et al.  The German Copernicus Data and Exploitation platform "CODE-DE" - online data access and big data processing , 2018 .

[27]  Denisa Rodila,et al.  Building an Earth Observations Data Cube: lessons learned from the Swiss Data Cube (SDC) on generating Analysis Ready Data (ARD) , 2017 .

[28]  Gerhard Triebnig,et al.  Land Monitoring Network Services based on international geospatial standards: SOSI and geoland2/SDI Projects , 2010, Int. J. Digit. Earth.