Synergy of Sentinel-1 and Sentinel-2 Time Series for Cloud-Free Vegetation Water Content Mapping with Multi-Output Gaussian Processes

Optical Earth Observation is often limited by weather conditions such as cloudiness. Radar sensors have the potential to overcome these limitations, however, due to the complex radar-surface interaction, the retrieving of crop biophysical variables using this technology remains an open challenge. Aiming to simultaneously benefit from the optical domain background and the all-weather imagery provided by radar systems, we propose a data fusion approach focused on the cross-correlation between radar and optical data streams. To do so, we analyzed several multiple-output Gaussian processes (MOGP) models and their ability to fuse efficiently Sentinel-1 (S1) Radar Vegetation Index (RVI) and Sentinel-2 (S2) vegetation water content (VWC) time series over a dry agri-environment in southern Argentina. MOGP models not only exploit the auto-correlations of S1 and S2 data streams independently but also the inter-channel cross-correlations. The S1 RVI and S2 VWC time series at the selected study sites being the inputs of the MOGP models proved to be closely correlated. Regarding the set of assessed models, the Convolutional Gaussian model (CONV) delivered noteworthy accurate data fusion results over winter wheat croplands belonging to the 2020 and 2021 campaigns (NRMSEwheat2020 = 16.1%; NRMSEwheat2021 = 10.1%). Posteriorly, we removed S2 observations from the S1 & S2 dataset corresponding to the complete phenological cycles of winter wheat from September to the end of December to simulate the presence of clouds in the scenes and applied the CONV model at the pixel level to reconstruct spatiotemporally-latent VWC maps. After applying the fusion strategy, the phenology of winter wheat was successfully recovered in the absence of optical data. Strong correlations were obtained between S2 VWC and S1 & S2 MOGP VWC reconstructed maps for the assessment dates (R2¯wheat−2020 = 0.95, R2¯wheat−2021 = 0.96). Altogether, the fusion of S1 SAR and S2 optical EO data streams with MOGP offers a powerful innovative approach for cropland trait monitoring over cloudy high-latitude regions.