Fusion of Sentinel-2 and PlanetScope time-series data into daily 3 m surface reflectance and wheat LAI monitoring

Abstract The dynamics of Leaf Area Index (LAI) from space is key to identify crop types and their phenology over large areas, and to characterize spatial variations within growers’ fields. However, for years remote-sensing applications have been constrained by a trade-off between the spatial and temporal resolutions. This study resolves this limitation. Over the past decade, the number of companies and organizations developing CubeSat constellations has increased. These new satellites make it possible to acquire large image collections at high spatial and temporal resolutions at a relatively low cost. However, the images obtained from CubeSat constellations frequently suffer from inconsistency in the data calibration between the different satellites within the constellation. To overcome these inconsistencies, a new method to fuse a time series of images sourced from two different satellite constellations is proposed, combining the advantages of both (i.e., the temporal, spatial and spectral resolution). This new technique was applied to fuse PlanetScope images with Sentinel-2 images, to create spectrally-consistent daily images of wheat LAI at a 3 m resolution. The daily 3 m LAI estimations were compared with 57 in-situ wheat LAI measurements taken in Australia and Israel. This approach was demonstrated to successfully estimate Green LAI (LAI before the major on-set of leaf senescence) with an R 2 of 0.94 and 86% relative accuracy (RMSE of 1.37) throughout the growing season without using any ground calibration. However, both the Sentinel-2 based estimates and the fused Green LAI were underestimated at high LAI values (LAI > 3). To account for this, regression models were developed, improving the relative accuracy of the Green LAI estimations by up to a further 47% (RMSE of 0.35–0.63) in comparison with field measured LAI. The new time series fusion method is an effective tool for continuous daily monitoring of crops at high-resolution over large scales, which opens up a range of new precision agriculture applications. These high spatio-temporal resolution time-series are valuable for monitoring crop growth and health, and can improve the effectiveness of farming practices and enhance yield forecasts at the field and sub-field scales.

[1]  D. Lobell,et al.  Towards fine resolution global maps of crop yields: Testing multiple methods and satellites in three countries , 2017 .

[2]  Feng Gao,et al.  Daily Mapping of 30 m LAI and NDVI for Grape Yield Prediction in California Vineyards , 2017, Remote. Sens..

[3]  D. Lobell,et al.  A scalable satellite-based crop yield mapper , 2015 .

[4]  C. Jordan Derivation of leaf-area index from quality of light on the forest floor , 1969 .

[5]  Xuan Zhu,et al.  Sowing date detection at the field scale using CubeSats remote sensing , 2019, Comput. Electron. Agric..

[6]  E. Kanemasu,et al.  Leaf Area Index Estimates for Wheat from LANDSAT and Their Implications for Evapotranspiration and Crop Modeling1 , 1979 .

[7]  Andrew E. Suyker,et al.  A Two-Step Filtering approach for detecting maize and soybean phenology with time-series MODIS data , 2010 .

[8]  A. Viña,et al.  Green leaf area index estimation in maize and soybean: Combining vegetation indices to achieve maximal sensitivity , 2012 .

[9]  Heather McNairn,et al.  Validation of the Sentinel Simplified Level 2 Product Prototype Processor (SL2P) for mapping cropland biophysical variables using Sentinel-2/MSI and Landsat-8/OLI data , 2019, Remote Sensing of Environment.

[10]  A. Gitelson,et al.  Estimating green LAI in four crops: Potential of determining optimal spectral bands for a universal algorithm , 2014 .

[11]  Nicholas Leach,et al.  Normalization method for multi-sensor high spatial and temporal resolution satellite imagery with radiometric inconsistencies , 2019, Comput. Electron. Agric..

[12]  Jiali Shang,et al.  Assessment of red-edge vegetation indices for crop leaf area index estimation , 2019, Remote Sensing of Environment.

[13]  Jianxi Huang,et al.  Improving the timeliness of winter wheat production forecast in the United States of America, Ukraine and China using MODIS data and NCAR Growing Degree Day information , 2015 .

[14]  C. Daughtry,et al.  Spectral estimates of absorbed radiation and phytomass production in corn and soybean canopies , 1992 .

[15]  Hao He,et al.  A Changing-Weight Filter Method for Reconstructing a High-Quality NDVI Time Series to Preserve the Integrity of Vegetation Phenology , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Frédéric Baret,et al.  Albedo and LAI estimates from FORMOSAT-2 data for crop monitoring , 2009 .

[17]  A. Gitelson,et al.  Spectral reflectance changes associated with autumn senescence of Aesculus hippocastanum L. and Acer platanoides L. leaves. Spectral features and relation to chlorophyll estimation , 1994 .

[18]  I. Herrmann,et al.  LAI assessment of wheat and potato crops by VENμS and Sentinel-2 bands , 2011 .

[19]  D. Medak,et al.  FUSION OF SENTINEL-2 AND PLANETSCOPE IMAGERY FOR VEGETATION DETECTION AND MONITORING , 2018, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[20]  Estimating leaf-area index of wheat with LANDSAT data , 1979 .

[21]  A. Viña,et al.  Remote estimation of leaf area index and green leaf biomass in maize canopies , 2003 .

[22]  M. Gašparović,et al.  The effect of fusing Sentinel-2 bands on land-cover classification , 2018 .

[23]  Anatoly A. Gitelson,et al.  Application of chlorophyll-related vegetation indices for remote estimation of maize productivity , 2011 .

[24]  J. Clevers,et al.  Application of the WDVI in estimating LAI at the generative stage of barley , 1991 .

[25]  D. Lobell,et al.  Improving the accuracy of satellite-based high-resolution yield estimation: A test of multiple scalable approaches , 2017 .

[26]  Eric Price,et al.  LAI-2200C Plant Canopy Analyzer , 2014 .

[27]  E. V. Lukina,et al.  Improving Nitrogen Use Efficiency in Cereal Grain Production with Optical Sensing and Variable Rate Application , 2002 .

[28]  James Hansen,et al.  Assimilation of remotely sensed soil moisture and vegetation with a crop simulation model for maize yield prediction , 2013 .

[29]  Jan G. P. W. Clevers,et al.  Using Sentinel-2 Data for Retrieving LAI and Leaf and Canopy Chlorophyll Content of a Potato Crop , 2017, Remote. Sens..

[30]  Emmanouil Psomiadis,et al.  Evaluation and cross-comparison of vegetation indices for crop monitoring from sentinel-2 and worldview-2 images , 2017, Remote Sensing.

[31]  Jan G. P. W. Clevers,et al.  Experimental Sentinel-2 LAI estimation using parametric, non-parametric and physical retrieval methods - A comparison , 2015 .

[32]  Mehrez Zribi,et al.  Integration of remote sensing derived parameters in crop models: Application to the PILOTE model for hay production , 2016 .

[33]  Yaoliang Chen,et al.  Mapping water-logging damage on winter wheat at parcel level using high spatial resolution satellite data , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[34]  Jianxi Huang,et al.  Jointly Assimilating MODIS LAI and ET Products Into the SWAP Model for Winter Wheat Yield Estimation , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[35]  Matthew F. McCabe,et al.  A Spatio-Temporal Enhancement Method for medium resolution LAI (STEM-LAI) , 2016, Int. J. Appl. Earth Obs. Geoinformation.

[36]  François Waldner,et al.  High temporal resolution of leaf area data improves empirical estimation of grain yield , 2019, Scientific Reports.

[37]  José Moreno,et al.  Multi-Crop Green LAI Estimation with a New Simple Sentinel-2 LAI Index (SeLI) , 2019, Sensors.

[38]  Laura F. Gentry,et al.  Deriving high-spatiotemporal-resolution leaf area index for agroecosystems in the U.S. Corn Belt using Planet Labs CubeSat and STAIR fusion data , 2020 .

[39]  Charlotte Bay Hasager,et al.  Incorporating remote sensing data in physically based distributed agro-hydrological modelling , 2004 .

[40]  R. Sahoo,et al.  Field scale wheat LAI retrieval from multispectral Sentinel 2A-MSI and LandSat 8-OLI imagery: effect of atmospheric correction, image resolutions and inversion techniques , 2019, Geocarto International.

[41]  D. Browning,et al.  Effect of spatial image support in detecting long-term vegetation change from satellite time-series , 2016, Landscape Ecology.

[42]  D. Watson Comparative Physiological Studies on the Growth of Field Crops: I. Variation in Net Assimilation Rate and Leaf Area between Species and Varieties, and within and between Years , 1947 .

[43]  Frédéric Baret,et al.  Vegetation baseline phenology from kilometric global LAI satellite products , 2016 .

[44]  A. Huete,et al.  Development of a two-band enhanced vegetation index without a blue band , 2008 .

[45]  S. Leblanc,et al.  Derivation and validation of Canada-wide coarse-resolution leaf area index maps using high-resolution satellite imagery and ground measurements , 2002 .

[46]  Jian Peng,et al.  STAIR: A generic and fully-automated method to fuse multiple sources of optical satellite data to generate a high-resolution, daily and cloud-/gap-free surface reflectance product , 2018, Remote Sensing of Environment.

[47]  Ying Wang,et al.  Generating Red-Edge Images at 3 M Spatial Resolution by Fusing Sentinel-2 and Planet Satellite Products , 2019, Remote. Sens..

[48]  A. Huete,et al.  A Modified Soil Adjusted Vegetation Index , 1994 .

[49]  Feng Gao,et al.  Simple method for retrieving leaf area index from Landsat using MODIS leaf area index products as reference , 2012 .

[50]  Enrico Cadau,et al.  SENTINEL-2 SEN2COR: L2A Processor for Users , 2016 .

[51]  A. Viña,et al.  Comparison of different vegetation indices for the remote assessment of green leaf area index of crops , 2011 .

[52]  A. Viña,et al.  Remote estimation of canopy chlorophyll content in crops , 2005 .

[53]  John R. Miller,et al.  Hyperspectral vegetation indices and novel algorithms for predicting green LAI of crop canopies: Modeling and validation in the context of precision agriculture , 2004 .

[54]  Robert E. Wolfe,et al.  A 30+ year AVHRR Land Surface Reflectance Climate Data Record and its application to wheat yield monitoring , 2017, Remote. Sens..

[55]  Matthew F. McCabe,et al.  A hybrid training approach for leaf area index estimation via Cubist and random forests machine-learning , 2018 .

[56]  Najib Djamai,et al.  Comparison of SNAP-Derived Sentinel-2A L2A Product to ESA Product over Europe , 2018, Remote. Sens..

[57]  Limin Wang,et al.  Mapping crop phenology using NDVI time-series derived from HJ-1 A/B data , 2015, Int. J. Appl. Earth Obs. Geoinformation.

[58]  José F. Moreno,et al.  rown and green LAI mapping through spectral indices , 2014 .

[59]  Matthew F. McCabe,et al.  High-Resolution NDVI from Planet's Constellation of Earth Observing Nano-Satellites: A New Data Source for Precision Agriculture , 2016, Remote. Sens..

[60]  Ning Jin,et al.  The Effect of NDVI Time Series Density Derived from Spatiotemporal Fusion of Multisource Remote Sensing Data on Crop Classification Accuracy , 2019, ISPRS Int. J. Geo Inf..

[61]  Mathew R. Schwaller,et al.  On the blending of the Landsat and MODIS surface reflectance: predicting daily Landsat surface reflectance , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[62]  R. Houborg,et al.  A Cubesat enabled Spatio-Temporal Enhancement Method (CESTEM) utilizing Planet, Landsat and MODIS data , 2018 .

[63]  J. Roujean,et al.  Estimating PAR absorbed by vegetation from bidirectional reflectance measurements , 1995 .

[64]  Frédéric Baret,et al.  Deforestation in Michoacan, Mexico, From CYCLOPES-LAI Time Series (2000–2006) , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[65]  Stephen V. Stehman,et al.  Evaluating Landsat and RapidEye Data for Winter Wheat Mapping and Area Estimation in Punjab, Pakistan , 2018, Remote. Sens..

[66]  Matthew F. McCabe,et al.  Daily Retrieval of NDVI and LAI at 3 m Resolution via the Fusion of CubeSat, Landsat, and MODIS Data , 2018, Remote. Sens..

[67]  Matthias Drusch,et al.  Sentinel-2: ESA's Optical High-Resolution Mission for GMES Operational Services , 2012 .

[68]  J. A. Schell,et al.  Monitoring vegetation systems in the great plains with ERTS , 1973 .

[69]  G. Rondeaux,et al.  Optimization of soil-adjusted vegetation indices , 1996 .

[70]  J. G. White,et al.  Aerial Color Infrared Photography for Determining Early In‐Season Nitrogen Requirements in Corn , 2005 .

[71]  A. Gitelson Wide Dynamic Range Vegetation Index for remote quantification of biophysical characteristics of vegetation. , 2004, Journal of plant physiology.

[72]  David B. Lobell,et al.  Mapping Smallholder Wheat Yields and Sowing Dates Using Micro-Satellite Data , 2016, Remote. Sens..

[73]  Frédéric Baret,et al.  An Overview of Global Leaf Area Index (LAI): Methods, Products, Validation, and Applications , 2019, Reviews of Geophysics.