Spatial Scaling of Satellite Soil Moisture using Temporal Correlations and Ensemble Learning

A novel algorithm is developed to downscale soil moisture (SM), obtained at satellite scales of 10-40 km by utilizing its temporal correlations to historical auxiliary data at finer scales. Including such correlations drastically reduces the size of the training set needed, accounts for time-lagged relationships, and enables downscaling even in the presence of short gaps in the auxiliary data. The algorithm is based upon bagged regression trees (BRT) and uses correlations between high-resolution remote sensing products and SM observations. The algorithm trains multiple regression trees and automatically chooses the trees that generate the best downscaled estimates. The algorithm was evaluated using a multi-scale synthetic dataset in north central Florida for two years, including two growing seasons of corn and one growing season of cotton per year. The time-averaged error across the region was found to be 0.01 $\mathrm{m}^3/\mathrm{m}^3$, with a standard deviation of 0.012 $\mathrm{m}^3/\mathrm{m}^3$ when 0.02% of the data were used for training in addition to temporal correlations from the past seven days, and all available data from the past year. The maximum spatially averaged errors obtained using this algorithm in downscaled SM were 0.005 $\mathrm{m}^3/\mathrm{m}^3$, for pixels with cotton land-cover. When land surface temperature~(LST) on the day of downscaling was not included in the algorithm to simulate "data gaps", the spatially averaged error increased minimally by 0.015 $\mathrm{m}^3/\mathrm{m}^3$ when LST is unavailable on the day of downscaling. The results indicate that the BRT-based algorithm provides high accuracy for downscaling SM using complex non-linear spatio-temporal correlations, under heterogeneous micro meteorological conditions.

[1]  Wolfram Mauser,et al.  On the Disaggregation of Passive Microwave Soil Moisture Data Using A Priori Knowledge of Temporally Persistent Soil Moisture Fields , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Jasmeet Judge,et al.  Assimilation of SMOS Soil Moisture for Quantifying Drought Impacts on Crop Yield in Agricultural Regions , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[3]  Michael A Babyak,et al.  What You See May Not Be What You Get: A Brief, Nontechnical Introduction to Overfitting in Regression-Type Models , 2004, Psychosomatic medicine.

[4]  Ahmad Al Bitar,et al.  Self-calibrated evaporation-based disaggregation of SMOS soil moisture: An evaluation study at 3 km and 100 m resolution in Catalunya, Spain , 2013 .

[5]  Ruiliang Pu,et al.  Downscaling Thermal Infrared Radiance for Subpixel Land Surface Temperature Retrieval , 2008, Sensors.

[6]  Rajat Bindlish,et al.  Subpixel variability of remotely sensed soil moisture: an inter-comparison study of SAR and ESTAR , 2002, IEEE Trans. Geosci. Remote. Sens..

[7]  Sanjay Ranka,et al.  Downscaling microwave brightness temperatures using self regularized regressive models , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[8]  Sanjay Ranka,et al.  Disaggregation of Remotely Sensed Soil Moisture in Heterogeneous Landscapes Using Holistic Structure-Based Models , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[9]  A. Kalra,et al.  Estimating soil moisture using remote sensing data: A machine learning approach , 2010 .

[10]  Jeffrey P. Walker,et al.  Towards deterministic downscaling of SMOS soil moisture using MODIS derived soil evaporative efficiency , 2008 .

[11]  Jasmeet Judge,et al.  Downscaling Satellite-Based Soil Moisture in Heterogeneous Regions Using High-Resolution Remote Sensing Products and Information Theory: A Synthetic Study , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Subimal Ghosh,et al.  Statistical downscaling of GCM simulations to streamflow using relevance vector machine , 2008 .

[13]  Terri S. Hogue,et al.  Improving Spatial Soil Moisture Representation Through Integration of AMSR-E and MODIS Products , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Matthew F. McCabe,et al.  Scaling characteristics of spatial patterns of soil moisture from distributed modelling , 2007 .

[15]  Adriano Camps,et al.  A Downscaling Approach for SMOS Land Observations: Evaluation of High-Resolution Soil Moisture Maps Over the Iberian Peninsula , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[16]  J. Privette,et al.  Early spatial and temporal validation of MODIS LAI product in the Southern Africa Kalahari , 2002 .

[17]  Jasmeet Judge,et al.  Spatial Scaling and Variability of Soil Moisture Over Heterogeneous Land Cover and Dynamic Vegetation Conditions , 2013, IEEE Geoscience and Remote Sensing Letters.

[18]  W. Crow,et al.  The assimilation of remotely sensed soil brightness temperature imagery into a land surface model using Ensemble Kalman filtering: a case study based on ESTAR measurements during SGP97 , 2003 .

[19]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[20]  Andrew S. Jones,et al.  A method to downscale soil moisture to fine resolutions using topographic, vegetation, and soil data , 2015 .

[21]  C. Frey,et al.  Two algorithms to fill cloud gaps in LST time series , 2013 .

[22]  W. Brutsaert On a derivable formula for long-wave radiation from clear skies , 1975 .

[23]  Giacomo Bertoldi,et al.  Nonlinear Processes in Geophysics On the scaling characteristics of observed and simulated spatial soil moisture fields , 2009 .

[24]  S. Miller,et al.  Spaceborne soil moisture estimation at high resolution: a microwave-optical/IR synergistic approach , 2003 .

[25]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[26]  I. Narsky,et al.  Statistical Analysis Techniques in Particle Physics: Fits, Density Estimation and Supervised Learning , 2013 .

[27]  Wade T. Crow,et al.  The Value of Coarse-Scale Soil Moisture Observations for Regional Surface Energy Balance Modeling , 2002 .

[28]  Chunlin Huang,et al.  Retrieving soil temperature profile by assimilating MODIS LST products with ensemble Kalman filter , 2008 .

[29]  Dawei Han,et al.  Machine Learning Techniques for Downscaling SMOS Satellite Soil Moisture Using MODIS Land Surface Temperature for Hydrological Application , 2013, Water Resources Management.

[30]  T. Schneider,et al.  Downscaling Advanced Microwave Scanning Radiometer (AMSR-E) SoilMoisture Retrievals Using a Multiple Time-Scale Exponential RainfallAdjustment Technique , 2015 .

[31]  Ahmad Al Bitar,et al.  Copula-Based Downscaling of Coarse-Scale Soil Moisture Observations With Implicit Bias Correction , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[33]  Yann Kerr,et al.  Downscaling SMOS-Derived Soil Moisture Using MODIS Visible/Infrared Data , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Gwangseob Kim,et al.  Space-time characterization of soil moisture from passive microwave remotely sensed imagery and ancillary data , 2002 .