A three-dimensional gap filling method for large geophysical datasets: Application to global satellite soil moisture observations

The presence of data gaps is always a concern in geophysical records, creating not only difficulty in interpretation but, more importantly, also a large source of uncertainty in data analysis. Filling the data gaps is a necessity for use in statistical modeling. There are numerous approaches for this purpose. However, particularly challenging are the increasing number of very large spatio-temporal datasets such as those from Earth observations satellites. Here we introduce an efficient three-dimensional method based on discrete cosine transforms, which explicitly utilizes information from both time and space to predict the missing values. To analyze its performance, the method was applied to a global soil moisture product derived from satellite images. We also executed a validation by introducing synthetic gaps. It is shown this method is capable of filling data gaps in the global soil moisture dataset with very high accuracy.

[1]  W. Wagner,et al.  Soil moisture from operational meteorological satellites , 2007 .

[2]  W. Wagner,et al.  An Intercomparison of ERS-Scat and AMSR-E Soil Moisture Observations with Model Simulations over France , 2009 .

[3]  Maria J. Diamantopoulou Filling gaps in diameter measurements on standing tree boles in the urban forest of Thessaloniki, Greece , 2010, Environ. Model. Softw..

[4]  Samuel Buis,et al.  Global sensitivity analysis measures the quality of parameter estimation: The case of soil parameters and a crop model , 2010, Environ. Model. Softw..

[5]  Damien Garcia,et al.  Robust smoothing of gridded data in one and higher dimensions with missing values , 2010, Comput. Stat. Data Anal..

[6]  R. Jeu,et al.  Multisensor historical climatology of satellite‐derived global land surface moisture , 2008 .

[7]  Klaus Fraedrich,et al.  Fluctuation regimes of soil moisture in ERA-40 re-analysis data , 2010 .

[8]  Tapio Schneider,et al.  Comment on "Spatio-temporal filling of missing points in geophysical data sets" by D. Kondrashov and M. Ghil, Nonlin. Processes Geophys., 13, 151-159, 2006 , 2007 .

[9]  Thomas R. H. Holmes,et al.  An evaluation of AMSR–E derived soil moisture over Australia , 2009 .

[10]  Michael Ghil,et al.  Spatio-temporal filling of missing points in geophysical data sets , 2006 .

[11]  Li Li,et al.  Global survey and statistics of radio-frequency interference in AMSR-E land observations , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Gift Dumedah,et al.  Evaluation of statistical methods for infilling missing values in high-resolution soil moisture data , 2011 .

[13]  S. Seneviratne,et al.  Investigating soil moisture-climate interactions in a changing climate: A review , 2010 .

[14]  Lifeng Luo,et al.  Contribution of land surface initialization to subseasonal forecast skill: First results from a multi‐model experiment , 2010 .

[15]  Damien Garcia,et al.  A fast all-in-one method for automated post-processing of PIV data , 2011, Experiments in fluids.

[16]  K. Hocke,et al.  Gap filling and noise reduction of unevenly sampled data by means of the Lomb-Scargle periodogram , 2008 .

[17]  W. Wagner,et al.  Global Soil Moisture Patterns Observed by Space Borne Microwave Radiometers and Scatterometers , 2008 .

[18]  J. Beckers,et al.  EOF Calculations and Data Filling from Incomplete Oceanographic Datasets , 2003 .

[19]  J. Beckers,et al.  Multivariate reconstruction of missing data in sea surface temperature, chlorophyll, and wind satellite fields , 2007 .