Transfer learning to improve streamflow forecasts in data sparse regions

Effective water resource management requires information on water availability – both in terms of quality and quantity spatially and temporally. In this paper, we study the methodology behind Transfer Learning (TL) through fine-tuning and parameter transferring for better generalization performance of streamflow prediction in data-sparse regions. We propose a standard recurrent neural network in the form of Long ShortTerm Memory (LSTM) to fit on a sufficiently large source domain dataset and repurpose the learned weights to a significantly smaller, yet similar target domain datasets. We present a methodology to implement transfer learning approaches for spatiotemporal applications by separating the spatial and temporal components of the model and training the model to generalize based on categorical datasets representing spatial variability. The framework is developed on a rich benchmark dataset from the US and evaluated on a smaller dataset collected by The Nature Conservancy in Kenya. The LSTM model exhibits generalization performance through our TL technique. Results from this current experiment demonstrate the effective predictive skill of forecasting streamflow responses when knowledge transferring and static descriptors are used to improve hydrologic model generalization in data-

[1]  Rico Sennrich,et al.  In Neural Machine Translation, What Does Transfer Learning Transfer? , 2020, ACL.

[2]  M. Butts,et al.  Flexible Integrated Watershed Modeling with MIKE SHE , 2005 .

[3]  G. S. Dwarakish,et al.  A Review on Hydrological Models , 2015 .

[4]  T. Gomi,et al.  A Review of SWAT Model Application in Africa , 2021, Water.

[5]  J. Kitheka,et al.  Assessment of the Influence of Rainfall and River Discharge on Sediment Yield in the Upper Tana Catchment in Kenya , 2017 .

[6]  Deniz Yuret,et al.  Transfer Learning for Low-Resource Neural Machine Translation , 2016, EMNLP.

[7]  Michael I. Jordan,et al.  Deep Transfer Learning with Joint Adaptation Networks , 2016, ICML.

[8]  Leonidas J. Guibas,et al.  Taskonomy: Disentangling Task Transfer Learning , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[9]  Freddy Lécué,et al.  Amsterdam to Dublin Eventually Delayed? LSTM and Transfer Learning for Predicting Delays of Low Cost Airlines , 2019, AAAI.

[10]  D. Lettenmaier,et al.  Water budget record from variable infiltration capacity (VIC) model , 2010 .

[11]  K. Schulz,et al.  LamaH | Large-Sample Data for Hydrology and Environmental Sciences for Central Europe , 2021 .

[12]  Scott N. Miller,et al.  Using the Soil and Water Assessment Tool (SWAT) to assess land use impact on water resources in an East African watershed , 2013 .

[13]  Jeffrey G. Arnold,et al.  The Soil and Water Assessment Tool: Historical Development, Applications, and Future Research Directions , 2007 .

[14]  Qun Dai,et al.  A novel transfer learning framework for time series forecasting , 2018, Knowl. Based Syst..

[15]  Martyn P. Clark,et al.  The CAMELS data set: catchment attributes and meteorology for large-sample studies , 2017 .

[16]  Bo Pang,et al.  Improving urban flood susceptibility mapping using transfer learning , 2021 .

[17]  Sepp Hochreiter,et al.  NeuralHydrology - Interpreting LSTMs in Hydrology , 2019, Explainable AI.

[18]  Sebastian Ruder,et al.  Universal Language Model Fine-tuning for Text Classification , 2018, ACL.

[19]  Gavriel Salomon,et al.  T RANSFER OF LEARNING , 1992 .

[20]  Impacts of Land Management Options in the Upper Tana, Kenya using the Soil and Water Assessment Tool - SWAT , 2011 .

[21]  A. Boretti,et al.  Reassessing the projections of the World Water Development Report , 2019, npj Clean Water.

[22]  Benjamin P. Bryant,et al.  Valuing investments in sustainable land management in the Upper Tana River basin, Kenya. , 2017, Journal of environmental management.

[23]  Germain Forestier,et al.  Transfer learning for time series classification , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[24]  Hoshin Vijai Gupta,et al.  Decomposition of the mean squared error and NSE performance criteria: Implications for improving hydrological modelling , 2009 .

[25]  J. Nash,et al.  River flow forecasting through conceptual models part I — A discussion of principles☆ , 1970 .

[26]  K. Chau,et al.  Predicting Standardized Streamflow index for hydrological drought using machine learning models , 2020 .

[27]  R. Srinivasan,et al.  Mitigating Economic Damage in Kenya's Upper Tana River Basin: An Application of Arc-View SWAT , 2007 .

[28]  Martyn P. Clark,et al.  Development of a large-sample watershed-scale hydrometeorological data set for the contiguous USA: data set characteristics and assessment of regional variability in hydrologic model performance , 2014 .

[29]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[30]  G. Nearing A Deep Learning Architecture for Conservative Dynamical Systems: Application to Rainfall-Runoff Modeling , 2020 .

[31]  S. Hochreiter,et al.  Toward Improved Predictions in Ungauged Basins: Exploiting the Power of Machine Learning , 2019, Water Resources Research.

[32]  Frederik Kratzert,et al.  What Role Does Hydrological Science Play in the Age of Machine Learning? , 2020, Water Resources Research.

[33]  Ming-Chang Wu,et al.  A physically based and machine learning hybrid approach for accurate rainfall-runoff modeling during extreme typhoon events , 2017, Appl. Soft Comput..

[34]  Kenny Q. Zhu,et al.  Transfer Learning for Traffic Speed Prediction: A Preliminary Study , 2018, AAAI Workshops.

[35]  Kuolin Hsu,et al.  Artificial Neural Network Modeling of the Rainfall‐Runoff Process , 1995 .

[36]  Raghavan Srinivasan,et al.  SWAT: Model Use, Calibration, and Validation , 2012 .

[37]  Vernon B. Sauer,et al.  Discharge Measurements at Gaging Stations , 2014 .