Deep Learning-Based Maximum Temperature Forecasting Assisted with Meta-Learning for Hyperparameter Optimization

Time series forecasting of meteorological variables such as daily temperature has recently drawn considerable attention from researchers to address the limitations of traditional forecasting models. However, a middle-range (e.g., 5–20 days) forecasting is an extremely challenging task to get reliable forecasting results from a dynamical weather model. Nevertheless, it is challenging to develop and select an accurate time-series prediction model because it involves training various distinct models to find the best among them. In addition, selecting an optimum topology for the selected models is important too. The accurate forecasting of maximum temperature plays a vital role in human life as well as many sectors such as agriculture and industry. The increase in temperature will deteriorate the highland urban heat, especially in summer, and have a significant influence on people’s health. We applied meta-learning principles to optimize the deep learning network structure for hyperparameter optimization. In particular, the genetic algorithm (GA) for meta-learning was used to select the optimum architecture for the network used. The dataset was used to train and test three different models, namely the artificial neural network (ANN), recurrent neural network (RNN), and long short-term memory (LSTM). Our results demonstrate that the hybrid model of an LSTM network and GA outperforms other models for the long lead time forecasting. Specifically, LSTM forecasts have superiority over RNN and ANN for 15-day-ahead in summer with the root mean square error (RMSE) value of 2.719 (°C).

[1]  Guoqiang Peter Zhang,et al.  An investigation of model selection criteria for neural network time series forecasting , 2001, Eur. J. Oper. Res..

[2]  Ozgur Kisi,et al.  Application of Heuristic Algorithms in Improving Performance of Soft Computing Models for Prediction of Min, Mean and Max Air Temperatures , 2019 .

[3]  A. Altunkaynak Forecasting Surface Water Level Fluctuations of Lake Van by Artificial Neural Networks , 2007 .

[4]  Jing Shi,et al.  On comparing three artificial neural networks for wind speed forecasting , 2010 .

[5]  S. Pryor,et al.  Downscaling temperature and precipitation: a comparison of regression‐based methods and artificial neural networks , 2001 .

[6]  Mohan Kolhe,et al.  GA-ANN for Short-Term Wind Energy Prediction , 2011, 2011 Asia-Pacific Power and Energy Engineering Conference.

[7]  S. Behera,et al.  Improving seasonal forecasts of air temperature using a genetic algorithm , 2019, Scientific Reports.

[8]  Bogdan Gabrys,et al.  Meta-learning for time series forecasting and forecast combination , 2010, Neurocomputing.

[9]  Pavel Kordík,et al.  Meta-learning approach to neural network optimization , 2010, Neural Networks.

[10]  Jan Nedoma,et al.  A Weather Forecast Model Accuracy Analysis and ECMWF Enhancement Proposal by Neural Network , 2019, Sensors.

[11]  H. K. Cigizoglu,et al.  Forecast of daily mean, maximum and minimum temperature time series by three artificial neural network methods , 2008 .

[12]  Ali Ouni,et al.  Optimal Deep Learning LSTM Model for Electric Load Forecasting using Feature Selection and Genetic Algorithm: Comparison with Machine Learning Approaches † , 2018, Energies.

[13]  Kyung-shik Shin,et al.  Genetic Algorithm-Optimized Long Short-Term Memory Network for Stock Market Prediction , 2018, Sustainability.

[14]  John D. Hunter,et al.  Matplotlib: A 2D Graphics Environment , 2007, Computing in Science & Engineering.

[15]  Bogdan Bochenek,et al.  Prediction of Air Temperature in the Polish Western Carpathian Mountains with the ALADIN-HIRLAM Numerical Weather Prediction System , 2019, Atmosphere.

[16]  Alaa El. Sagheer,et al.  Time series forecasting of petroleum production using deep LSTM recurrent networks , 2019, Neurocomputing.

[17]  Nitin K. Tripathi,et al.  An artificial neural network model for rainfall forecasting in Bangkok, Thailand , 2008 .

[18]  G. Mihalakakou,et al.  Modeling ambient air temperature time series using neural networks , 1998 .

[19]  J. Torres,et al.  Forecast of hourly average wind speed with ARMA models in Navarre (Spain) , 2005 .

[20]  Junyu Dong,et al.  Prediction of Sea Surface Temperature Using Long Short-Term Memory , 2017, IEEE Geoscience and Remote Sensing Letters.

[21]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[22]  G. Fallah Ghalhari,et al.  Forecasting Maximum Seasonal Temperature Using Artificial Neural Networks “Tehran Case Study” , 2019, Asia-Pacific Journal of Atmospheric Sciences.

[23]  Michael Y. Hu,et al.  Forecasting with artificial neural networks: The state of the art , 1997 .

[24]  Afan Galih Salman,et al.  Single Layer & Multi-layer Long Short-Term Memory (LSTM) Model with Intermediate Variables for Weather Forecasting , 2018 .

[25]  M. Malek,et al.  Suitability of ANN applied as a hydrological model coupled with statistical downscaling model: a case study in the northern area of Peninsular Malaysia , 2015, Environmental Earth Sciences.

[26]  Qing Cao,et al.  Forecasting wind speed with recurrent neural networks , 2012, Eur. J. Oper. Res..

[27]  Fi-John Chang,et al.  Evolutionary artificial neural networks for hydrological systems forecasting , 2009 .

[28]  Marc Parizeau,et al.  DEAP: evolutionary algorithms made easy , 2012, J. Mach. Learn. Res..