A hybrid CNN-LSTM model for typhoon formation forecasting

A typhoon is an extreme weather event that can cause huge loss of life and economic damage in coastal areas and beyond. As a consequence, the search for more accurate predictive models of typhoon formation; and, intensity have become imperative as meteorologists, governments, and other agencies seek to mitigate the impact of these catastrophic events. While work in this field has progressed diligently, this paper argues, that the existing models are deficient. Traditional numerical forecast models based on fluid mechanics have difficulty in predicting the intensity of typhoons. Forecasts based on statistics and machine learning fail to take into account the spatial and temporal relationships among typhoon formation variables leading to weaknesses in the predictive power of this model. Therefore, we propose a hybrid model, which we argue, can produce a more realist and accurate account of typhoon ‘behavior’ as it focuses on both the spatio-temporal correlations of atmospheric and oceanographic variables. Our CNN-LSTM model introduces 3D convolutional neural networks (3DCNN) and 2D convolutional neural networks (2DCNN) as a method to better understand the spatial relationships of the features of typhoon formation. We also use LSTM to examine the temporal sequence of relations in typhoon progression. Extensive experiments based on three datasets show that our hybrid CNN-LSTM model is superior to existing methods, including numerical forecast models used by many official organizations; and, statistical forecast and machine learning based methods.

[1]  Ke Zhang,et al.  A Short-Term Rainfall Prediction Model Using Multi-task Convolutional Neural Networks , 2017, 2017 IEEE International Conference on Data Mining (ICDM).

[2]  Christian S. Jensen,et al.  Efficient Online Summarization of Large-Scale Dynamic Networks , 2016, IEEE Transactions on Knowledge and Data Engineering.

[3]  James L. Franklin,et al.  National Hurricane Center forecast verification , 2008 .

[4]  Lorenzo Torresani,et al.  Learning Spatiotemporal Features with 3D Convolutional Networks , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[5]  Guoqi Qian,et al.  Variable Selection for Tropical Cyclogenesis Predictive Modeling , 2016 .

[6]  Manzhu Yu,et al.  Leveraging LSTM for rapid intensifications prediction of tropical cyclones , 2017 .

[7]  Brandon W. Kerns,et al.  Cloud Clusters and Tropical Cyclogenesis: Developing and Nondeveloping Systems and Their Large-Scale Environment , 2013 .

[8]  Kerry A. Emanuel,et al.  Use of a Genesis Potential Index to Diagnose ENSO Effects on Tropical Cyclone Genesis , 2007 .

[9]  Wei Zhang,et al.  Discriminating Developing versus Nondeveloping Tropical Disturbances in the Western North Pacific through Decision Tree Analysis , 2015 .

[10]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[11]  Wei Zhang,et al.  The application of decision tree to intensity change classification of tropical cyclones in western North Pacific , 2013 .

[12]  Ming Yang,et al.  3D Convolutional Neural Networks for Human Action Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Johnny C. L. Chan,et al.  A western North Pacific tropical cyclone intensity prediction scheme , 2011 .

[14]  Junyu Dong,et al.  A CFCC-LSTM Model for Sea Surface Temperature Prediction , 2018, IEEE Geoscience and Remote Sensing Letters.

[15]  Xin Xu,et al.  Large-scale gesture recognition with a fusion of RGB-D data based on the C3D model , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[16]  Min Zhang,et al.  A genesis potential index for Western North Pacific tropical cyclones by using oceanic parameters , 2016 .

[17]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[18]  Melinda S. Peng,et al.  Developing versus Nondeveloping Disturbances for Tropical Cyclone Formation. Part I: North Atlantic* , 2012 .

[19]  Hiroyuki Murakami,et al.  Effect of Model Resolution on Tropical Cyclone Climate Projections , 2010 .

[20]  Christopher C. Hennon,et al.  Forecasting Tropical Cyclogenesis over the Atlantic Basin Using Large-Scale Data , 2003 .

[21]  Qiang Qu,et al.  Dynamic collective routing using crowdsourcing data , 2016 .

[22]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[23]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[24]  Melinda S. Peng,et al.  Developing versus Nondeveloping Disturbances for Tropical Cyclone Formation. Part II: Western North Pacific* , 2012 .

[25]  Wang Yuan,et al.  A statistical prediction scheme of tropical cyclone intensity over the western North Pacific based on the partial least square regression , 2011 .

[26]  Alex Graves,et al.  Grid Long Short-Term Memory , 2015, ICLR.

[27]  Kevin Walsh,et al.  Forecasting Tropical Cyclone Formation in the Fiji Region: A Probit Regression Approach Using Bayesian Fitting , 2011 .

[28]  John A. Knaff,et al.  Objective Estimation of the 24-h Probability of Tropical Cyclone Formation , 2009 .

[29]  MA Lei-min,et al.  Research Progress on China typhoon numerical prediction models and associated major techniques , 2014 .

[30]  Siyuan Liu,et al.  Rationality Analytics from Trajectories , 2015, ACM Trans. Knowl. Discov. Data.

[31]  Siyuan Liu,et al.  Heterogeneous anomaly detection in social diffusion with discriminative feature discovery , 2018, Inf. Sci..

[32]  Yu Su,et al.  A New Data Mining Model for Hurricane Intensity Prediction , 2010, 2010 IEEE International Conference on Data Mining Workshops.

[33]  Juan Song,et al.  Learning Spatiotemporal Features Using 3DCNN and Convolutional LSTM for Gesture Recognition , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[34]  Trevor Darrell,et al.  Long-term recurrent convolutional networks for visual recognition and description , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).