Weighted Multi-view Deep Neural Networks for Weather Forecasting

In multi-view regression the information from multiple representations of the input data is combined to improve the prediction. Inspired by the success of deep learning, this paper proposes a novel model called Weighted Multi-view Deep Neural Networks (MV-DNN) regression. The objective function used is a weighted version of the primal formulation of the existing Multi-View Least Squares Support Vector Machines method, where both the objectives from all different views, as well as the coupling term, are weighted. This work is motivated by the challenging application of weather forecasting. To predict the temperature, the weather variables from several previous days are taken into account. Each feature vector belonging to a previous day (delay) is regarded as a different view. Experimental results on the minimum and maximum temperature prediction in Brussels, reveal the merit of the weighting and show promising results when compared to existing the state-of-the-art methods in weather prediction.

[1]  H. Hotelling Relations Between Two Sets of Variates , 1936 .

[2]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[3]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[4]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[5]  Jeff A. Bilmes,et al.  Deep Canonical Correlation Analysis , 2013, ICML.

[6]  Sham M. Kakade,et al.  Multi-view clustering via canonical correlation analysis , 2009, ICML '09.

[7]  Peter Bauer,et al.  The quiet revolution of numerical weather prediction , 2015, Nature.

[8]  Johan A. K. Suykens,et al.  Multi-view LS-SVM regression for black-box temperature prediction in weather forecasting , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[9]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machines , 2002 .

[10]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[11]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[12]  Yu Zheng,et al.  Urban Water Quality Prediction Based on Multi-Task Multi-View Learning , 2016, IJCAI.

[13]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[14]  Jeff A. Bilmes,et al.  On Deep Multi-View Representation Learning , 2015, ICML.

[15]  Geoffrey E. Hinton What kind of graphical model is the brain? , 2005, IJCAI.

[16]  Johan A. K. Suykens,et al.  Deep Restricted Kernel Machines Using Conjugate Feature Duality , 2017, Neural Computation.

[17]  Shiliang Sun,et al.  Multi-view learning overview: Recent progress and new challenges , 2017, Inf. Fusion.