2-D Convolutional Deep Neural Network for the Multivariate Prediction of Photovoltaic Time Series

Here, we propose a new deep learning scheme to solve the energy time series prediction problem. The model implementation is based on the use of Long Short-Term Memory networks and Convolutional Neural Networks. These techniques are combined in such a fashion that inter-dependencies among several different time series can be exploited and used for forecasting purposes by filtering and joining their samples. The resulting learning scheme can be summarized as a superposition of network layers, resulting in a stacked deep neural architecture. We proved the accuracy and robustness of the proposed approach by testing it on real-world energy problems.

[1]  Kok Soon Tey,et al.  Forecasting of photovoltaic power generation and model optimization: A review , 2018 .

[2]  Peng Guo,et al.  A Review of Wind Power Forecasting Models , 2011 .

[3]  Heng Tao Shen,et al.  Beyond Frame-level CNN: Saliency-Aware 3-D CNN With LSTM for Video Action Recognition , 2017, IEEE Signal Processing Letters.

[4]  Houshang Darabi,et al.  Multivariate LSTM-FCNs for Time Series Classification , 2018, Neural Networks.

[5]  Christopher Heard,et al.  Wind Speed Prediction Using a Univariate ARIMA Model and a Multivariate NARX Model , 2016 .

[6]  Ping-Huan Kuo,et al.  A Deep CNN-LSTM Model for Particulate Matter (PM2.5) Forecasting in Smart Cities , 2018, Sensors.

[7]  Benjamin Schrauwen,et al.  Training and Analysing Deep Recurrent Neural Networks , 2013, NIPS.

[8]  Jaime Lloret,et al.  Artificial neural networks for short-term load forecasting in microgrids environment , 2014 .

[9]  Pavel Filonov,et al.  Multivariate Industrial Time Series with Cyber-Attack Simulation: Fault Detection Using an LSTM-based Predictive Data Model , 2016, ArXiv.

[10]  Soteris A. Kalogirou,et al.  Machine learning methods for solar radiation forecasting: A review , 2017 .

[11]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Amit Kumar Yadav,et al.  Solar radiation prediction using Artificial Neural Network techniques: A review , 2014 .

[13]  Mehmet Emre Çek,et al.  Analysis of observed chaotic data , 2004 .

[14]  Tara N. Sainath,et al.  Convolutional, Long Short-Term Memory, fully connected Deep Neural Networks , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[15]  Christof Weinhardt,et al.  Designing microgrid energy markets , 2018 .

[16]  Athanasios Sfetsos,et al.  Univariate and multivariate forecasting of hourly solar radiation with artificial intelligence techniques , 2000 .

[17]  Rafał Weron,et al.  Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs. multivariate modeling frameworks , 2018, 1805.06649.

[18]  Irena Koprinska,et al.  Univariate and multivariate methods for very short-term solar photovoltaic power forecasting , 2016 .

[19]  Weihong Deng,et al.  Learning temporal features using LSTM-CNN architecture for face anti-spoofing , 2015, 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR).

[20]  Christof Weinhardt,et al.  Designing microgrid energy markets A case study: The Brooklyn Microgrid , 2018 .

[21]  Paras Mandal,et al.  Demand response for sustainable energy systems: A review, application and implementation strategy , 2015 .

[22]  Jason Eisner,et al.  The Neural Hawkes Process: A Neurally Self-Modulating Multivariate Point Process , 2016, NIPS.

[23]  Jürgen Schmidhuber,et al.  Learning to Forget: Continual Prediction with LSTM , 2000, Neural Computation.

[24]  Juan José González de la Rosa,et al.  Weather forecasts for microgrid energy management: Review, discussion and recommendations , 2018, Applied Energy.

[25]  R. Urraca,et al.  Review of photovoltaic power forecasting , 2016 .

[26]  Consolación Gil,et al.  Optimization methods applied to renewable and sustainable energy: A review , 2011 .

[27]  Chongqing Kang,et al.  Modeling Conditional Forecast Error for Wind Power in Generation Scheduling , 2014, IEEE Transactions on Power Systems.

[28]  Jianfeng Zhao,et al.  Speech emotion recognition using deep 1D & 2D CNN LSTM networks , 2019, Biomed. Signal Process. Control..

[29]  Martin Singull,et al.  Forecasting Financial Time Series through Causal and Dilated Convolutional Neural Networks , 2020, Entropy.

[30]  Claudio A. Cañizares,et al.  Fuzzy Prediction Interval Models for Forecasting Renewable Resources and Loads in Microgrids , 2015, IEEE Transactions on Smart Grid.

[31]  Massimo Panella,et al.  Takagi-sugeno fuzzy systems applied to voltage prediction of photovoltaic plants , 2017, 2017 IEEE International Conference on Environment and Electrical Engineering and 2017 IEEE Industrial and Commercial Power Systems Europe (EEEIC / I&CPS Europe).

[32]  Massimo Panella,et al.  A Neural Network Based Prediction System of Distributed Generation for the Management of Microgrids , 2019, IEEE Transactions on Industry Applications.

[33]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[34]  Guy R. Newsham,et al.  The effect of utility time-varying pricing and load control strategies on residential summer peak electricity use: A review , 2010 .

[35]  Yuteng Xiao,et al.  A dual‐stage attention‐based Conv‐LSTM network for spatio‐temporal correlation and multivariate time series prediction , 2021, Int. J. Intell. Syst..

[36]  Sung Wook Baik,et al.  Action Recognition in Video Sequences using Deep Bi-Directional LSTM With CNN Features , 2018, IEEE Access.

[37]  Massimo Panella,et al.  Prediction in Photovoltaic Power by Neural Networks , 2017 .

[38]  Cyril Voyant,et al.  Optimization of an artificial neural network dedicated to the multivariate forecasting of daily glob , 2011 .

[39]  Massimo Panella,et al.  Neural Network Approaches to Electricity Price Forecastingly in Day-Ahead Markets , 2018, 2018 IEEE International Conference on Environment and Electrical Engineering and 2018 IEEE Industrial and Commercial Power Systems Europe (EEEIC / I&CPS Europe).

[40]  Dongxiao Niu,et al.  Short-term wind speed forecasting using wavelet transform and support vector machines optimized by genetic algorithm , 2014 .

[41]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[42]  Ha Young Kim,et al.  Forecasting stock prices with a feature fusion LSTM-CNN model using different representations of the same data , 2019, PloS one.

[43]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[44]  Massimo Panella,et al.  A Distributed Algorithm for the Cooperative Prediction of Power Production in PV Plants , 2019, IEEE Transactions on Energy Conversion.

[45]  Massimo Panella,et al.  A Smart Grid in Ponza Island: Battery Energy Storage Management by Echo State Neural Network , 2018, 2018 IEEE International Conference on Environment and Electrical Engineering and 2018 IEEE Industrial and Commercial Power Systems Europe (EEEIC / I&CPS Europe).

[46]  Nadeem Javaid,et al.  Load Prediction Based on Multivariate Time Series Forecasting for Energy Consumption and Behavioral Analytics , 2018, CISIS.

[47]  Anastasios G. Bakirtzis,et al.  Optimal Offering Strategy of a Virtual Power Plant: A Stochastic Bi-Level Approach , 2016, IEEE Transactions on Smart Grid.

[48]  See-Kiong Ng,et al.  Anomaly Detection with Generative Adversarial Networks for Multivariate Time Series , 2018, ArXiv.

[49]  Massimo Panella,et al.  Deep Neural Networks for Multivariate Prediction of Photovoltaic Power Time Series , 2020, IEEE Access.

[50]  Massimo Panella,et al.  Embedding of time series for the prediction in photovoltaic power plants , 2016, 2016 IEEE 16th International Conference on Environment and Electrical Engineering (EEEIC).

[51]  Duehee Lee,et al.  A multivariate time series forecast model for wind and storage integrated system operation , 2017, 2017 IEEE Power & Energy Society General Meeting.

[52]  Rahmat-Allah Hooshmand,et al.  A comprehensive review on microgrid and virtual power plant concepts employed for distributed energy resources scheduling in power systems , 2017 .