Assessment of Deep Learning techniques for Prognosis of solar thermal systems

Abstract Solar Hot Water (SHW) systems are a sustainable and renewable alternative for domestic and low-temperature industrial applications. As solar energy is a variable resource, performance prediction methods are useful tools to increase the overall availability and effective use of these systems. Recently, data-driven techniques have been successfully used for Prognosis and Health Management applications. In the present work, Deep Learning models are trained to predict the performance of an SHW system under different meteorological conditions. Techniques such as artificial neural networks (ANN) recurrent neural networks (RNN) and long short-term memory (LSTM) are explored. A physical simulation model is developed in TRNSYS software to generate large quantities of synthetic operational data in nominal conditions. Although similar results are achieved with the tested architectures, both RNN and LSTM outperform ANN when replicating the data's temporal behavior; all of which outperform naive predictors and other regression models such as Bayesian Ridge, Gaussian Process and Linear Regression. LSTM models achieved a low Mean Absolute Error of 0.55 °C and the lowest Root Mean Square Error scores (1.27 °C) for temperature sequence predictions, as well as the lowest variance (0.520 °C2) and relative prediction errors (3.45%) for single value predictions, indicating a more reliable prediction performance.

[1]  Stefan Lessmann,et al.  A comparative study of LSTM neural networks in forecasting day-ahead global horizontal irradiance with satellite data , 2018 .

[2]  A. Palombo,et al.  Development and validation of a new TRNSYS Type for thermosiphon flat-plate solar thermal collectors: energy and economic optimization for hot water production in different climates , 2019, Renewable Energy.

[3]  Jay Burch,et al.  TOWARDS DEVELOPMENT OF AN ALGORITHM FOR MAINS WATER TEMPERATURE , 2007 .

[4]  T. Soubdhan,et al.  A benchmarking of machine learning techniques for solar radiation forecasting in an insular context , 2015 .

[5]  Bhiksha Raj,et al.  On the Origin of Deep Learning , 2017, ArXiv.

[6]  Pedro J. Martínez,et al.  Analysis of an open-air swimming pool solar heating system by using an experimentally validated TRNSYS model , 2010 .

[7]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[8]  Farid Melgani,et al.  Multi-step ahead forecasting of daily global and direct solar radiation: A review and case study of Ghardaia region , 2018, Journal of Cleaner Production.

[9]  Evgueniy Entchev,et al.  Performance prediction of a solar thermal energy system using artificial neural networks , 2014 .

[10]  Imdat Taymaz,et al.  Generating hot water by solar energy and application of neural network , 2005 .

[11]  Chetan Gupta,et al.  Long Short-Term Memory Network for Remaining Useful Life estimation , 2017, 2017 IEEE International Conference on Prognostics and Health Management (ICPHM).

[12]  Zachary Chase Lipton A Critical Review of Recurrent Neural Networks for Sequence Learning , 2015, ArXiv.

[13]  Simon Furbo,et al.  Development and validation of a detailed TRNSYS-Matlab model for large solar collector fields for district heating applications , 2017 .

[14]  Soteris A. Kalogirou,et al.  Artificial neural networks used for the performance prediction of a thermosiphon solar water heater , 1999 .

[15]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[16]  Guangquan Zhao,et al.  Lithium-ion Battery Remaining Useful Life Prediction with Long Short-term Memory Recurrent Neural Network , 2017 .

[17]  Engin Avci,et al.  Forecasting of thermal energy storage performance of Phase Change Material in a solar collector using soft computing techniques , 2010, Expert Syst. Appl..

[18]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[19]  W. Beckman,et al.  Solar Engineering of Thermal Processes , 1985 .

[20]  Radha Krishna Prasad,et al.  Application of ANN technique to predict the performance of solar collector systems - A review , 2018 .

[21]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[22]  Kuldip K. Paliwal,et al.  Bidirectional recurrent neural networks , 1997, IEEE Trans. Signal Process..

[23]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[24]  Thomas P. Caudell,et al.  Application of Adaptive Resonance Theory neural networks to monitor solar hot water systems and detect existing or developing faults , 2012 .

[25]  G. Florides,et al.  Development of a neural network-based fault diagnostic system for solar thermal applications , 2008 .

[26]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[27]  Yaguo Lei,et al.  Machinery health prognostics: A systematic review from data acquisition to RUL prediction , 2018 .

[28]  J. Griffin,et al.  Some Priors for Sparse Regression Modelling , 2013 .

[29]  Iryna Gurevych,et al.  Reporting Score Distributions Makes a Difference: Performance Study of LSTM-networks for Sequence Tagging , 2017, EMNLP.

[30]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[31]  Gang Niu,et al.  Data-Driven Technology for Engineering Systems Health Management , 2017 .

[32]  Michael Conlon,et al.  Validated TRNSYS model for forced circulation solar water heating systems with flat plate and heat pipe evacuated tube collectors , 2011 .

[33]  Li Lin,et al.  Remaining useful life estimation of engineered systems using vanilla LSTM neural networks , 2018, Neurocomputing.

[34]  Takehisa Yairi,et al.  A review on the application of deep learning in system health management , 2018, Mechanical Systems and Signal Processing.

[35]  Francesco Grimaccia,et al.  Analysis and validation of 24 hours ahead neural network forecasting of photovoltaic output power , 2017, Math. Comput. Simul..

[36]  Cihan H. Dagli,et al.  Solar Irradiance Forecasting Using Deep Neural Networks , 2017 .

[37]  Soteris A. Kalogirou,et al.  Prediction of flat-plate collector performance parameters using artificial neural networks , 2006 .

[38]  Klaus Vajen,et al.  Simulation-based long-term fault detection for solar thermal systems , 2013 .

[39]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[40]  Ruzhu Wang,et al.  Experimental and analytical study on an air-cooled single effect LiBr-H 2 O absorption chiller driven by evacuated glass tube solar collector for cooling application in residential buildings , 2017 .

[41]  Atsunori Ogawa,et al.  Error detection and accuracy estimation in automatic speech recognition using deep bidirectional recurrent neural networks , 2017, Speech Commun..

[42]  Soteris A. Kalogirou,et al.  Modelling of an ICS solar water heater using artificial neural networks and TRNSYS , 2009 .

[43]  S. Jayaraj,et al.  Modeling of a Direct Expansion Solar Assisted Heat Pump Using Artificial Neural Networks , 2008 .

[44]  P. Alam,et al.  H , 1887, High Explosives, Propellants, Pyrotechnics.

[45]  Paul J. Werbos,et al.  Backpropagation Through Time: What It Does and How to Do It , 1990, Proc. IEEE.

[46]  A. Shashua,et al.  On the Long-Term Memory of Deep Recurrent Networks , 2017 .

[47]  K. Prodanova,et al.  Modeling data for tilted implants in grafted with bio-oss maxillary sinuses using logistic regression , 2014 .

[48]  Arzu Şencan Şahin,et al.  Estimation and optimization of thermal performance of evacuated tube solar collector system , 2014 .

[49]  Ruqiang Yan,et al.  Learning to Monitor Machine Health with Convolutional Bi-Directional LSTM Networks , 2017, Sensors.

[50]  S. Kalogirou Solar Energy Engineering: Processes and Systems , 2009 .

[51]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.