Local Maximum Ozone Concentration Prediction Using Soft Computing Methodologies

The prediction of ozone levels is an important task because this toxic gas can produce harmful effects to the population health especially of children. This article describes the application of the Fuzzy Inductive Reasoning methodology and a Recurrent Neural Network (RNN) approach, the Long Short Term Memory (LSTM) architecture, to a signal forecasting task in an environmental domain. More specifically, we have applied FIR and LSTM to the prediction of maximum ozone(O3) concentrations in the East Austrian region. In this article the results of FIR and LSTM on this task are compared with those obtained previously using other types of neural networks (Multilayer Perceptrons (MLPs), Elman Networks (ENs) and Modified Elman Networks (MENs)). The performance of the best LSTM networks inferred are equivalent to the best FIR models identified and both are slightly better than the other Neural Networks studied (MENs, ENs and MLPs, in decreasing order of performance). Cross validation tests are included in this research in order to study more deeply the accuracy of the FIR models and to extract as much information as possible from the available data.

[1]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[2]  Jing Peng,et al.  An Efficient Gradient-Based Algorithm for On-Line Training of Recurrent Network Trajectories , 1990, Neural Computation.

[3]  Jürgen Schmidhuber,et al.  Learning to Forget: Continual Prediction with LSTM , 2000, Neural Computation.

[4]  Bush Jones,et al.  Architecture of systems problem solving , 1986, Journal of the American Society for Information Science.

[5]  Duc Truong Pham,et al.  Neural Networks for Identification, Prediction and Control , 1995 .

[6]  A Nebot,et al.  Mixed quantitative/qualitative modeling and simulation of the cardiovascular system. , 1998, Computer methods and programs in biomedicine.

[7]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[8]  Àngela Nebot,et al.  COMBINED QUALITATIVE/QUANTITATIVE SIMULATION MODELS OF CONTINUOUS-TIME PROCESSES USING FUZZY INDUCTIVE REASONING TECHNIQUES , 1996 .

[9]  Andrew K. C. Wong,et al.  Synthesizing Statistical Knowledge from Incomplete Mixed-Mode Data , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  J. Bezdek,et al.  FCM: The fuzzy c-means clustering algorithm , 1984 .

[11]  G. Miller Learning to Forget , 2004, Science.

[12]  F. Gers,et al.  Long short-term memory in recurrent neural networks , 2001 .

[13]  Barak A. Pearlmutter Gradient calculations for dynamic recurrent neural networks: a survey , 1995, IEEE Trans. Neural Networks.

[14]  Franz Wotawa,et al.  Local Maximum Ozone Concentration Prediction Using Neural Networks , 1999 .

[15]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[16]  Franz Wotawa,et al.  Deriving qualitative rules from neural networks - a case study for ozone forecasting , 2001, AI Commun..

[17]  Gonzalo Acuña,et al.  Neural Network Model for Maximum Ozone Concentration Prediction , 1996, ICANN.