Discussion and Review of the Use of Neural Networks to Improve the Flexibility of Smart Grids in Presence of Distributed Renewable Ressources

The evolving and nonstationary behavior of realworld data generally generated in streaming way creates serious challenges for learning models. Thus, changes may deteriorate previous decision models accuracy, which requires permanent adaptation strategies. Artificial neural networks have been among the popular choice of adaptation strategies to tackle concept drifting data streams, relying on their online learning capabilities. In this paper, the ability of most known neural networks of the literature to learn from data streams in presence of concept drift will be studied and compared using some meaningful criteria. Their limits will be highlighted using a case-study about the design of decision making aid model to improve the flexibility of electrical grids in presence of distributed Wind-PV renewable energy ressources. Finally, a self-adaptive scheme based on the use of neural networks is proposed in order to avoid these limits.

[1]  Yauheni Marushko,et al.  Ensembles of Neural Network for Telemetry Multivariate Time Series Forecasting , 2016, ICPR 2016.

[2]  Ryszard S. Michalski,et al.  Incremental learning with partial instance memory , 2002, Artif. Intell..

[3]  Guang-Bin Huang,et al.  Extreme learning machine: a new learning scheme of feedforward neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[4]  Rui Araújo,et al.  An adaptive ensemble of on-line Extreme Learning Machines with variable forgetting factor for dynamic system prediction , 2016, Neurocomputing.

[5]  João Gama,et al.  Evaluating algorithms that learn from data streams , 2009, SAC '09.

[6]  Robi Polikar,et al.  Learn$^{++}$ .NC: Combining Ensemble of Classifiers With Dynamically Weighted Consult-and-Vote for Efficient Incremental Learning of New Classes , 2009, IEEE Transactions on Neural Networks.

[7]  Mateusz Zarkowski.  Adaptive Online Neural Network for Face Identification with Concept Drift , 2014, IEEE Conf. on Intelligent Systems.

[8]  Abdelhamid Bouchachia,et al.  Incremental learning with multi-level adaptation , 2011, Neurocomputing.

[9]  Robi Polikar,et al.  Learning concept drift in nonstationary environments using an ensemble of classifiers based approach , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[10]  Ying Tan,et al.  Recentness biased learning for time series forecasting , 2013, Inf. Sci..

[11]  Daniel F. Leite,et al.  Evolving granular neural networks from fuzzy data streams , 2013, Neural Networks.

[12]  Jennifer Widom,et al.  Models and issues in data stream systems , 2002, PODS.

[13]  Nuno C. Marques.  Applying Neural Networks for Concept Drift Detection in Financial Markets (Proceedings Ubiquitous Data Miningorkshop, in conjunction with ECAI 2012.) , 2012 .

[14]  Zhiping Lin,et al.  Meta-cognitive online sequential extreme learning machine for imbalanced and concept-drifting data classification , 2016, Neural Networks.

[15]  Hadi Sadoghi Yazdi,et al.  Ensemble of online neural networks for non-stationary and imbalanced data streams , 2013, Neurocomputing.

[16]  Simon Fong,et al.  Self-Adaptive Parameters Optimization for Incremental Classification in Big Data Using Neural Network , 2016 .

[17]  Ning Lu,et al.  Concept drift detection via competence models , 2014, Artif. Intell..

[18]  João Gama,et al.  Learning with Drift Detection , 2004, SBIA.

[19]  Koichiro Yamauchi.  Incremental model selection and ensemble prediction under virtual concept drifting environments , 2011, Evol. Syst..

[20]  Robi Polikar,et al.  Incremental Learning of Variable Rate Concept Drift , 2009, MCS.

[21]  Robi Polikar,et al.  Incremental Learning of Concept Drift in Nonstationary Environments , 2011, IEEE Transactions on Neural Networks.

[22]  Albert Bifet,et al.  DATA STREAM MINING A Practical Approach , 2009 .

[23]  Yue Dong,et al.  Threaded Ensembles of Supervised and Unsupervised Neural Networks for Stream Learning , 2016, Canadian Conference on AI.

[24]  Qun Dai,et al.  A competitive ensemble pruning approach based on cross-validation technique , 2013, Knowl. Based Syst..

[25]  Moamar Sayed Mouchaweh,et al.  Dynamic supervised classification method for online monitoring in non-stationary environments , 2014, Neurocomputing.

[26]  He Jiang,et al.  FP-ELM: An online sequential learning algorithm for dealing with concept drift , 2016, Neurocomputing.

[27]  Mohamad Ivan Fanany,et al.  Adaptive Convolutional ELM For Concept Drift Handling in Online Stream Data , 2016, ArXiv.

[28]  Adriano Lorena Inácio de Oliveira,et al.  An approach to handle concept drift in financial time series based on Extreme Learning Machines and explicit Drift Detection , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[29]  Gerhard Widmer,et al.  Adapting to Drift in Continuous Domains (Extended Abstract) , 1995, ECML.

[30]  João Gama,et al.  A survey on concept drift adaptation , 2014, ACM Comput. Surv..

[31]  Nan Liu,et al.  Ensemble of subset online sequential extreme learning machine for class imbalance and concept drift , 2015, Neurocomputing.

[32]  Khaled Ghédira,et al.  Self-Adaptive Windowing Approach for Handling Complex Concept Drift , 2015, Cognitive Computation.

[33]  V. Miranda,et al.  Entropy and Correntropy Against Minimum Square Error in Offline and Online Three-Day Ahead Wind Power Forecasting , 2009, IEEE Transactions on Power Systems.

[34]  Cesare Alippi,et al.  Just-in-Time Adaptive Classifiers—Part I: Detecting Nonstationary Changes , 2008, IEEE Transactions on Neural Networks.

[35]  Amparo Alonso-Betanzos,et al.  A robust incremental learning method for non-stationary environments , 2011, Neurocomputing.

[36]  Lamjed Ben Said,et al.  On-line self-adaptive framework for tailoring a neural-agent learning model addressing dynamic real-time scheduling problems , 2017 .

[37]  Christophe G. Giraud-Carrier,et al.  Efficient mining of high-speed uncertain data streams , 2015, Applied Intelligence.

[38]  Daniel F. Leite,et al.  Evolving fuzzy granular modeling from nonstationary fuzzy data streams , 2012, Evol. Syst..

[39]  Hadi Sadoghi Yazdi,et al.  Online cost-sensitive neural network classifiers for non-stationary and imbalanced data streams , 2012, Neural Computing and Applications.

[40]  Hadi Sadoghi Yazdi,et al.  Online neural network model for non-stationary and imbalanced data stream classification , 2014, Int. J. Mach. Learn. Cybern..

[41]  Rui Araújo,et al.  A dynamic and on-line ensemble regression for changing environments , 2015, Expert Syst. Appl..

[42]  Robi Polikar,et al.  Incremental learning in nonstationary environments with controlled forgetting , 2009, 2009 International Joint Conference on Neural Networks.

[43]  Moamar Sayed-Mouchaweh.  Learning from Data Streams in Dynamic Environments , 2015 .

[44]  Mahardhika Pratama,et al.  An Incremental Learning of Concept Drifts Using Evolving Type-2 Recurrent Fuzzy Neural Networks , 2017, IEEE Transactions on Fuzzy Systems.

[45]  Robi Polikar,et al.  Incremental learning in non-stationary environments with concept drift using a multiple classifier based approach , 2008, 2008 19th International Conference on Pattern Recognition.

[46]  Zbigniew Telec,et al.  Evaluation of Neural Network Ensemble Approach to Predict from a Data Stream , 2014, ICCCI.