Analysis on Improving the Response Time with PIDSARSA-RAL in ClowdFlows Mining Platform

This paper provides an improved parallel data processing in Big Data mining using ClowdFlows platform. The big data processing involves an improvement in Proportional Integral Derivative (PID) controller using Reinforcement Adaptive Learning (RAL). The Reinforcement Adaptive Learning involves the use of Actor-critic State–action–reward–state–action (SARSA) learning that suits well the stream mining module of ClowdFlows platform. The study concentrates on batch mode processing in Big Data mining model with the use of proposed PID-SARSA-RAL. The experimental evaluation with the conventional ClowdFlows platform proved the effectiveness of the proposed method over continuous parallel workflow execution.

[1]  Csaba Szepesvári,et al.  Algorithms for Reinforcement Learning , 2010, Synthesis Lectures on Artificial Intelligence and Machine Learning.

[2]  Nada Lavrac,et al.  ClowdFlows: Online workflows for distributed big data mining , 2017, Future Gener. Comput. Syst..

[3]  Naoki Abe,et al.  Efficient Data Mining by Active Learning , 2002, Progress in Discovery Science.

[4]  Mariano De Paula,et al.  Incremental Q-learning strategy for adaptive PID control of mobile robots , 2017, Expert Syst. Appl..

[5]  Tae-Yong Kuc,et al.  An adaptive PID learning control of DC motors , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[6]  Tae-Yong Kuc,et al.  Adaptive PID learning of periodic robot motion , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[7]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[8]  Paulo J. L. Adeodato,et al.  Improving reinforcement learning algorithms by the use of data mining techniques for feature and action selection , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[9]  Nada Lavrac,et al.  Active learning for sentiment analysis on data streams: Methodology and workflow implementation in the ClowdFlows platform , 2015, Inf. Process. Manag..

[10]  Wei Sun,et al.  A Proposal of Adaptive PID Controller Based on Reinforcement Learning , 2007 .

[11]  Yu Xue,et al.  A hybrid feature selection algorithm for gene expression data classification , 2017, Neurocomputing.

[12]  Nada Lavrac,et al.  ClowdFlows: A Cloud Based Scientific Workflow Platform , 2012, ECML/PKDD.

[13]  Tae-Yong Kuc,et al.  An adaptive PID learning control of robot manipulators , 2000, Autom..