Adaptive control of distillation column using adaptive critic design

The paper aims at synthesis of an adaptive controller of the distillate output flow rate of a binary distillation column. The disturbance of the process is the change of concentration of the inlet compound. The Adaptive Critic Design (ACD) approach was applied to predict on time the future effect of disturbance and to adapt the distillate output flow rate in order to prevent deviations from the desired distillate concentration. The key element of ACD — the critic — is a fast trainable recurrent neural network named Echo state network (ESN). The simulation investigations demonstrated that the proposed adaptive control scheme outperforms a classical non-adaptive controller with respect to the settling time and the reaction delay.

[1]  Petia Koprinkova-Hristova,et al.  Heuristic dynamic programming using echo state network as online trainable adaptive critic , 2012 .

[2]  Richard S. Sutton,et al.  Learning to predict by the methods of temporal differences , 1988, Machine Learning.

[3]  Herbert Jaeger,et al.  Reservoir computing approaches to recurrent neural network training , 2009, Comput. Sci. Rev..

[4]  Thomas F. Edgar,et al.  An improved method for nonlinear model reduction using balancing of empirical gramians , 2002 .

[5]  Richard S. Sutton,et al.  Neuronlike adaptive elements that can solve difficult learning control problems , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[6]  Jochen J. Steil,et al.  Improving reservoirs using intrinsic plasticity , 2008, Neurocomputing.

[7]  P J Webros.  BACKPROPAGATION THROUGH TIME: WHAT IT DOES AND HOW TO DO IT , 1990 .

[8]  Donald C. Wunsch,et al.  Adaptive critic designs and their applications , 1997 .

[9]  Danil V. Prokhorov.  Training Recurrent Neurocontrollers for Real-Time Applications , 2007, IEEE Transactions on Neural Networks.

[10]  George G. Lendaris,et al.  A retrospective on Adaptive Dynamic Programming for control , 2009, 2009 International Joint Conference on Neural Networks.

[11]  D. Prokhorov.  Toward effective combination of off-line and on-line training in ADP framework , 2007, 2007 IEEE International Symposium on Approximate Dynamic Programming and Reinforcement Learning.

[12]  Günther Palm,et al.  Adaptive Critic Design with ESN Critic for Bioprocess Optimization , 2010, ICANN.

[13]  Petia Koprinkova-Hristova,et al.  Adaptive Critic Design with Echo State Network , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.