Reinforcement Learning-Based Controller for Field-Oriented Control of Induction Machine

This paper presents the concept of reinforcement learning-based field-oriented control (FOC) of induction motor. Conventional controllers such as PID used for FOC of induction machines are model-based controllers and face the issue of parameter tuning. Periodic retuning of PID controllers is required to take care of model approximations, parameter variations of the system during operation and external disturbances which are random in character, magnitudes, and place of occurrences in the system. Reinforcement learning is a model-free and online learning technique which can take care of parameter variations. These properties make reinforcement learning a potential candidate, to act as an adaptive controller which can replace conventional controllers. In this study, reinforcement learning-based controller has been designed to control the speed of induction machine using filed-oriented control. The controller performance has been verified for various operating conditions by computer simulation in MATLAB/SIMULINK.

[1]  Yu-Seok Jeong,et al.  Energy-Efficient and Robust Control for High-Performance Induction Motor Drive With an Application in Electric Vehicles , 2012, IEEE Transactions on Vehicular Technology.

[2]  Donald W. Novotny,et al.  The Influence of Motor Parameter Deviations in Feedforward Field Orientation Drive Systems , 1985, IEEE Transactions on Industry Applications.

[3]  Y. Narahari,et al.  Reinforcement learning applications in dynamic pricing of retail markets , 2003, EEE International Conference on E-Commerce, 2003. CEC 2003..

[4]  Bimal K. Bose,et al.  Modern Power Electronics and AC Drives , 2001 .

[5]  Chris Watkins,et al.  Learning from delayed rewards , 1989 .

[6]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[7]  Luis Antonio Amezquita-Brooks,et al.  Speed and Position Controllers Using Indirect Field-Oriented Control: A Classical Control Approach , 2014, IEEE Transactions on Industrial Electronics.

[8]  Zhang Kai,et al.  Research on rotor resistance adaptation algorithm for indirect vector control of induction machines , 2015, 2015 IEEE Advanced Information Technology, Electronic and Automation Control Conference (IAEAC).

[9]  R. Krishnan,et al.  Study of Parameter Sensitivity in High-Performance Inverter-Fed Induction Motor Drive Systems , 1987, IEEE Transactions on Industry Applications.

[10]  Sergey Levine,et al.  Deep reinforcement learning for robotic manipulation with asynchronous off-policy updates , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Atsuo Kawamura,et al.  Online rotor resistance estimation using the transient state under the speed sensorless control of induction motor , 2000 .

[12]  Sukanta Das,et al.  Review on model reference adaptive system for sensorless vector control of induction motor drives , 2015 .