Optimal Tracking Current Control of Switched Reluctance Motor Drives Using Reinforcement Q-Learning Scheduling

In this article, a novel Q-learning scheduling method for the current controller of a switched reluctance motor (SRM) drive is investigated. The Q-learning algorithm is a class of reinforcement learning approaches that can find the best forward-in-time solution of a linear control problem. An augmented system is constructed based on the reference current signal and the SRM model to allow for solving the algebraic Riccati equation of the current-tracking problem. This article introduces a new scheduled-Q-learning algorithm that utilizes a table of Q-cores that lies on the nonlinear surface of an SRM model without involving any information about the model parameters to track the reference current trajectory by scheduling the infinite horizon linear quadratic trackers (LQT) handled by Q-learning algorithms. Additionally, a linear interpolation algorithm is proposed to improve the transition of the LQT between trained Q-cores to ensure a smooth response as state variables evolve on the nonlinear surface of the model. Lastly, simulation and experimental results are provided to validate the effectiveness of the proposed control scheme.

[1]  M Aliakcayol Application of adaptive neuro-fuzzy controller for SRM , 2004 .

[2]  Xin Li,et al.  Inductance Surface Learning for Model Predictive Current Control of Switched Reluctance Motors , 2015, IEEE Transactions on Transportation Electrification.

[3]  Eva Cosoroaba,et al.  Rotor Shape Investigation and Optimization of Double Stator Switched Reluctance Machine , 2015, IEEE Transactions on Magnetics.

[4]  Xin Cao,et al.  Direct Torque Control for Switched Reluctance Motor to Obtain High Torque–Ampere Ratio , 2019, IEEE Transactions on Industrial Electronics.

[5]  S.E. Schulz,et al.  High performance digital PI current regulator for EV switched reluctance motor drives , 2002, Conference Record of the 2002 IEEE Industry Applications Conference. 37th IAS Annual Meeting (Cat. No.02CH37344).

[6]  B. Fahimi,et al.  Single-Bus Star-Connected Switched Reluctance Drive , 2013, IEEE Transactions on Power Electronics.

[7]  Frank L. Lewis,et al.  Model-free Q-learning designs for linear discrete-time zero-sum games with application to H-infinity control , 2007, Autom..

[8]  Fei Liu,et al.  Online policy iterative-based H∞ optimization algorithm for a class of nonlinear systems , 2019, Inf. Sci..

[9]  Frank L. Lewis,et al.  Policy Iterations on the Hamilton–Jacobi–Isaacs Equation for $H_{\infty}$ State Feedback Control With Input Saturation , 2006, IEEE Transactions on Automatic Control.

[10]  Arash Hassanpour Isfahani,et al.  Comparison of Mechanical Vibration Between a Double-Stator Switched Reluctance Machine and a Conventional Switched Reluctance Machine , 2014, IEEE Transactions on Magnetics.

[11]  G. Narayanan,et al.  Predictive control based constant current injection scheme for characterization of switched reluctance machine , 2016, 2016 IEEE International Conference on Power Electronics, Drives and Energy Systems (PEDES).

[12]  Akira Chiba,et al.  Comparison of Test Result and Design Stage Prediction of Switched Reluctance Motor Competitive With 60-kW Rare-Earth PM Motor , 2014, IEEE Transactions on Industrial Electronics.

[13]  R. Gobbi,et al.  Optimisation techniques for a hysteresis current controller to minimise torque ripple in switched reluctance motors , 2009 .

[14]  Jae Young Lee,et al.  Policy-iteration-based adaptive optimal control for uncertain continuous-time linear systems with excitation signals , 2010, ICCAS 2010.

[15]  Iqbal Husain,et al.  A Fixed Switching Frequency Predictive Current Control Method for Switched Reluctance Machines , 2014, IEEE Transactions on Industry Applications.

[16]  Zhengtao Ding,et al.  Reinforcement learning and adaptive optimization of a class of Markov jump systems with completely unknown dynamic information , 2019, Neural Comput. Appl..

[17]  M. Ehsani,et al.  Making the case for applications of switched reluctance motor technology in automotive products , 2006, IEEE Transactions on Power Electronics.

[18]  Ali Emadi,et al.  A digital PWM control for switched reluctance motor drives , 2010, 2010 IEEE Vehicle Power and Propulsion Conference.

[19]  Frank L. Lewis,et al.  Reinforcement Q-learning for optimal tracking control of linear discrete-time systems with unknown dynamics , 2014, Autom..

[20]  Hao Chen,et al.  Multiobjective Optimization Design of a Switched Reluctance Motor for Low-Speed Electric Vehicles With a Taguchi–CSO Algorithm , 2018, IEEE/ASME Transactions on Mechatronics.

[21]  F. Lewis,et al.  Reinforcement Learning and Feedback Control: Using Natural Decision Methods to Design Optimal Adaptive Controllers , 2012, IEEE Control Systems.

[22]  Ali Emadi,et al.  Double-Rotor Switched Reluctance Machine (DRSRM) , 2015, IEEE Transactions on Energy Conversion.

[23]  Sima Azizi,et al.  Autonomous Control of a Line Follower Robot Using a Q-Learning Controller , 2020, 2020 10th Annual Computing and Communication Workshop and Conference (CCWC).

[24]  S. K. Panda,et al.  Gain-scheduling control of the Switched Reluctance Motor , 1998 .

[25]  Paul J. Werbos,et al.  Approximate dynamic programming for real-time control and neural modeling , 1992 .

[26]  Barry W. Williams,et al.  High-performance current control for switched reluctance motors based on on-line estimated parameters , 2010 .

[27]  Akira Chiba,et al.  Acoustic noise reduction of a high efficiency switched reluctance motor for hybrid electric vehicles with novel current waveform , 2017, 2017 IEEE International Electric Machines and Drives Conference (IEMDC).

[28]  F.L. Lewis,et al.  Reinforcement learning and adaptive dynamic programming for feedback control , 2009, IEEE Circuits and Systems Magazine.

[29]  Antonio Lázaro,et al.  Behavioral Modeling of a Switched Reluctance Generator for Aircraft Power Systems , 2014, IEEE Transactions on Industrial Electronics.

[30]  K. Kiyota,et al.  Design of switched reluctance motor competitive to 60 kW IPMSM in third generation hybrid electric vehicle , 2011, 2011 IEEE Energy Conversion Congress and Exposition.

[31]  Frank L. Lewis,et al.  Optimal tracking control for linear discrete-time systems using reinforcement learning , 2013, 52nd IEEE Conference on Decision and Control.

[32]  Xin Li,et al.  Model Predictive Current Control of Switched Reluctance Motors With Inductance Auto-Calibration , 2016, IEEE Transactions on Industrial Electronics.

[33]  Ali Emadi,et al.  A Fixed-Switching-Frequency Integral Sliding Mode Current Controller for Switched Reluctance Motor Drives , 2015, IEEE Journal of Emerging and Selected Topics in Power Electronics.

[34]  Srdjan M. Lukic,et al.  State-Switching Control Technique for Switched Reluctance Motor Drives: Theory and Implementation , 2010, IEEE Transactions on Industrial Electronics.

[35]  C. Marchand,et al.  Gain-scheduling PI current controller for a Switched Reluctance Motor , 2007, 2007 IEEE International Symposium on Industrial Electronics.

[36]  Qingguo Sun,et al.  DSSRM Design With Multiple Pole Arcs Optimization for High Torque and Low Torque Ripple Applications , 2018, IEEE Access.

[37]  Man Zhang,et al.  A New Fast Method for Obtaining Flux-Linkage Characteristics of SRM , 2015, IEEE Transactions on Industrial Electronics.

[38]  Frede Blaabjerg,et al.  Improved digital current control methods in switched reluctance motor drives , 1999 .