Optimal Switching of DC–DC Power Converters Using Approximate Dynamic Programming

Optimal switching between different topologies in step-down dc–dc voltage converters, with nonideal inductors and capacitors, is investigated in this paper. Challenges including constraint on the inductor current and voltage leakages across the capacitor (due to switching) are incorporated. The objective is generating the desired voltage with low ripples and high robustness toward line and load disturbances. A previously developed tool, which is based on approximate dynamic programming, is adapted for this application. The scheme leads to tuning a parametric function approximator to provide optimal switching in a feedback form. No fixed cycle time is assumed, as the cycle time and the duty ratio will be adjusted on the fly in an optimal fashion. The controller demonstrates good capabilities in controlling the system even under parameter uncertainties. Finally, some modifications on the scheme are conducted to handle optimal switching problems with state jumps at the switching times.

[1]  W. Marsden.  I and J , 2012 .

[2]  Jerry M. Mendel,et al.  IEEE Press Series on Computational Intelligence , 2014 .

[3]  Ali Heydari,et al.  Optimal switching between autonomous subsystems , 2014, J. Frankl. Inst..

[4]  Dragan Maksimovic,et al.  Second-Order Sliding-Mode Controlled Synchronous Buck DC–DC Converter , 2016, IEEE Transactions on Power Electronics.

[5]  F.H.F. Leung,et al.  The control of switching DC-DC converters-a general LWR problem , 1991 .

[6]  Shuhui Li,et al.  An adaptive recurrent neural-network controller using a stabilization matrix and predictive inputs to solve a tracking problem under disturbances , 2014, Neural Networks.

[7]  D. Ernst,et al.  Power systems stability control: reinforcement learning framework , 2004, IEEE Transactions on Power Systems.

[8]  Derong Liu,et al.  Finite-Approximation-Error-Based Discrete-Time Iterative Adaptive Dynamic Programming , 2014, IEEE Transactions on Cybernetics.

[9]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[10]  Francesco Vasca,et al.  Control of DC-DC converters with linear optimal feedback and nonlinear feedforward , 1994 .

[11]  Ali Heydari,et al.  Optimal scheduling for reference tracking or state regulation using reinforcement learning , 2015, J. Frankl. Inst..

[12]  Manfred Morari,et al.  Hybrid Model Predictive Control of the Step-Down DC–DC Converter , 2008, IEEE Transactions on Control Systems Technology.

[13]  Magnus Egerstedt,et al.  Optimal switching control of a step-down DC-DC converter , 2012, 2012 American Control Conference (ACC).

[14]  Haibo He,et al.  Convergence Proof of Approximate Policy Iteration for Undiscounted Optimal Control of Discrete-Time Systems , 2015, Cognitive Computation.

[15]  Ali Heydari,et al.  Theoretical and Numerical Analysis of Approximate Dynamic Programming with Approximation Errors , 2014, ArXiv.

[16]  C. K. Michael Tse,et al.  A unified approach to the design of PWM-based sliding-mode voltage controllers for basic DC-DC converters in continuous conduction mode , 2006, IEEE Transactions on Circuits and Systems I: Regular Papers.

[17]  Louis Wehenkel,et al.  Application of Reinforcement Learning to Electrical Power System Closed-Loop Emergency Control , 2000, PKDD.

[18]  Tobias Geyer,et al.  A Comparison of Control and Modulation Schemes for Medium-Voltage Drives: Emerging Predictive Control Concepts Versus PWM-Based Schemes , 2011, IEEE Transactions on Industry Applications.

[19]  Kyriakos G. Vamvoudakis,et al.  Online optimal switching of single phase DC/AC inverters using partial information , 2014, 2014 American Control Conference.

[20]  John Y. Hung,et al.  Implementation of a fuzzy controller for DC-DC converters using an inexpensive 8-b microcontroller , 1997, IEEE Trans. Ind. Electron..

[21]  Marian K. Kazimierczuk,et al.  Dynamic performance of PWM DC-DC boost converter with input voltage feedforward control , 1999 .

[22]  Slobodan Cuk,et al.  A general unified approach to modelling switching-converter power stages , 1976, 1970 IEEE Power Electronics Specialists Conference.

[23]  Bin Wu,et al.  Model Predictive Control of Capacitor Voltage Balancing for Cascaded Modular DC–DC Converters , 2017, IEEE Transactions on Power Electronics.

[24]  Bo Lincoln,et al.  Relaxing dynamic programming , 2006, IEEE Transactions on Automatic Control.

[25]  Jung-Su Kim,et al.  A Stabilizing Model Predictive Controller for Voltage Regulation of a DC/DC Boost Converter , 2014, IEEE Transactions on Control Systems Technology.

[26]  Donald E. Kirk,et al.  Optimal control theory : an introduction , 1970 .

[27]  Kok Lay Teo,et al.  Optimal PWM Control of Switched-Capacitor DC–DC Power Converters via Model Transformation and Enhancing Control Techniques , 2008, IEEE Transactions on Circuits and Systems I: Regular Papers.

[28]  Kok Lay Teo,et al.  Optimal switching instants for a switched-capacitor DC/DC power converter , 2009, Autom..

[29]  Ali Heydari,et al.  Approximate solution to discrete-time optimal switching problems with minimum dwell time constraint , 2016, 2016 American Control Conference (ACC).

[30]  Ali Heydari,et al.  Optimal Triggering of Networked Control Systems , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[31]  U. Ammann,et al.  Model Predictive Control—A Simple and Powerful Method to Control Power Converters , 2009, IEEE Transactions on Industrial Electronics.

[32]  Ali Heydari,et al.  Fixed-final-time optimal control of nonlinear systems with terminal constraints , 2013, Neural Networks.

[33]  Amrane Oukaour,et al.  Adaptive Fuzzy Logic Control Mixing Strategy of DC/DC Converters in Both Discontinuous and Continuous Conduction Modes , 2016 .

[34]  Manfred Morari,et al.  Optimal sampled data control of PWM systems using piecewise affine approximations , 2010, 49th IEEE Conference on Decision and Control (CDC).

[35]  W. Rudin.  Principles of mathematical analysis , 1964 .

[36]  Manfred Morari,et al.  Sampled Data Model Predictive Control of a Voltage Source Inverter for Reduced Harmonic Distortion , 2013, IEEE Transactions on Control Systems Technology.

[37]  H. Sira-Ramírez.  Nonlinear P-I controller design for switchmode DC-to-DC power converters , 1991 .

[38]  A. Wernrud,et al.  Strategies for Computing Switching Feedback Controllers , 2007, 2007 American Control Conference.

[39]  Qiang Zhao,et al.  Optimal Control of DC/DC Converter Using Improved Model-free Adaptive Control Algorithm , 2013 .

[40]  Robert Gardner,et al.  Introduction To Real Analysis , 1994 .

[41]  Ali Heydari,et al.  Feedback Solution to Optimal Switching Problems With Switching Cost , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[42]  Frank L. Lewis,et al.  Reinforcement Learning and Approximate Dynamic Programming for Feedback Control , 2012 .