Resource-Aware Distributed Differential Evolution for Training Expensive Neural-Network-Based Controller in Power Electronic Circuit

The neural-network (NN)-based control method is a new emerging promising technique for controller design in a power electronic circuit (PEC). However, the optimization of NN-based controllers (NNCs) has significant challenges in two aspects. The first challenge is that the search space of the NNC optimization problem is such complex that the global optimization ability of the existing algorithms still needs to be improved. The second challenge is that the training process of the NNC parameters is very computationally expensive and requires a long execution time. Thus, in this article, we develop a powerful evolutionary computation-based algorithm to find a high-quality solution and reduce computational time. First, the differential evolution (DE) algorithm is adopted because it is a powerful global optimizer in solving a complex optimization problem. This can help to overcome the premature convergence in local optima to train the NNC parameters well. Second, to reduce the computational time, the DE is extended to distribute DE (DDE) by dispatching all the individuals to different distributed computing resources for parallel computing. Moreover, a resource-aware strategy (RAS) is designed to further efficiently utilize the resources by adaptively dispatching individuals to resources according to the real-time performance of the resources, which can simultaneously concern the computing ability and load state of each resource. Experimental results show that, compared with some other typical evolutionary algorithms, the proposed algorithm can get significantly better solutions within a shorter computational time.

[1]  Yao Zhou,et al.  Evolutionary Compression of Deep Neural Networks for Biomedical Image Segmentation , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Zhi-Hui Zhan,et al.  Distributed Individuals for Multiple Peaks: A Novel Differential Evolution for Multimodal Optimization Problems , 2020, IEEE Transactions on Evolutionary Computation.

[3]  Henry Been-Lirn Duh,et al.  Neural Network-Based Information Transfer for Dynamic Optimization , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Ali Eslami,et al.  A Brain-Inspired Framework for Evolutionary Artificial General Intelligence , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Koen Vanhoof,et al.  Nonsynaptic Error Backpropagation in Long-Term Cognitive Networks , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Isaac Chairez,et al.  Adaptive Tracking Control of State Constraint Systems Based on Differential Neural Networks: A Barrier Lyapunov Function Approach , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Lei Ma,et al.  Multiple Convolutional Recurrent Neural Networks for Fault Identification and Performance Degradation Evaluation of High-Speed Train Bogie , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Jun Zhang,et al.  Automatic Niching Differential Evolution With Contour Prediction Approach for Multimodal Optimization Problems , 2020, IEEE Transactions on Evolutionary Computation.

[9]  Tianlong Gu,et al.  Historical and Heuristic-Based Adaptive Differential Evolution , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[10]  Henry Chung,et al.  A Neural-Network-Based Color Control Method for Multi-Color LED Systems , 2019, IEEE Transactions on Power Electronics.

[11]  Venkata Dinavahi,et al.  A Fast and Stable Method for Modeling Generalized Nonlinearities in Power Electronic Circuit Simulation and Its Real-Time Implementation , 2019, IEEE Transactions on Power Electronics.

[12]  Alvaro Luna,et al.  A Unified Power Flow Controller Using a Power Electronics Integrated Transformer , 2019, IEEE Transactions on Power Delivery.

[13]  Jiujun Cheng,et al.  Dendritic Neuron Model With Effective Learning Algorithms for Classification, Approximation, and Prediction , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[14]  Jun Zhang,et al.  Dual-Strategy Differential Evolution With Affinity Propagation Clustering for Multimodal Optimization Problems , 2018, IEEE Transactions on Evolutionary Computation.

[15]  Cheng-Hung Chen,et al.  Reinforcement Learning-Based Differential Evolution With Cooperative Coevolution for a Compensatory Neuro-Fuzzy Controller , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[16]  Tomislav Dragičević,et al.  Model Predictive Control of Power Converters for Robust and Fast Operation of AC Microgrids , 2018, IEEE Transactions on Power Electronics.

[17]  Yi-Hsuan Yang,et al.  Backpropagation With $N$ -D Vector-Valued Neurons Using Arbitrary Bilinear Products , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Ahmad Reza Heravi,et al.  A New Correntropy-Based Conjugate Gradient Backpropagation Algorithm for Improving Training in Neural Networks , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[19]  Haizhou Li,et al.  A Cost-Sensitive Deep Belief Network for Imbalanced Classification , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[20]  Zhang Yi,et al.  Evolving Unsupervised Deep Neural Networks for Learning Meaningful Representations , 2017, IEEE Transactions on Evolutionary Computation.

[21]  Kouichi Sakurai,et al.  One Pixel Attack for Fooling Deep Neural Networks , 2017, IEEE Transactions on Evolutionary Computation.

[22]  Jun Zhang,et al.  Training neural-network-based controller on distributed machine learning platform for power electronics systems , 2017, 2017 IEEE Energy Conversion Congress and Exposition (ECCE).

[23]  Ning Ma,et al.  Load balance aware distributed differential evolution for computationally expensive optimization problems , 2017, GECCO.

[24]  Kankar Bhattacharya,et al.  Distributed Computing Architecture for Optimal Control of Distribution Feeders With Smart Loads , 2017, IEEE Transactions on Smart Grid.

[25]  Jun Zhang,et al.  Cloudde: A Heterogeneous Differential Evolution Algorithm and Its Distributed Cloud Version , 2017, IEEE Transactions on Parallel and Distributed Systems.

[26]  Zhi-hui Zhan,et al.  Parallel Differential Evolution Based on Distributed Cloud Computing Resources for Power Electronic Circuit Optimization , 2016, GECCO.

[27]  A. Izadian,et al.  Electrochemical model parameter identification of a lithium-ion battery using particle swarm optimization method , 2016 .

[28]  Jianbin Qiu,et al.  A Combined Adaptive Neural Network and Nonlinear Model Predictive Control for Multirate Networked Industrial Process Control , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[29]  Teresa Orlowska-Kowalska,et al.  Adaptive neural speed controllers applied for a drive system with an elastic mechanical coupling - A comparative study , 2015, Eng. Appl. Artif. Intell..

[30]  Miguel A. Vega-Rodríguez,et al.  Parallel Multiobjective Metaheuristics for Inferring Phylogenies on Multicore Clusters , 2015, IEEE Transactions on Parallel and Distributed Systems.

[31]  Hao Xu,et al.  Neural Network-Based Finite Horizon Stochastic Optimal Control Design for Nonlinear Networked Control Systems , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[32]  Yoichi Hori,et al.  An Adaptive Speed Sensorless Induction Motor Drive With Artificial Neural Network for Stability Enhancement , 2012, IEEE Transactions on Industrial Informatics.

[33]  Ashish Ghosh,et al.  Distributed differential evolution algorithm for MAP estimation of MRF model for detecting moving objects , 2011, 2011 International Conference on Image Information Processing.

[34]  Jun Zhang,et al.  Orthogonal learning particle swarm optimization for power electronic circuit optimization with free search range , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[35]  Plamen P. Angelov,et al.  Uniformly Stable Backpropagation Algorithm to Train a Feedforward Neural Network , 2011, IEEE Transactions on Neural Networks.

[36]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[37]  G. Ioup,et al.  Channel order selection in blind deconvolution based on eigenvector characteristics and using normal modes in conjunction with multipath compression for source identification , 2003 .

[38]  Antonio J. Conejo,et al.  A Parallel Repair Genetic Algorithm to Solve the Unit Commitment Problem , 2002, IEEE Power Engineering Review.

[39]  Jun Zhang,et al.  Implementation of a decoupled optimization technique for design of switching regulators using genetic algorithms , 2001 .

[40]  Henry Shu-Hung Chung,et al.  Steady-state analysis of PWM DC/DC switching regulators using iterative cycle time-domain simulation , 1998, IEEE Trans. Ind. Electron..

[41]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .