Optimal Structure Design of Ferromagnetic Cores in Wireless Power Transfer by Reinforcement Learning

In this paper, a reinforcement learning algorithm is applied for the first time to find a ferromagnetic core structure with optimal coupling coefficient between transmitting (Tx) and receiving (Rx) coils of a wireless power transfer (WPT) system. Since formula-based theoretical design is not available due to the non-linear magnetic field distortion stems from the presence of the ferromagnetic core in a WPT system, the proposed design has been achieved through finite element analysis (FEA) simulation-based data learning. The proposed design methods are so general that they can be applied to any conventional WPT coil types. We applied the proposed algorithm to the ferromagnetic core structure design of a simple dipole coil first. By training only 2.3 % data out of total possible cases, it is experimentally verified that the core structure obtained by the proposed method has a coupling coefficient 7 % higher than that of the example design level in the case of 98 cm distance between Tx and Rx coils.

[1]  Meng Wang,et al.  Demagnetization Weakening and Magnetic Field Concentration With Ferrite Core Characterization for Efficient Wireless Power Transfer , 2019, IEEE Transactions on Industrial Electronics.

[2]  Chunting Chris Mi,et al.  Feasibility study on bipolar pads for efficient wireless power chargers , 2014, 2014 IEEE Applied Power Electronics Conference and Exposition - APEC 2014.

[3]  Gyu-Hyeong Cho,et al.  General Unified Analyses of Two-Capacitor Inductive Power Transfer Systems: Equivalence of Current-Source SS and SP Compensations , 2015, IEEE Transactions on Power Electronics.

[4]  Senén Barro,et al.  Combining reinforcement learning and genetic algorithms to learn behaviours in mobile robotics , 2006, ICINCO-RA.

[5]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[6]  Jacobus Daniel van Wyk,et al.  Sliding transformers for linear contactless power delivery , 1997, IEEE Trans. Ind. Electron..

[7]  Grant Covic,et al.  Multiphase Pickups for Large Lateral Tolerance Contactless Power-Transfer Systems , 2010, IEEE Transactions on Industrial Electronics.

[8]  Grant A. Covic,et al.  Development and evaluation of single sided flux couplers for contactless electric vehicle charging , 2011, 2011 IEEE Energy Conversion Congress and Exposition.

[9]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Fatimah Ibrahim,et al.  An Improved Wearable Resonant Wireless Power Transfer System for Biomedical Capsule Endoscope , 2018, IEEE Transactions on Industrial Electronics.

[11]  Jie Shao,et al.  Swarm robots reinforcement learning convergence accuracy-based learning classifier systems with gradient descent (XCS-GD) , 2013, Proceedings of 2013 3rd International Conference on Computer Science and Network Technology.

[12]  Dong-Ho Cho,et al.  Design and Implementation of Shaped Magnetic-Resonance-Based Wireless Power Transfer System for Roadway-Powered Moving Electric Vehicles , 2014, IEEE Transactions on Industrial Electronics.

[13]  Rangarajan Jegadeesan,et al.  WIRELESS POWER TRANSCEIVER AND DISPLAY APPARATUS WITH THE SAME , 2019 .

[14]  Filippos Marketos,et al.  Experimental and Numerical Investigation of Flux Density Distribution in the Individual Packets of a 100 kVA Transformer Core , 2012, IEEE Transactions on Magnetics.

[15]  Jenshan Lin,et al.  Method of Load/Fault Detection for Loosely Coupled Planar Wireless Power Transfer System With Power Delivery Tracking , 2010, IEEE Transactions on Industrial Electronics.

[16]  Johann W. Kolar,et al.  Comprehensive Evaluation of Rectangular and Double-D Coil Geometry for 50 kW/85 kHz IPT System , 2016, IEEE Journal of Emerging and Selected Topics in Power Electronics.

[17]  Grant A. Covic,et al.  Evaluation of Magnetic Pad Sizes and Topologies for Electric Vehicle Charging , 2015, IEEE Transactions on Power Electronics.

[18]  Alanson P. Sample,et al.  Analysis , Experimental Results , and Range Adaptation of Magnetically Coupled Resonators for Wireless Power Transfer , 2010 .

[19]  Melanie Mitchell,et al.  An introduction to genetic algorithms , 1996 .

[20]  Xun Liu,et al.  Passive Radio-Frequency Repeater for Enhancing Signal Reception and Transmission in a Wireless Charging Platform , 2014, IEEE Transactions on Industrial Electronics.

[21]  Alex Graves,et al.  Playing Atari with Deep Reinforcement Learning , 2013, ArXiv.

[22]  Xun Liu,et al.  A Novel Single-Layer Winding Array and Receiver Coil Structure for Contactless Battery Charging Systems With Free-Positioning and Localized Charging Features , 2011, IEEE Transactions on Industrial Electronics.

[23]  Xiaodong Zhuang,et al.  Strategy Entropy as a Measure of Strategy Convergence in Reinforcement Learning , 2008, 2008 First International Conference on Intelligent Networks and Intelligent Systems.

[24]  W. X. Zhong,et al.  Maximum Energy Efficiency Tracking for Wireless Power Transfer Systems , 2015, IEEE Transactions on Power Electronics.

[25]  G. Covic,et al.  A New Concept: Asymmetrical Pick-Ups for Inductively Coupled Power Transfer Monorail Systems , 2006, IEEE Transactions on Magnetics.

[26]  Chunting Chris Mi,et al.  Wireless Power Transfer for Electric Vehicle Applications , 2015, IEEE Journal of Emerging and Selected Topics in Power Electronics.

[27]  C. Sullivan,et al.  A Study of Flux Distribution and Impedance in Solid and Laminar Ferrite Cores , 2019, 2019 IEEE Applied Power Electronics Conference and Exposition (APEC).

[28]  Gyu-Hyeong Cho,et al.  Innovative 5-m-Off-Distance Inductive Power Transfer Systems With Optimally Shaped Dipole Coils , 2015, IEEE Transactions on Power Electronics.

[29]  Jenshan Lin,et al.  Design and Test of a High-Power High-Efficiency Loosely Coupled Planar Wireless Power Transfer System , 2009, IEEE Transactions on Industrial Electronics.

[30]  Takehiro Imura,et al.  Impedance Matching and Power Division Using Impedance Inverter for Wireless Power Transfer via Magnetic Resonant Coupling , 2014, IEEE Transactions on Industry Applications.

[31]  Guo Wei,et al.  A Comprehensive Study on Composite Resonant Circuit-Based Wireless Power Transfer Systems , 2018, IEEE Transactions on Industrial Electronics.

[32]  A.P. Hu,et al.  A Wireless Power Pickup Based on Directional Tuning Control of Magnetic Amplifier , 2009, IEEE Transactions on Industrial Electronics.

[33]  Grant Covic,et al.  A Unity-Power-Factor IPT Pickup for High-Power Applications , 2010, IEEE Transactions on Industrial Electronics.

[34]  Charles K. Alexander,et al.  Fundamentals of Electric Circuits, 5/E , 2016 .

[35]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[36]  Sungwoo Lee,et al.  On-Line Electric Vehicle using inductive power transfer system , 2010, 2010 IEEE Energy Conversion Congress and Exposition.

[37]  Grant Covic,et al.  Inductive Power Transfer , 2013, Proceedings of the IEEE.

[38]  Dorothea Heiss-Czedik,et al.  An Introduction to Genetic Algorithms. , 1997, Artificial Life.

[39]  J. T. Boys,et al.  Design and Optimization of Circular Magnetic Structures for Lumped Inductive Power Transfer Systems , 2011, IEEE Transactions on Power Electronics.

[40]  Wencong Su,et al.  A Dual-Coupled LCC-Compensated IPT System With a Compact Magnetic Coupler , 2018, IEEE Transactions on Power Electronics.

[41]  Liming Xiang,et al.  Kernel-Based Reinforcement Learning , 2006, ICIC.

[42]  Zhen Zhang,et al.  Wireless Power Transfer—An Overview , 2019, IEEE Transactions on Industrial Electronics.

[43]  Eun S. Lee,et al.  A Modularized IPT With Magnetic Shielding for a Wide-Range Ubiquitous Wi-Power Zone , 2018, IEEE Transactions on Power Electronics.

[44]  J. Huh,et al.  Narrow-Width Inductive Power Transfer System for Online Electrical Vehicles , 2011, IEEE Transactions on Power Electronics.

[45]  Grant A. Covic,et al.  A bipolar primary pad topology for EV stationary charging and highway power by inductive coupling , 2011, 2011 IEEE Energy Conversion Congress and Exposition.

[46]  Martin Brown,et al.  Convergence Analysis of Reinforcement Learning Approaches to Humanoid Locomotion , 2010 .

[47]  Mark W. Schmidt,et al.  A Stochastic Gradient Method with an Exponential Convergence Rate for Finite Training Sets , 2012, NIPS.

[48]  J. Huh,et al.  Finite-Width Magnetic Mirror Models of Mono and Dual Coils for Wireless Electric Vehicles , 2013, IEEE Transactions on Power Electronics.

[49]  Seho Kim,et al.  Tripolar Pad for Inductive Power Transfer Systems for EV Charging , 2017, IEEE Transactions on Power Electronics.

[50]  Chun T. Rim,et al.  Six Degrees of Freedom Mobile Inductive Power Transfer by Crossed Dipole Tx and Rx Coils , 2016, IEEE Transactions on Power Electronics.

[51]  Stefan Videv,et al.  Indoor Optical Wireless Power Transfer to Small Cells at Nighttime , 2016, Journal of Lightwave Technology.