Efficient ESD Generator Modeling Using Reinforcement Learning

This paper describes Reinforcement Learning (RL) based technique for estimating the parameters of ESD generators modeled using circuit templates, given the current discharge waveform. The proposed algorithms can be applied to any circuit template to tune the circuit parameters for the desired application or optimization efficiently with minimum prior knowledge. The model can then be used in system-level dynamic ESD simulation with 3D Electromagnetic simulation for optimal ESD protection design.

[1]  Yuval Tassa,et al.  Continuous control with deep reinforcement learning , 2015, ICLR.

[2]  Demis Hassabis,et al.  Mastering the game of Go without human knowledge , 2017, Nature.

[3]  Myeongkoo Park,et al.  Efficient Circuit and an EM Model of an Electrostatic Discharge Generator , 2017, IEEE Transactions on Electromagnetic Compatibility.

[4]  Peter Henderson,et al.  An Introduction to Deep Reinforcement Learning , 2018, Found. Trends Mach. Learn..

[5]  H. Tanaka,et al.  A circuit approach to simulate discharge current injected in contact with an ESD-gun , 2002, 2002 3rd International Symposium on Electromagnetic Compatibility.

[6]  Demis Hassabis,et al.  A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play , 2018, Science.

[7]  Norman Chang,et al.  System-level ESD failure diagnosis with chip-package-system dynamic ESD simulation , 2014, Electrical Overstress/Electrostatic Discharge Symposium Proceedings 2014.

[8]  Li Li,et al.  Optimization of Molecules via Deep Reinforcement Learning , 2018, Scientific Reports.

[9]  Guy Lever,et al.  Deterministic Policy Gradient Algorithms , 2014, ICML.

[10]  Ameet Talwalkar,et al.  Foundations of Machine Learning , 2012, Adaptive computation and machine learning.

[11]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[12]  Kenji Araki,et al.  System-Level Modeling for Transient Electrostatic Discharge Simulation , 2015, IEEE Transactions on Electromagnetic Compatibility.

[13]  Giles Thomas,et al.  Docking Control of an Autonomous Underwater Vehicle Using Reinforcement Learning , 2019, Applied Sciences.