Study on a Fast Solver for Poisson’s Equation Based on Deep Learning Technique

Fast and efficient computational electromagnetic simulation is a long-standing challenge. In this article, we propose a data-driven model to solve Poisson’s equation that leverages the learning capacity of deep learning techniques. A deep convolutional neural network (ConvNet) is trained to predict the electric potential with different excitations and permittivity distribution in 2-D and 3-D models. With a careful design of cost function and proper training data generated from finite-difference solvers, the proposed network enables a reliable simulation with significant speedup and fairly good accuracy. Numerical experiments show that the same ConvNet architecture is effective for both 2-D and 3-D models, and the average relative prediction error of the proposed ConvNet model is less than 3% in both 2-D and 3-D simulations with a significant reduction in computation time compared to the finite-difference solver. This article shows that deep neural networks have a good learning capacity for numerical simulations. This could help us to build some fast solvers for some computational electromagnetic problems.

[1]  Luca Maria Gambardella,et al.  Fast image scanning with deep max-pooling convolutional neural networks , 2013, 2013 IEEE International Conference on Image Processing.

[2]  Rob Fergus,et al.  Learning Physical Intuition of Block Towers by Example , 2016, ICML.

[3]  Christophe Reboud,et al.  Real-Time NDT-NDE Through an Innovative Adaptive Partial Least Squares SVR Inversion Approach , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Jake Bouvrie,et al.  Notes on Convolutional Neural Networks , 2006 .

[5]  Anders Krogh,et al.  A Simple Weight Decay Can Improve Generalization , 1991, NIPS.

[6]  Dieter Fox,et al.  SE3-nets: Learning rigid body motion using deep neural networks , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Fan Yang,et al.  Study on a 3D Possion's Equation Slover Based on Deep Learning Technique , 2018, 2018 IEEE International Conference on Computational Electromagnetics (ICCEM).

[8]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[9]  He Ming Yao,et al.  Machine learning based MoM (ML-MoM) for parasitic capacitance extractions , 2016, 2016 IEEE Electrical Design of Advanced Packaging and Systems (EDAPS).

[10]  Jin-Fa Lee,et al.  Interior Penalty Discontinuous Galerkin Finite Element Method for the Time-Dependent First Order Maxwell's Equations , 2010, IEEE Transactions on Antennas and Propagation.

[11]  Ahmed K. Noor,et al.  Reduced Basis Technique for Nonlinear Analysis of Structures , 1979 .

[12]  Niloy J. Mitra,et al.  Learning A Physical Long-term Predictor , 2017, ArXiv.

[13]  Jianming Jin Theory and Computation of Electromagnetic Fields , 2010 .

[14]  Wei Li,et al.  Convolutional Neural Networks for Steady Flow Approximation , 2016, KDD.

[15]  Ah Chung Tsoi,et al.  Face recognition: a convolutional neural-network approach , 1997, IEEE Trans. Neural Networks.

[16]  Li Jun Jiang,et al.  Integration of Arbitrary Lumped Multiport Circuit Networks Into the Discontinuous Galerkin Time-Domain Analysis , 2013, IEEE Transactions on Microwave Theory and Techniques.

[17]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[18]  Christophe Reboud,et al.  A nonlinear Kernel-based adaptive learning-by-examples method for robust NDT/NDE of conductive tubes , 2019, Journal of Electromagnetic Waves and Applications.

[19]  Qi-Jun Zhang,et al.  Artificial neural networks for RF and microwave design - from theory to practice , 2003 .

[20]  Jian-Ming Jin,et al.  Fast and Efficient Algorithms in Computational Electromagnetics , 2001 .

[21]  H. V. D. Vorst,et al.  Model Order Reduction: Theory, Research Aspects and Applications , 2008 .

[22]  Paolo Rocca,et al.  Learning-by-examples techniques as applied to electromagnetics , 2018 .

[23]  Fan Yang,et al.  Quasi-Periodic Array Modeling Using Reduced Basis Method , 2017, IEEE Antennas and Wireless Propagation Letters.

[24]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[25]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[26]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[27]  Ken Perlin,et al.  Accelerating Eulerian Fluid Simulation With Convolutional Networks , 2016, ICML.

[28]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Qing Huo Liu,et al.  Discontinuous Galerkin Time-Domain Methods for Multiscale Electromagnetic Simulations: A Review , 2013, Proceedings of the IEEE.

[30]  Allen Taflove,et al.  Computational Electrodynamics the Finite-Difference Time-Domain Method , 1995 .

[31]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[32]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[33]  Ken-ichi Funahashi,et al.  On the approximate realization of continuous mappings by neural networks , 1989, Neural Networks.

[34]  Jean Ponce,et al.  A Theoretical Analysis of Feature Pooling in Visual Recognition , 2010, ICML.

[35]  Ji Wu,et al.  Study on a Poisson's equation solver based on deep learning technique , 2017, 2017 IEEE Electrical Design of Advanced Packaging and Systems Symposium (EDAPS).

[36]  J. Hesthaven,et al.  Nodal Discontinuous Galerkin Methods: Algorithms, Analysis, and Applications , 2007 .

[37]  Kyle Mills,et al.  Deep learning and the Schrödinger equation , 2017, ArXiv.

[38]  Michel Nakhla,et al.  A neural network modeling approach to circuit optimization and statistical design , 1995 .

[39]  R. Mittra,et al.  Characteristic basis function method: A new technique for efficient solution of method of moments matrix equations , 2003 .

[40]  Maokun Li,et al.  Coding Programmable Metasurfaces Based on Deep Learning Techniques , 2019, 2019 IEEE International Symposium on Antennas and Propagation and USNC-URSI Radio Science Meeting.

[41]  Qi-Jun Zhang,et al.  Neural Networks for RF and Microwave Design , 2000 .

[42]  김덕영 [신간안내] Computational Electrodynamics (the finite difference time - domain method) , 2001 .