Neural Networks for Microwave Modeling: Model Development Issues and Nonlinear Modeling Techniques

() ABSTRACT: Artificial neural networks ANN recently gained attention as a fast and flexible vehicle to microwave modeling and design. Fast neural models trained from measured simulated microwave data can be used during microwave design to provide instant answers to the task they have learned. We review two important aspects of neural-network-based microwave modeling, namely, model development issues and nonlin- ear modeling. A systematic description of key issues in neural modeling approach such as data generation, range and distribution of samples in model input parameter space, data scaling, etc., is presented. Techniques that pave the way for automation of neural model development could be of immense interest to microwave engineers, whose knowledge about ANN is limited. As such, recent techniques that could lead to automatic neural model development, e.g., adaptive controller and adaptive sampling, are discussed. Neural model- ing of nonlinear device circuit characteristics has emerged as an important research area. An overview of nonlinear techniques including small large signal neural modeling of () transistors and dynamic recurrent neural network RNN modeling of circuits is presented. Practical microwave examples are used to illustrate the reviewed techniques. 2001 John Wiley & Sons, Inc. Int J RF and Microwave CAE 11: 421, 2001.

[1]  Li Gao,et al.  Huber optimization of circuits: a robust approach , 1993 .

[2]  N.G. Alexopoulos,et al.  Microstrip circuit design using neural networks , 1993, 1993 IEEE MTT-S International Microwave Symposium Digest.

[3]  A. Ishimaru,et al.  Surface roughness determination using spectral correlations of scattered intensities and an artificial neural network technique , 1993 .

[4]  K. C. Gupta,et al.  Emerging trends in millimeter-wave CAD , 1998 .

[5]  K. C. Gupta,et al.  EM-ANN models for microstrip vias and interconnects in dataset circuits , 1996 .

[6]  Denis Barataud,et al.  Modeling microwave devices and circuits for telecommunications system design , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[7]  W. Curtice.  GaAs MESFET modeling and nonlinear CAD , 1988 .

[8]  Fang Wang,et al.  Robust training of microwave neural models , 1999, 1999 IEEE MTT-S International Microwave Symposium Digest (Cat. No.99CH36282).

[9]  Jacek M. Zurada,et al.  Neural network modeling of GaAs IC material and MESFET device characteristics , 1999 .

[10]  J.W. Bandler,et al.  New directions in model development for RF/microwave components utilizing artificial neural networks and space mapping , 1999, IEEE Antennas and Propagation Society International Symposium. 1999 Digest. Held in conjunction with: USNC/URSI National Radio Science Meeting (Cat. No.99CH37010).

[11]  Roop L. Mahajan,et al.  Applications of knowledge‐based artificial neural network modeling to microwave components , 1999 .

[12]  Rabindra K. Mishra,et al.  An artificial neural network model for effective dielectric constant of microstrip line , 1997 .

[13]  Zeljko Mrcarica,et al.  MOS transistor modelling using neural network , 1992 .

[14]  Qi-Jun Zhang,et al.  Neural Network Training-Driven Adaptive Sampling Algorithm for Microwave Modeling , 2000, 2000 30th European Microwave Conference.

[15]  Gregory N. Washington,et al.  Aperture antenna shape prediction by feedforward neural networks , 1997 .

[16]  Robert J. Trew,et al.  A large-signal, analytic model for the GaAs MESFET , 1988 .

[17]  A. Patnaik,et al.  Neurospectral analysis of coaxial fed rectangular patch antenna , 2000, IEEE Antennas and Propagation Society International Symposium. Transmitting Waves of Progress to the Next Millennium. 2000 Digest. Held in conjunction with: USNC/URSI National Radio Science Meeting (C.

[18]  T. H. O'Donnell,et al.  Direction finding in phased arrays with a neural network beamformer , 1995 .

[19]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.

[20]  Q.J. Zhang,et al.  A Neural Network Approach to the Modeling of Heterojunction Bipolar Transistors from S-Parameter Data , 1998, 1998 28th European Microwave Conference.

[21]  John W. Bandler,et al.  Efficient quadratic approximation for statistical design , 1989 .

[22]  S.E. El-Khamy,et al.  Sidelobes reduction and steerable nulling of antenna arrays using neural networks , 1999, IEEE Antennas and Propagation Society International Symposium. 1999 Digest. Held in conjunction with: USNC/URSI National Radio Science Meeting (Cat. No.99CH37010).

[23]  Adrian J. Shepherd,et al.  Second-Order Methods for Neural Networks , 1997 .

[24]  Qi-Jun Zhang,et al.  Device and circuit-level modeling using neural networks with faster training based on network sparsity , 1997 .

[25]  S. Prasad,et al.  Creating neural network based microwave circuit models for analysis and synthesis , 1997, Proceedings of 1997 Asia-Pacific Microwave Conference.

[26]  G. L. Creech,et al.  Artificial neural networks for accurate microwave CAD applications , 1996, 1996 IEEE MTT-S International Microwave Symposium Digest.

[27]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[28]  K.C. Gupta,et al.  EM-ANN modeling of overlapping open-ends in multilayer microstrip lines for design of bandpass filters , 1999, IEEE Antennas and Propagation Society International Symposium. 1999 Digest. Held in conjunction with: USNC/URSI National Radio Science Meeting (Cat. No.99CH37010).

[29]  Mankuan Vai,et al.  Neural networks in microwave circuit design?beyond black-box models (invited article) , 1999 .

[30]  Mauro Mongiardo,et al.  A review of artificial neural networks applications in microwave computer-aided design , 1999 .

[31]  Masahide Yoneyama,et al.  Millimeter-wave imaging using neural networks for object recognition , 1996, 1996 IEEE MTT-S International Microwave Symposium Digest.

[32]  Fang Wang,et al.  Incorporating functional knowledge into neural networks , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[33]  Y. Kitaura,et al.  A large-signal model of self-aligned gate GaAs FETs for high-efficiency power amplifier design , 1999, 1999 IEEE MTT-S International Microwave Symposium Digest (Cat. No.99CH36282).

[34]  Kuan-Kin Chan,et al.  A neural network approach to MVDR beamforming problem , 1992 .

[35]  S. Manetti,et al.  Design of cylindrical posts in rectangular waveguide by neural network approach , 2000, IEEE Antennas and Propagation Society International Symposium. Transmitting Waves of Progress to the Next Millennium. 2000 Digest. Held in conjunction with: USNC/URSI National Radio Science Meeting (C.

[36]  Qi-Jun Zhang,et al.  Neural Networks for RF and Microwave Design , 2000 .

[37]  Qi-Jun Zhang,et al.  A Hybrid Neural and Circuit-Based Model Structure for Microwave Modeling , 1999, 1999 29th European Microwave Conference.

[38]  S.M. El-Ghazaly,et al.  A global modeling approach using artificial neural network , 1999, 1999 IEEE MTT-S International Microwave Symposium Digest (Cat. No.99CH36282).

[39]  Chen He,et al.  Using artificial neural network approach to predict rain attenuation on Earth-space path , 2000 .

[40]  M. Vai,et al.  Microwave circuit analysis and design by a massively distributed computing network , 1995 .

[41]  M. Vai,et al.  Automatic impedance matching with a neural network , 1993, IEEE Microwave and Guided Wave Letters.

[42]  S. Prasad,et al.  Qualitatively modeling heterojunction bipolar transistors for optimization: a neural network approach , 1993, Proceedings of IEEE/Cornell Conference on Advanced Concepts in High Speed Semiconductor Devices and Circuits.

[43]  G. Castaldi,et al.  Neural net aided fault diagnostics of large antenna arrays , 1999, IEEE Antennas and Propagation Society International Symposium. 1999 Digest. Held in conjunction with: USNC/URSI National Radio Science Meeting (Cat. No.99CH37010).

[44]  Geoffrey E. Hinton,et al.  Phoneme recognition using time-delay neural networks , 1989, IEEE Trans. Acoust. Speech Signal Process..

[45]  K. C. Gupta,et al.  Design and optimization of CPW circuits using EM-ANN models for CPW components , 1997 .

[46]  Giuseppe Pelosi,et al.  Direct-coupled cavity filters design using a hybrid feedforward neural network–finite elements procedure , 1999 .

[47]  M. S. Nakhla,et al.  Optimization of high-speed VLSI interconnects , 1996, 1996 Symposium on Antenna Technology and Applied Electromagnetics.

[48]  Fang Wang,et al.  A new macromodeling approach for nonlinear microwave circuits based on recurrent neural networks , 2000, 2000 IEEE MTT-S International Microwave Symposium Digest (Cat. No.00CH37017).

[49]  Qi-Jun Zhang,et al.  Neural Network Structures and Training Algorithms for RF and Microwave Applications , 1999 .

[50]  Rabindra K. Mishra,et al.  Neural network-based CAD model for the design of square-patch antennas , 1998 .

[51]  Michel Nakhla,et al.  A neural network modeling approach to circuit optimization and statistical design , 1995 .

[52]  L.L. Liou,et al.  Input variable space reduction using dimensional analysis for artificial neural network modeling [of MMICs] , 1999, 1999 IEEE MTT-S International Microwave Symposium Digest (Cat. No.99CH36282).

[53]  Fang Wang,et al.  Knowledge based neural models for microwave design , 1997, IMS 1997.

[54]  Denis Barataud,et al.  The use of artificial neural networks in nonlinear microwave devices and circuits modeling: An application to telecommunication system design (invited article) , 1999 .

[55]  Michel Nakhla,et al.  Analysis and optimization of microwave circuits and devices using neural network models , 1994, 1994 IEEE MTT-S International Microwave Symposium Digest (Cat. No.94CH3389-4).

[56]  J.W. Bandler,et al.  Neuromodeling of microwave circuits exploiting space mapping technology , 1999, 1999 IEEE MTT-S International Microwave Symposium Digest (Cat. No.99CH36282).

[57]  John W. Bandler,et al.  A nonlinear l_1 optimization algorithm for design, modeling, and diagnosis of networks , 1987 .

[58]  Mehmet Erler,et al.  Calculation of bandwidth for electrically thin and thick rectangular microstrip antennas with the use of multilayered perceptrons , 1999 .

[59]  S. Caorsi,et al.  Time domain inverse scattering by means of neural networks , 2000, IEEE Antennas and Propagation Society International Symposium. Transmitting Waves of Progress to the Next Millennium. 2000 Digest. Held in conjunction with: USNC/URSI National Radio Science Meeting (C.

[60]  Hongwei Yang,et al.  Using artificial neural network approach to predict rain attenuation on Earth-space path , 2000, IEEE Antennas and Propagation Society International Symposium. Transmitting Waves of Progress to the Next Millennium. 2000 Digest. Held in conjunction with: USNC/URSI National Radio Science Meeting (C.

[61]  Joy Laskar,et al.  An improved deep sub-micron MOSFET RF nonlinear model with new breakdown current model and drain to substrate nonlinear coupling , 2000, 2000 IEEE MTT-S International Microwave Symposium Digest (Cat. No.00CH37017).

[62]  Tom Dhaene,et al.  Adaptive Sampling Algorithm for Accurate Modeling of General Interconnection Structures , 1999, 1999 29th European Microwave Conference.

[63]  Peter H. Ladbrooke,et al.  MMIC Design GaAs FETs and HEMTs , 1989 .

[64]  J Rousset,et al.  An accurate neural network model of FET for intermodulation and power analysis , 1996, 1996 26th European Microwave Conference.

[65]  Adrian J. Shepherd.  Second-Order Optimisation Methods , 1997 .

[66]  O. L. Davies,et al.  The Design and Analysis of Experiments , 1953 .

[67]  Christos G. Christodoulou,et al.  Neural network-based adaptive beamforming for one- and two-dimensional antenna arrays , 1998 .

[68]  C.G. Christodoulou,et al.  Neural network processing for adaptive array antennas , 1999, IEEE Antennas and Propagation Society International Symposium. 1999 Digest. Held in conjunction with: USNC/URSI National Radio Science Meeting (Cat. No.99CH37010).

[69]  Kuldip Gupta,et al.  EM-ANN models for via interconnects in microstrip circuits , 1996, 1996 IEEE MTT-S International Microwave Symposium Digest.

[70]  V. A. Monaco,et al.  A nonlinear integral model of electron devices for HB circuit analysis , 1992 .

[71]  Russell Reed,et al.  Pruning algorithms-a survey , 1993, IEEE Trans. Neural Networks.

[72]  Jean-Jacques Laurin,et al.  An implementation of a direction-finding antenna for mobile communications using a neural network , 1999 .

[73]  Ganesh Kothapalli.  Artificial neural networks as aids in circuit design , 1995 .

[74]  James Aweya,et al.  A direct adaptive neural controller for flow control in computer networks , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[75]  M.M. Vai,et al.  Applications of neural networks optimized by the genetic algorithm to microwave systems , 1999, IEEE Antennas and Propagation Society International Symposium. 1999 Digest. Held in conjunction with: USNC/URSI National Radio Science Meeting (Cat. No.99CH37010).

[76]  S. Selleri,et al.  An artificial neural network for the analysis of profiled corrugated circular horns , 1999, IEEE Antennas and Propagation Society International Symposium. 1999 Digest. Held in conjunction with: USNC/URSI National Radio Science Meeting (Cat. No.99CH37010).

[77]  Uwe Beyer,et al.  Data exploration with reflective adaptive models , 1996 .

[78]  J.W. Bandler,et al.  Neural space mapping EM optimization of microwave structures , 2000, 2000 IEEE MTT-S International Microwave Symposium Digest (Cat. No.00CH37017).

[79]  Dominique Baillargeat,et al.  An accurate wavelet neural-network-based model for electromagnetic optimization of microwave circuits , 1999 .

[80]  A.K.Y. Lai,et al.  Function-based and physics-based hybrid modular neural network for radio wave propagation modeling , 2000, IEEE Antennas and Propagation Society International Symposium. Transmitting Waves of Progress to the Next Millennium. 2000 Digest. Held in conjunction with: USNC/URSI National Radio Science Meeting (C.

[81]  Fang Wang,et al.  A hierarchical neural network approach to the development of library of neural models for microwave design , 1998, IMS 1998.

[82]  M. Mongiardo,et al.  A neural network model for CAD and optimization of microwave filters , 1998, 1998 IEEE MTT-S International Microwave Symposium Digest (Cat. No.98CH36192).

[83]  Adam Krzyzak,et al.  Radial Basis Function Networks and Complexity Regularization in Function Learning , 2022 .

[84]  W. Press,et al.  Numerical Recipes: The Art of Scientific Computing , 1987 .

[85]  S. Prasad,et al.  Reverse modeling of microwave circuits with bidirectional neural network models , 1998 .

[86]  Naofumi Okubo,et al.  Structural determination of multilayered large-signal neural-network HEMT model , 1998 .

[87]  Fang Wang,et al.  Optimization of high‐speed VLSI interconnects: A review (invited article) , 1997 .

[88]  Yoshiaki Kitaura,et al.  A large-signal model of self-aligned gate GaAs FETs for high-efficiency power amplifier design , 1999, IMS 1999.

[89]  Peter B. L. Meijer,et al.  Fast and smooth highly nonlinear multidimensional table models for device modeling , 1990 .

[90]  L. R. Bragg,et al.  Pitman research notes in mathematics series, 0269-3674; 154 on Oakland conference on partial differential equations and applied mathematics , 1986 .

[91]  Qi-Jun Zhang,et al.  Ultra fast neural models for analysis of electro/optical interconnects , 1997, 1997 Proceedings 47th Electronic Components and Technology Conference.

[92]  K.C. Gupta,et al.  Knowledge based EM-ANN models for the design of wide bandwidth CPW patch/slot antennas , 1999, IEEE Antennas and Propagation Society International Symposium. 1999 Digest. Held in conjunction with: USNC/URSI National Radio Science Meeting (Cat. No.99CH37010).

[93]  G. L. Creech,et al.  Artificial neural networks for fast and accurate EM-CAD of microwave circuits , 1997 .

[94]  Joy Laskar,et al.  An improved deep submicrometer MOSFET RF nonlinear model with new breakdown current model and drain-to-substrate nonlinear coupling , 2000, IMS 2000.

[95]  James T. Kwok,et al.  Constructive algorithms for structure learning in feedforward neural networks for regression problems , 1997, IEEE Trans. Neural Networks.

[96]  V.K. Devabhaktuni,et al.  Neural network structures for EM/microwave modeling , 1999, IEEE Antennas and Propagation Society International Symposium. 1999 Digest. Held in conjunction with: USNC/URSI National Radio Science Meeting (Cat. No.99CH37010).

[97]  Kim Halskov,et al.  The Huber concept in device modeling, circuit diagnosis and design centering , 1994, Proceedings of IEEE International Symposium on Circuits and Systems - ISCAS '94.

[98]  Naofumi Okubo,et al.  A large-signal characterization of an HEMT using a multilayered neural network , 1997 .

[99]  P.M. Watson,et al.  Development of knowledge based artificial neural network models for microwave components , 1998, 1998 IEEE MTT-S International Microwave Symposium Digest (Cat. No.98CH36192).

[100]  Jose C. Pedro,et al.  Modeling MESFETs and HEMTs intermodulation distortion behavior using a generalized radial basis function network , 1999 .

[101]  Giulio Antonini,et al.  Gradient evaluation for neural-networks-based electromagnetic optimization procedures , 2000 .

[102]  G. L. Creech.  Neural networks for the design and fabrication of integrated circuits for aerospace applications , 1997, 1997 IEEE Aerospace Conference.

[103]  Kuldip Gupta,et al.  Electromagnetic‐artificial neural network model for synthesis of physical dimensions for multilayer asymmetric coupled transmission structures (invited article) , 1999 .

[104]  S. M. Sze,et al.  Physics of semiconductor devices , 1969 .

[105]  Thomas R. Cuthbert,et al.  Optimization Using Personal Computers: With Applications to Electrical Networks , 1987 .

[106]  William H. Press,et al.  Numerical recipes in C. The art of scientific computing , 1987 .