Stochastic gradient optimization of importance sampling for the efficient simulation of digital communication systems

Importance sampling (IS) techniques offer the potential for large speed-up factors for bit error rate (BER) estimation using Monte Carlo (MC) simulation. To obtain these speed-up factors, the IS parameters specifying the simulation probability density function (PDF) must be carefully chosen. With the increased complexity in communication systems, analytical optimization of the IS parameters can be virtually impossible. We present a new IS optimization algorithm based on stochastic gradient techniques. The formulation of the stochastic gradient descent (SGD) algorithm is more general and system-independent than other existing IS methodologies, and its applicability is not restricted to a specific PDF or biasing scheme. The effectiveness of the SGD algorithm is demonstrated by two examples of communication systems where the IS techniques have not been applied before. The first example is a communication system with diversity combining, slow nonselective Rayleigh fading channel, and noncoherent envelope detection. The second example is a binary baseband communication system with a static linear channel and a recursive least square (RLS) linear equalizer in the presence of additive white Gaussian noise (AWGN).

[1]  P. Balaban,et al.  A Modified Monte-Carlo Simulation Technique for the Evaluation of Error Rate in Digital Communication Systems , 1980, IEEE Trans. Commun..

[2]  John G. Proakis,et al.  Digital Communications , 1983 .

[3]  C. Nelson Dorny,et al.  A Vector Space Approach to Models and Optimization , 1983 .

[4]  Michel C. Jeruchim,et al.  Techniques for Estimating the Bit Error Rate in the Simulation of Digital Communication Systems , 1984, IEEE J. Sel. Areas Commun..

[5]  M. Metivier,et al.  Applications of a Kushner and Clark lemma to general classes of stochastic algorithms , 1984, IEEE Trans. Inf. Theory.

[6]  Peter W. Glynn,et al.  Proceedings of Ihe 1986 Winter Simulation , 2022 .

[7]  Bruce R. Davis An Improved Importance Sampling Method for Digital Communication System Simulations , 1986, IEEE Trans. Commun..

[8]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[9]  Peter W. Glynn,et al.  Likelilood ratio gradient estimation: an overview , 1987, WSC '87.

[10]  Kung Yao,et al.  Improved importance sampling technique for efficient simulation of digital communication systems , 1988, IEEE J. Sel. Areas Commun..

[11]  J.S. Sadowsky,et al.  On large deviations theory and asymptotically efficient Monte Carlo estimation , 1990, IEEE Trans. Inf. Theory.

[12]  Peter W. Glynn,et al.  Likelihood ratio gradient estimation for stochastic systems , 1990, CACM.

[13]  J.K. Townsend,et al.  Stochastic gradient techniques for the efficient simulation of high-speed networks using importance sampling , 1993, Proceedings of GLOBECOM '93. IEEE Global Telecommunications Conference.

[14]  Michael Devetsikiotis,et al.  Importance Sampling Methodologies for Simulation of Communication Systems with Time-Varying Channels and Adaptive Equalizers , 1993, IEEE J. Sel. Areas Commun..

[15]  Michael Devetsikiotis,et al.  An algorithmic approach to the optimization of importance sampling parameters in digital communication system simulation , 1993, IEEE Trans. Commun..

[16]  John S. Sadowsky,et al.  On Importance Sampling in Digital Communications - Part II: Trellis-Coded Modulation , 1993, IEEE J. Sel. Areas Commun..

[17]  Kung Yao,et al.  On Importance Sampling in Digital Communications - Part I: Fundamentals , 1993, IEEE J. Sel. Areas Commun..

[18]  Michael Devetsikiotis,et al.  Statistical optimization of dynamic importance sampling parameters for efficient simulation of communication networks , 1993, TNET.

[19]  P. Glynn LIKELIHOOD RATIO GRADIENT ESTIMATION : AN OVERVIEW by , 2022 .