Methods and Techniques for Accurate and Reliable Measurement and Estimation of Distribution Functions in Real Time

Three methods for the probability distribution function F(x) estimation, based on the traditional Monte Carlo method, the Chebyshev inequality, and the theorems of Smirnov and Kolmogorov, are developed and compared. The methods are based on the functional dependence of the sample size n on the estimated value of F(x) with an accuracy factor as a parameter. Expressions for this dependence are derived for all methods and compared. It is shown that the accuracy of the estimation can be expressed and controlled by two parameters: the confidence and the confidence limits factor. Based on the methods developed, two techniques for F(x) estimation are proposed and demonstrated: a technique with prespecified accuracy and a technique with controlled accuracy. The technique with controlled accuracy allows the processing of a random sample starting with a limited initial sample of observations and then proceeding with the processing on an observation-by-observation basis. This way, the time that is needed to sort the sample has been minimized, and the estimation of distribution functions in real-time has become possible. This technique is demonstrated by estimating the distribution functions of chaotic and Gaussian sequences that are applied in code-division multiple-access (CDMA) systems.

[1]  Marco Gamassi,et al.  Quality assessment of biometric systems: a comprehensive perspective based on accuracy and performance measurement , 2005, IEEE Transactions on Instrumentation and Measurement.

[2]  C. K. Michael Tse,et al.  Exact analytical bit error rates for multiple access chaos-based communication systems , 2004, IEEE Transactions on Circuits and Systems II: Express Briefs.

[3]  S.M. Berber,et al.  An automated method for BER characteristics measurement , 2001, IMTC 2001. Proceedings of the 18th IEEE Instrumentation and Measurement Technology Conference. Rediscovering Measurement in the Age of Informatics (Cat. No.01CH 37188).

[4]  J. Kiefer,et al.  Asymptotic Minimax Character of the Sample Distribution Function and of the Classical Multinomial Estimator , 1956 .

[5]  Daniel N. Aloi,et al.  A Methodology for the Evaluation of a GPS Receiver Performance in Telematics Applications , 2007, IEEE Transactions on Instrumentation and Measurement.

[6]  Aarnout Brombacher,et al.  Probability... , 2009, Qual. Reliab. Eng. Int..

[7]  S.M. Berber Noise Phase Shift Keying for Secure Multiuser Code Division Communication Systems , 2006, MILCOM 2006 - 2006 IEEE Military Communications conference.

[8]  Alfréd Rényi,et al.  Probability Theory , 1970 .

[9]  Stevan M. Berber Methods and techniques for parameter and distribution function estimation in cascaded digital channels with and without memory , 2001 .

[10]  Carlo Muscas,et al.  Modeling ADC Nonlinearity in Monte Carlo Procedures for Uncertainty Estimation , 2006, IEEE Transactions on Instrumentation and Measurement.

[11]  Athanasios Papoulis,et al.  Probability, Random Variables and Stochastic Processes , 1965 .

[12]  Yih-Chyun Jenq,et al.  Ratio indicator characterization for measuring the precision of an estimate obtained by processing sampled data , 2005, IEEE Trans. Instrum. Meas..

[13]  M. B. Brilliant Observations of errors and error rates on T1 digital repeatered lines , 1978, The Bell System Technical Journal.

[14]  Gilles Fleury,et al.  Bootstrap methods for a measurement estimation problem , 2006, IEEE Transactions on Instrumentation and Measurement.

[15]  Stevan M. Berber,et al.  Investigation on operations of a secure communication system based on the chaotic phase shift keying scheme , 2005, Third International Conference on Information Technology and Applications (ICITA'05).

[16]  Gilles Fleury,et al.  Markov chain Monte Carlo posterior density approximation for a groove-dimensioning purpose , 2006, IEEE Transactions on Instrumentation and Measurement.

[17]  Bruno O. Shubert,et al.  Random variables and stochastic processes , 1979 .

[18]  Robert V. Brill,et al.  Applied Statistics and Probability for Engineers , 2004, Technometrics.

[19]  William Turin,et al.  Modeling Error Sources in Digital Channels , 1993, IEEE J. Sel. Areas Commun..

[20]  Pedro M. Crespo,et al.  Hidden Markov models for burst error characterization in indoor radio channels , 1997 .

[21]  A.R.K. Sastry,et al.  Models for channels with memory and their applications to error control , 1978, Proceedings of the IEEE.

[22]  Stevan M. Berber,et al.  Performance Analysis of a Chaos-Based Multi-User Communication System Implemented in DSP Technology , 2007 .

[23]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .