A universal statistical test for random bit generators

A new statistical test for random bit generators is presented which, in contrast to presently used statistical tests, is universal in the sense that it can detect any significant deviation of a device's output statistics from the statistics of a truly random bit source when the device can be modeled as an ergodic stationary source with finite memory but arbitrary (unknown) state transition probabilities. The test parameter is closely related to the device's per-bit entropy which is shown to be the correct quality measure for a secret-key source in a cryptographic application. The test hence measures the cryptographic badness of a device's possible defect. The test is easy to implement and very fast and thus well suited for practical applications. A sample program listing is provided.

[1]  J. Ziv.  Compression, tests for randomness and estimating the statistical model of an individual sequence , 1990 .

[2]  J. L. Massey,et al.  An introduction to contemporary cryptology , 1988, Proc. IEEE.

[3]  S. Lin,et al.  ON SEQUENTIAL DECODING , 1967 .

[4]  Frans M. J. Willems,et al.  Universal data compression and repetition times , 1989, IEEE Trans. Inf. Theory.

[5]  Edward C. van der Meulen,et al.  Entropy-Based Tests of Uniformity , 1981 .

[6]  Donald Ervin Knuth,et al.  The Art of Computer Programming , 1968 .

[7]  Per Martin-Löf,et al.  The Definition of Random Sequences , 1966, Inf. Control..

[8]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[9]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1951 .

[10]  Peter Elias,et al.  Interval and recency rank source coding: Two on-line adaptive variable-length schemes , 1987, IEEE Trans. Inf. Theory.

[11]  Abraham Lempel,et al.  A universal algorithm for sequential data compression , 1977, IEEE Trans. Inf. Theory.

[12]  Richard E. Blahut,et al.  Principles and practice of information theory , 1987 .

[13]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1967 .

[14]  M. W. Shields.  An Introduction to Automata Theory , 1988 .

[15]  A. Kolmogorov.  Three approaches to the quantitative definition of information , 1968 .

[16]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .