Guessing Individual Sequences: Generating Randomized Guesses Using Finite–State Machines

Motivated by earlier results on universal randomized guessing, we consider an individual–sequence approach to the guessing problem: in this setting, the goal is to guess a secret, individual (deterministic) vector <inline-formula> <tex-math notation="LaTeX">$x^{n}=(x_{1},\ldots,x_{n})$ </tex-math></inline-formula>, by using a finite–state machine that sequentially generates randomized guesses from a stream of purely random bits. We define the finite–state guessing exponent as the asymptotic normalized logarithm of the minimum achievable moment of the number of randomized guesses, generated by any finite–state machine, until <inline-formula> <tex-math notation="LaTeX">$x^{n}$ </tex-math></inline-formula> is guessed successfully. We show that the finite–state guessing exponent of any sequence is intimately related to its finite–state compressibility (due to Lempel and Ziv), and it is asymptotically achieved by the decoder of (a certain modified version of) the 1978 Lempel–Ziv data compression algorithm (a.k.a. the LZ78 algorithm), fed by purely random bits. The results are also extended to the case where the guessing machine has access to a side information sequence, <inline-formula> <tex-math notation="LaTeX">$y^{n}=(y_{1},\ldots,y_{n})$ </tex-math></inline-formula>, which is also an individual sequence.

[1]  Muriel Médard,et al.  Why Botnets Work: Distributed Brute-Force Attacks Need No Synchronization , 2018, IEEE Transactions on Information Forensics and Security.

[2]  Neri Merhav,et al.  Universal prediction of individual sequences , 1992, IEEE Trans. Inf. Theory.

[3]  Erdal Arikan An inequality on guessing and its application to sequential decoding , 1996, IEEE Trans. Inf. Theory.

[4]  Thomas M. Cover,et al.  Elements of Information Theory: Cover/Elements of Information Theory, Second Edition , 2005 .

[5]  Meir Feder,et al.  Gambling using a finite state machine , 1991, IEEE Trans. Inf. Theory.

[6]  Neri Merhav,et al.  Universal coding with minimum probability of codeword length overflow , 1991, IEEE Trans. Inf. Theory.

[7]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[8]  Abraham Lempel,et al.  On the Complexity of Finite Sequences , 1976, IEEE Trans. Inf. Theory.

[9]  Abraham Lempel,et al.  Compression of individual sequences via variable-rate coding , 1978, IEEE Trans. Inf. Theory.

[10]  Neri Merhav,et al.  Perfectly Secure Encryption of Individual Sequences , 2011, IEEE Transactions on Information Theory.

[11]  Neri Merhav,et al.  Universal Randomized Guessing With Application to Asynchronous Decentralized Brute–Force Attacks , 2020, IEEE Transactions on Information Theory.

[12]  J. Massey Guessing and entropy , 1994, Proceedings of 1994 IEEE International Symposium on Information Theory.

[13]  Jacob Ziv,et al.  Universal decoding for finite-state channels , 1985, IEEE Trans. Inf. Theory.

[14]  Neri Merhav Universal detection of messages via finite-state channels , 2000, IEEE Trans. Inf. Theory.

[15]  Shigeaki Kuzuoka,et al.  Conditional Lempel-Ziv complexity and its application to source coding theorem with side information , 2003, IEEE International Symposium on Information Theory, 2003. Proceedings..