On the Power of Finite Automata with Both Nondeterministic and Probabilistic States

We study finite automata with both nondeterministic and random states (npfa's). We restrict our attention to those npfa's that accept their languages with a small probability of error and run in polynomial expected time. Equivalently, we study Arthur--Merlin games where Arthur is limited to polynomial time and constant space. Dwork and Stockmeyer [SIAM J. Comput., 19 (1990), pp. 1011--1023] asked whether these npfa's accept only the regular languages (this was known if the automaton has only randomness or only nondeterminism). We show that the answer is yes in the case of npfa's with a 1-way input head. We also show that if L is a nonregular language, then either L or $\bar{L}$ is not accepted by any npfa with a 2-way input head. Toward this end, we define a new measure of the complexity of a language L, called its 1-tiling complexity. For each $n$, this is the number of tiles needed to cover the 1's in the "characteristic matrix" of L, namely, the binary matrix with a row and column for each string of length $\le n$, where entry [x,y]=1 if and only if the string $xy \in L$. We show that a language has constant 1-tiling complexity if and only if it is regular, from which the result on 1-way input follows. Our main result regarding the general 2-way input tape follows by contrasting two bounds: an upper bound of polylog(n) on the 1-tiling complexity of every language computed by our model and a lower bound stating that the 1-tiling complexity of a nonregular language or its complement exceeds a function in $2^{\Omega (\sqrt{\log n})}$ infinitely often. The last lower bound follows by proving that the characteristic matrix of every nonregular language has rank n for infinitely many n. This is our main technical result, and its proof extends techniques of Frobenius and Iohvidov developed for Hankel matrices [Sitzungsber. der Konigl. Preuss. Akad. der Wiss., 1894, pp. 407--431], [Hankel and Toeplitz Matrices and Forms: Algebraic Theory, Birkhauser, Boston, 1982].

[1]  J. Milnor Games Against Nature , 1951 .

[2]  Dana S. Scott,et al.  Finite Automata and Their Decision Problems , 1959, IBM J. Res. Dev..

[3]  Richard M. Karp,et al.  Some Bounds on the Storage Requirements of Sequential Machines and Turing Machines , 1967, JACM.

[4]  J. Orlin Contentment in graph theory: Covering graphs with cliques , 1977 .

[5]  Arto Salomaa,et al.  Automata-Theoretic Aspects of Formal Power Series , 1978, Texts and Monographs in Computer Science.

[6]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .

[7]  Rusins Freivalds,et al.  Probabilistic Two-Way Machines , 1981, MFCS.

[8]  Kurt Mehlhorn,et al.  Las Vegas is better than determinism in VLSI and distributed computing (Extended Abstract) , 1982, STOC '82.

[9]  Alfred V. Aho,et al.  On notions of information transfer in VLSI circuits , 1983, STOC.

[10]  Andrew C. Yao,et al.  Lower bounds by probabilistic arguments , 1983, 24th Annual Symposium on Foundations of Computer Science (sfcs 1983).

[11]  Christos H. Papadimitriou,et al.  Games against nature , 1985, 24th Annual Symposium on Foundations of Computer Science (sfcs 1983).

[12]  W. Ledermann,et al.  HANKEL AND TOEPLITZ MATRICES AND FORMS: Algebraic Theory , 1983 .

[13]  Albert G. Greenberg,et al.  A Lower Bound for Probabilistic Algorithms for Finite State Machines , 1984, J. Comput. Syst. Sci..

[14]  Richard E. Ladner,et al.  Probabilistic Game Automata , 1986, J. Comput. Syst. Sci..

[15]  Rüdiger Reischuk,et al.  On different modes of communication , 1988, STOC '88.

[16]  László Babai,et al.  Arthur-Merlin Games: A Randomized Proof System, and a Hierarchy of Complexity Classes , 1988, J. Comput. Syst. Sci..

[17]  M. W. Shields An Introduction to Automata Theory , 1988 .

[18]  Richard E. Ladner,et al.  Probabilistic Game Automata , 1988, J. Comput. Syst. Sci..

[19]  Anne Condon,et al.  Computational models of games , 1989, ACM distinguished dissertations.

[20]  Rusins Freivalds,et al.  Minimal Nontrivial Space Complexity of Probabilistic One-Way Turing Machines , 1990, MFCS.

[21]  Cynthia Dwork,et al.  A Time Complexity Gap for Two-Way Probabilistic Finite-State Automata , 1990, SIAM J. Comput..

[22]  Rusins Freivalds,et al.  Running Time to Recognize Nonregular Languages by 2-Way Probabilistic Automata , 1991, ICALP.

[23]  Janis Kaneps Regularity of One-Letter Languages Acceptable by 2-Way Finite Probabilistic Automata , 1991, FCT.

[24]  Carsten Lund,et al.  Interactive Proof Systems and Alternating Time-Space Complexity , 1991, STACS.

[25]  Cynthia Dwork,et al.  Finite state verifiers I: the power of interaction , 1992, JACM.

[26]  Carsten Lund,et al.  Proof verification and hardness of approximation problems , 1992, Proceedings., 33rd Annual Symposium on Foundations of Computer Science.

[27]  Jeffrey Shallit,et al.  Automaticity: Properties of a Measure of Descriptional Complexity , 1994, STACS.

[28]  Lisa Hellerstein,et al.  On the power of finite automata with both nondeterministic and probabilistic states (preliminary version) , 1994, STOC '94.