On Regularity of Unary Probabilistic Automata

The quantitative verification of Probabilistic Automata (PA) is undecidable in general. Unary PA are a simpler model where the choice of action is fixed. Still, the quantitative verification problem is open and known to be as hard as Skolem's problem, a problem on linear recurrence sequences, whose decidability is open for at least 40 years. In this paper, we approach this problem by studying the languages generated by unary PAs (as defined below), whose regularity would entail the decidability of quantitative verification. Given an initial distribution, we represent the trajectory of a unary PA over time as an infinite word over a finite alphabet, where the n th letter represents a probability range after n steps. We extend this to a language of trajectories (a set of words), one trajectory for each initial distribution from a (possibly infinite) set. We show that if the eigenvalues of the transition matrix associated with the unary PA are all distinct positive real numbers, then the language is effectively regular. Further, we show that this result is at the boundary of regularity, as non-regular languages can be generated when the restrictions are even slightly relaxed. The regular representation of the language allows us to reason about more general properties, e.g., robustness of a regular property in a neighbourhood around a given distribution.

[1]  Azaria Paz,et al.  Probabilistic automata , 2003 .

[2]  Hugo Gimbert,et al.  Probabilistic Automata on Finite Words: Decidable and Undecidable Problems , 2010, ICALP.

[3]  Alberto Bertoni,et al.  The Solution of Problems Relative to Probabilistic Automata in the Frame of the Formal Languages Theory , 1974, GI Jahrestagung.

[4]  Joël Ouaknine,et al.  On the Positivity Problem for Simple Linear Recurrence Sequences, , 2013, ICALP.

[5]  Mariëlle Stoelinga,et al.  An Introduction to Probabilistic Automata , 2002, Bull. EATCS.

[6]  P. S. Thiagarajan,et al.  Approximate Verification of the Symbolic Dynamics of Markov Chains , 2012, 2012 27th Annual IEEE Symposium on Logic in Computer Science.

[7]  Hugo Gimbert,et al.  Deciding the Value 1 Problem for Probabilistic Leaktight Automata , 2011, 2012 27th Annual IEEE Symposium on Logic in Computer Science.

[8]  B. Genest,et al.  2 On Regularity of unary Probabilistic Automata , 2018 .

[9]  Paavo Turakainen,et al.  On Stochastic Languages , 1968, Inf. Control..

[10]  Mahesh Viswanathan,et al.  Decidable Problems for Unary PFAs , 2014, QEST.

[11]  Krishnendu Chatterjee,et al.  Decidable Problems for Probabilistic Automata on Infinite Words , 2011, 2012 27th Annual IEEE Symposium on Logic in Computer Science.

[12]  Mahesh Viswanathan,et al.  Reasoning about MDPs as Transformers of Probability Distributions , 2010, 2010 Seventh International Conference on the Quantitative Evaluation of Systems.

[13]  A. Bertoni The Solution of Problems Relative to Probabilistic Automata in the Frame of the Formal Languages Theory , 1974, GI Jahrestagung.

[14]  Anne Condon,et al.  On the undecidability of probabilistic planning and related stochastic optimization problems , 2003, Artif. Intell..

[15]  Christer Lech,et al.  A note on recurring series , 1953 .

[16]  Joël Ouaknine,et al.  Ultimate Positivity is Decidable for Simple Linear Recurrence Sequences , 2013, ICALP.

[17]  Christel Baier,et al.  Probabilistic ω-automata , 2012, JACM.

[18]  Tero Harju,et al.  Positivity of second order linear recurrent sequences , 2006, Discret. Appl. Math..

[19]  Joël Ouaknine,et al.  Positivity Problems for Low-Order Linear Recurrence Sequences , 2013, SODA.

[20]  Joël Ouaknine,et al.  Decision Problems for Linear Recurrence Sequences , 2012, SCSS.

[21]  Eugenio Cinquemani,et al.  Towards Real-Time Control of Gene Expression at the Single Cell Level: A Stochastic Control Approach , 2014, CMSB.

[22]  Joël Ouaknine,et al.  Reachability problems for Markov chains , 2015, Inf. Process. Lett..