Most Programs Stop Quickly or Never Halt

The aim of this paper is to provide a probabilistic, but non-quantum, analysis of the Halting Problem. Our approach is to have the probability space extend over both space and time and to consider the probability that a random N-bit program has halted by a random time. We postulate an a priori computable probability distribution on all possible runtimes and we prove that given an integer k>0, we can effectively compute a time bound T such that the probability that an N-bit program will eventually halt given that it has not halted by T is smaller than 2^-^k. We also show that the set of halting programs (which is computably enumerable, but not computable) can be written as a disjoint union of a computable set and a set of effectively vanishing probability. Finally, we show that ''long'' runtimes are effectively rare. More formally, the set of times at which an N-bit program can stop after the time 2^N^+^c^o^n^s^t^a^n^t has effectively zero density.

[1]  Riccardo Poli,et al.  The Halting Probability in Von Neumann Architectures , 2006, EuroGP.

[2]  Cristian S. Calude,et al.  From Heisenberg to Gödel via Chaitin , 2004 .

[3]  Germano D'Abramo Asymptotic behavior and halting probability of Turing Machines , 2008 .

[4]  Cristian S. Calude,et al.  A New Measure of the Difficulty of Problems , 2006, J. Multiple Valued Log. Soft Comput..

[5]  Gregory J. Chaitin,et al.  A recent technical report , 1974, SIGA.

[6]  Martin Ziegler,et al.  Does Quantum Mechanics allow for Infinite Parallelism? , 2004 .

[7]  Cristian S. Calude,et al.  Natural halting probabilities, partial randomness, and zeta functions , 2006, Inf. Comput..

[8]  Cristian S. Calude,et al.  Computing a Glimpse of Randomness , 2002, Exp. Math..

[9]  T. Mexia,et al.  Author ' s personal copy , 2009 .

[10]  Christian Schindelhauer,et al.  On Approximating Real-World Halting Problems , 2005, FCT.

[11]  Cristian S. Calude,et al.  From Heisenberg to Gödel via Chaitin , 2005 .

[12]  Cristian S. Calude,et al.  Transcending the Limits of Turing Computability , 2003, quant-ph/0304128.

[13]  Martin Ziegler,et al.  Computational Power of Infinite Quantum Parallelism , 2005 .

[14]  Alex Kane,et al.  Coins , 1984 .

[15]  Cristian S. Calude,et al.  Finite Versus Infinite: Contributions to an Eternal Dilemma , 2000 .

[16]  Cristian Claude,et al.  Information and Randomness: An Algorithmic Perspective , 1994 .

[17]  N. Margolus,et al.  The maximum speed of dynamical evolution , 1997, quant-ph/9710043.

[18]  Elsevier Sdol,et al.  Advances in Applied Mathematics , 2009 .

[19]  Gregory J. Chaitin,et al.  Computing the Busy Beaver Function , 1987 .

[20]  Joel David Hamkins,et al.  The Halting Problem Is Decidable on a Set of Asymptotic Probability One , 2006, Notre Dame J. Formal Log..

[21]  Cristian S. Calude,et al.  Coins, Quantum Measurements, and Turing's Barrier , 2002, Quantum Inf. Process..

[22]  Cristian S. Calude Information and Randomness: An Algorithmic Perspective , 1994 .

[23]  Cristian S. Calude,et al.  Is complexity a source of incompleteness? , 2004, Adv. Appl. Math..

[24]  Thomas M. Cover,et al.  Open Problems in Communication and Computation , 2011, Springer New York.