Turing Tests with Turing Machines

Comparative tests work by finding the difference (or the absence of difference) between a reference subject and an evaluee. The Turing Test, in its standard interpretation, takes (a subset of) the human species as a reference. Motivated by recent findings and developments in the area of machine intelligence evaluation, we discuss what it would be like to have a Turing Test where the reference and the interrogator subjects are replaced by Turing Machines. This question sets the focus on several issues that are usually disregarded when dealing with the Turing Test, such as the degree of intelligence of reference and interrogator, the role of imitation (and not only prediction) in intelligence, its view from the perspective of game theory and others. Around these issues, this paper finally brings the Turing Test to the realm of Turing machines.

[1]  José Hernández-Orallo,et al.  Compression and Intelligence: Social Environments and Communication , 2011, AGI.

[2]  R. Buck,et al.  MICHAEL SCRIVEN AN ESSENTIAL UNPREDICTABILITY IN HUMAN BEHAVIOR * , 2006 .

[3]  John R. Searle,et al.  Minds, brains, and programs , 1980, Behavioral and Brain Sciences.

[4]  Bill Hibbard.  Measuring Agent Intelligence via Hierarchies of Environments , 2011, AGI.

[5]  Bill Hibbard.  Bias and No Free Lunch in Formal Measures of Intelligence , 2009, J. Artif. Gen. Intell..

[6]  David L. Dowe,et al.  MML, hybrid Bayesian network graphical models, statistical consistency, invarianc , 2010 .

[7]  A. Elo.  The rating of chessplayers, past and present , 1978 .

[8]  Ray J. Solomonoff,et al.  A Formal Theory of Inductive Inference. Part I , 1964, Inf. Control..

[9]  David L. Dowe,et al.  The Turing Test , 2003 .

[10]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[11]  G. Chaitin.  Gödel's theorem and information , 1982 .

[12]  J. Hernández-Orallo,et al.  IQ tests are not for machines, yet , 2012 .

[13]  Varol Akman,et al.  Turing Test: 50 Years Later , 2000, Minds and Machines.

[14]  Peter Grünwald,et al.  Invited review of the book Statistical and Inductive Inference by Minimum Message Length , 2006 .

[15]  José Hernández-Orallo,et al.  On More Realistic Environment Distributions for Defining, Evaluating and Developing Intelligence , 2011, AGI.

[16]  E. B. Andersen,et al.  Information Science and Statistics , 1986 .

[17]  Shane Legg,et al.  Tests of Machine Intelligence , 2006, 50 Years of Artificial Intelligence.

[18]  John Langford,et al.  Telling humans and computers apart automatically , 2004, CACM.

[19]  Jörgen W. Weibull,et al.  Evolutionary Game Theory , 1996 .

[20]  Gregory J. Chaitin,et al.  On the Length of Programs for Computing Finite Binary Sequences , 1966, JACM.

[21]  José Hernández-Orallo,et al.  Comparing Humans and AI Agents , 2011, AGI.

[22]  Shane Legg,et al.  An Approximation of the Universal Intelligence Measure , 2011, Algorithmic Probability and Friends.

[23]  José Hernández-Orallo,et al.  Beyond the Turing Test , 2000, J. Log. Lang. Inf..

[24]  C. S. Wallace,et al.  Statistical and Inductive Inference by Minimum Message Length (Information Science and Statistics) , 2005 .

[25]  Ray J. Solomonoff,et al.  A Formal Theory of Inductive Inference. Part II , 1964, Inf. Control..

[26]  José Hernández-Orallo,et al.  Evaluating a Reinforcement Learning Algorithm with a General Intelligence Test , 2011, CAEPIA.

[27]  C. S. Wallace,et al.  An Information Measure for Classification , 1968, Comput. J..

[28]  C. Cannings,et al.  Evolutionary Game Theory , 2010 .

[29]  David L. Dowe,et al.  A Non-Behavioural, Computational Extension to the Turing Test , 1998 .

[30]  Shane Legg,et al.  Universal Intelligence: A Definition of Machine Intelligence , 2007, Minds and Machines.

[31]  José Hernández-Orallo,et al.  Measuring universal intelligence: Towards an anytime intelligence test , 2010, Artif. Intell..

[32]  Philippe E. Ruiz.  Building and solving odd-one-out classification problems: A systematic approach , 2011 .

[33]  David L. Dowe,et al.  A computer program capable of passing I.Q. tests , 2008 .

[34]  David L. Dowe,et al.  Minimum Message Length and Kolmogorov Complexity , 1999, Comput. J..

[35]  Matthew V. Mahoney,et al.  Text Compression as a Test for Artificial Intelligence , 1999, AAAI/IAAI.

[36]  A. Kolmogorov.  Three approaches to the quantitative definition of information , 1968 .

[37]  E. Mark Gold,et al.  Language Identification in the Limit , 1967, Inf. Control..

[38]  Bill Hibbard.  Adversarial Sequence Prediction , 2008, AGI.

[39]  David Lewis,et al.  Scriven on human unpredictability , 1966 .