The ANYNT project intelligence test Λone

All tests in psychometrics, comparative psychology and cognition which have been put into practice lack a mathematical (computational) foundation or lack the capability to be applied to any kind of system (humans, non-human animals, machines, hybrids, collectives, etc.). In fact, most of them lack both things. In the past fifteen years, some efforts have been done to derive intelligence tests from formal intelligence definitions or vice versa, grounded on computational concepts. However, some of these approaches have not been able to create universal tests (i.e., tests which can evaluate any kind of subjects) and others have even failed to make a feasible test. The ANYNT project was conceived to explore the possibility of defining formal, universal and anytime intelligence tests, having a feasible implementation in mind. This paper presents the basics of the theory behind the ANYNT project and describes one of the test propotypes that were developed in the project: test Λone.

[1]  José Hernández-Orallo,et al.  On Evaluating Agent Performance in a Fixed Period of Time (Extended Version) , 2010, AGI 2010.

[2]  Ming Li,et al.  An Introduction to Kolmogorov Complexity and Its Applications , 2019, Texts in Computer Science.

[3]  C. S. Wallace,et al.  An Information Measure for Classification , 1968, Comput. J..

[4]  Peter Grünwald,et al.  Invited review of the book Statistical and Inductive Inference by Minimum Message Length , 2006 .

[5]  Joel Veness,et al.  A Monte-Carlo AIXI Approximation , 2009, J. Artif. Intell. Res..

[6]  José Hernández-Orallo.  Constructive reinforcement learning , 2000, Int. J. Intell. Syst..

[7]  M. Tomasello,et al.  Humans Have Evolved Specialized Skills of Social Cognition: The Cultural Intelligence Hypothesis , 2007, Science.

[8]  M. Tomasello,et al.  The Structure of Individual Differences in the Cognitive Abilities of Children and Chimpanzees , 2010, Psychological science.

[9]  C. Q. Lee,et al.  The Computer Journal , 1958, Nature.

[10]  José Hernández-Orallo,et al.  On More Realistic Environment Distributions for Defining, Evaluating and Developing Intelligence , 2011, AGI.

[11]  John Langford,et al.  Telling humans and computers apart automatically , 2004, CACM.

[12]  Shane Legg,et al.  Universal Intelligence: A Definition of Machine Intelligence , 2007, Minds and Machines.

[13]  José Hernández-Orallo,et al.  Measuring universal intelligence: Towards an anytime intelligence test , 2010, Artif. Intell..

[14]  Joel Veness,et al.  Reinforcement Learning via AIXI Approximation , 2010, AAAI.

[15]  José Hernández-Orallo,et al.  Comparing Humans and AI Agents , 2011, AGI.

[16]  Ray J. Solomonoff,et al.  A Formal Theory of Inductive Inference. Part I , 1964, Inf. Control..

[17]  Dina Q. Goldin,et al.  Indirect Interaction in Environments for Multi-agent Systems , 2005, E4MAS.

[18]  Shane Legg,et al.  A Universal Measure of Intelligence for Artificial Agents , 2005, IJCAI.

[19]  Martin Ziegler,et al.  Variations of the Turing Test in the Age of Internet and Virtual Reality , 2009, KI.

[20]  José Hernández-Orallo,et al.  On the Computational Measurement of Intelligence Factors , 2011 .

[21]  José Hernández-Orallo,et al.  Evaluating a Reinforcement Learning Algorithm with a General Intelligence Test , 2011, CAEPIA.

[22]  John R. Searle,et al.  Minds, brains, and programs , 1980, Behavioral and Brain Sciences.

[23]  José Hernández-Orallo.  A (hopefully) Unbiased Universal Environment Class for Measuring Intelligence of Biological and Artificial Systems , 2009, AGI 2010.

[24]  David L. Dowe,et al.  A computer program capable of passing I.Q. tests , 2008 .

[25]  David L. Dowe,et al.  Minimum Message Length and Kolmogorov Complexity , 1999, Comput. J..

[26]  Marcus Hutter,et al.  Universal Artificial Intellegence - Sequential Decisions Based on Algorithmic Probability , 2005, Texts in Theoretical Computer Science. An EATCS Series.

[27]  David L. Dowe,et al.  A Non-Behavioural, Computational Extension to the Turing Test , 1998 .

[28]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[29]  Itamar Arel,et al.  Beyond the Turing Test , 2009, Computer.

[30]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[31]  J. Hernández-Orallo,et al.  IQ tests are not for machines, yet , 2012 .

[32]  David L. Dowe,et al.  A computational extension to the Turing test , 1997 .

[33]  Marcus Hutter,et al.  Universal Algorithmic Intelligence: A Mathematical Top→Down Approach , 2007, Artificial General Intelligence.

[34]  D. Washburn,et al.  Exploration of virtual mazes by rhesus monkeys (Macaca mulatta) , 2003, Animal Cognition.

[35]  David L. Dowe,et al.  Foreword re C. S. Wallace , 2008, Comput. J..