Human misidentification in Turing tests

This paper presents some important issues on misidentification of human interlocutors in text-based communication during practical Turing tests. The study here presents transcripts in which human judges succumbed to theconfederate effect, misidentifying hidden human foils for machines. An attempt is made to assess the reasons for this. The practical Turing tests in question were held on 23 June 2012 at Bletchley Park, England. A selection of actual full transcripts from the tests is shown and an analysis is given in each case. As a result of these tests, conclusions are drawn with regard to the sort of strategies which can perhaps lead to erroneous conclusions when one is involved as an interrogator. Such results also serve to indicate conversational directions to avoid for those machine designers who wish to create a conversational entity that performs well on the Turing test.

[1]  Peter Rickman.  The Philosopher as Joker , 1999 .

[2]  Kevin Warwick,et al.  Some Implications of a Sample of Practical Turing Tests , 2013, Minds and Machines.

[3]  Gary Roberts,et al.  Parsing the Turing Test: Philosophical and Methodological Issues in the Quest for the Thinking Computer , 2008 .

[4]  Kenneth M. Ford,et al.  Turing Test Considered Harmful , 1995, IJCAI.

[5]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[6]  Golda Eldridge,et al.  Alan Turing: The Enigma , 2015 .

[7]  Stuart M. Shieber,et al.  Turing on the “Imitation Game” , 2004 .

[8]  Kevin Warwick,et al.  From the Buzzing in Turing’s Head to Machine Intelligence Contests , 2010 .

[9]  Kevin Warwick,et al.  Good Machine Performance in Turing's Imitation Game , 2014, IEEE Transactions on Computational Intelligence and AI in Games.

[10]  R. French.  The Turing Test: the first 50 years , 2000, Trends in Cognitive Sciences.

[11]  Steven Pinker,et al.  The mystery of consciousness. , 2007, Time.

[12]  Huma Shah.  Turing's misunderstood imitation game and IBM Watson's success , 2011 .

[13]  James H. Moor,et al.  The Turing Test: The Elusive Standard of Artificial Intelligence , 1989, Computational Linguistics.

[14]  F. M.,et al.  The Concise Oxford Dictionary of Current English , 1929, Nature.

[15]  Kevin Warwick,et al.  Artificial Intelligence: The Basics , 2011 .

[16]  Richard L. Purtill.  BEATING THE IMITATION GAME , 1971 .

[17]  Kevin Warwick,et al.  Hidden Interlocutor Misidentification in Practical Turing Tests , 2010, Minds and Machines.

[18]  N. Block.  Psychologism and Behaviorism , 1981 .

[19]  Stevan Harnad,et al.  The Turing Test is not a trick: Turing indistinguishability is a scientific criterion , 1992, SGAR.

[20]  Michael Wheeler.  Plastic machines: behavioural diversity and the Turing test , 2010, Kybernetes.

[21]  Blay Whitby,et al.  The Turing Test: AI's biggest blind alley? , 1996 .

[22]  James H. Moor,et al.  An analysis of the turing test , 1976 .

[23]  Kevin Warwick,et al.  Not Another Look at the Turing Test! , 2012, SOFSEM.

[24]  土肥 一夫,et al.  The Concise Oxford Dictionary of Current Englishと英和辞典 , 2001 .

[25]  James H. Moor,et al.  The Status and Future of the Turing Test , 2001, Minds and Machines.