Virtual Humans with Secrets: Learning to Detect Verbal Cues to Deception

Virtual humans are animated, lifelike characters capable of free-speech and nonverbal interaction with human users In this paper, we describe the development of two virtual human characters for teaching the skill of deception detection An accompanying tutoring system provides solicited hints on what to ask during an interview and unsolicited feedback that identifies properties of truthful and deceptive statements uttered by the characters We present the results of an experiment comparing use of virtual humans with tutoring against a no-interaction (baseline) condition and a didactic condition The didactic group viewed a slide show consisting of recorded videos along with descriptions of properties of deception and truth-telling Results revealed that both groups significantly outperformed the no-interaction control group in a binary decision task to identify truth or deception in video statements No significant differences were found between the training conditions.

[1]  Kyle Johnsen,et al.  The validity of a virtual human experience for interpersonal skills education , 2007, CHI.

[2]  Albert A. Rizzo,et al.  Virtual humans for assisted health care , 2008, PETRA '08.

[3]  Role playing for educational use , 1964 .

[4]  Scott P. Robertson,et al.  Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , 1991 .

[5]  Saul M. Kassin,et al.  “I’d Know a False Confession if I Saw One”: A Comparative Study of College Students and Police Investigators , 2005, Law and human behavior.

[6]  Saul M. Kassin,et al.  “He's guilty!”: Investigator Bias in Judgments of Truth and Deception , 2002, Law and human behavior.

[7]  Geoffrey A. Frank,et al.  Lessons learned in modeling schizophrenic and depressed responsive virtual humans for training , 2003, IUI '03.

[8]  Anton Leuski,et al.  From domain specification to virtual humans: an integrated approach to authoring tactical questioning characters , 2008, INTERSPEECH.

[9]  T. Wickens.  Elementary Signal Detection Theory , 2001 .

[10]  James J. Lindsay,et al.  Cues to deception. , 2003, Psychological bulletin.

[11]  Randall W. Hill,et al.  Toward Virtual Humans , 2006, AI Mag..

[12]  Holly A. Miller,et al.  The Training of Law Enforcement Officers in Detecting Deception: A Survey of Current Practices and Suggestions for Improving Accuracy , 2006 .

[13]  James C. Lester,et al.  Animated Pedagogical Agents: Face-to-Face Interaction in Interactive Learning Environments , 2000 .

[14]  B. Depaulo,et al.  Accuracy of Deception Judgments , 2006, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[15]  Paula J. Durlach,et al.  BiLAT: A Game-Based Environment for Practicing Negotiation in a Cultural Context , 2009, Int. J. Artif. Intell. Educ..

[16]  A. L. Baylor,et al.  A Social-Cognitive Framework for Pedagogical Agents as Learning Companions , 2006 .

[17]  W. Lewis Johnson,et al.  Tactical Language and Culture Training Systems: Using Artificial Intelligence to Teach Foreign Languages and Cultures , 2008, AAAI.

[18]  Jim Holder,et al.  User interfaces , 1985, ALET.

[19]  Anton Leuski,et al.  Asking Questions to Limited Domain Virtual Characters: How Good Does Speech Recognition Have to Be? , 2006 .

[20]  Ning Wang,et al.  Creating Rapport with Virtual Agents , 2007, IVA.

[21]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[22]  Justine Cassell,et al.  Playing with virtual peers: bootstrapping contingent discourse in children with autism , 2008, ICLS.

[23]  Thomas Hugh Feeley,et al.  To Catch a Liar: Challenges for Research in Lie Detection Training , 2003 .