Are you Awerewolf? Detecting deceptive roles and outcomes in a conversational role-playing game

This paper addresses the task of automatically detecting outcomes of social interaction patterns, using non-verbal audio cues in competitive role-playing games (RPGs). For our experiments, we introduce a new data set which features 3 hours of audio-visual recordings of the popular “Are you a Werewolf?” RPG. Two problems are approached in this paper: Detecting lying or suspicious behavior using non-verbal audio cues in a social context and predicting participants' decisions in a game-day by analyzing speaker turns. Our best classifier exhibits a performance improvement of 87% over the baseline for detecting deceptive roles. Also, we show that speaker turn based features can be used to determine the outcomes in the initial stages of the game, when the group is large.

[1]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[2]  Andreas Stolcke,et al.  Distinguishing deceptive from non-deceptive speech , 2005, INTERSPEECH.

[3]  Aldert Vrij,et al.  Detecting lies and deceit: Pitfalls and opportunities, 2nd ed. , 2008 .

[4]  A. Vrij Detecting Lies and Deceit: Pitfalls and Opportunities , 2008 .

[5]  Mark Braverman,et al.  Mafia: A theoretical study of players and coalitions in a partial information environment , 2008 .

[6]  Alex Pentland,et al.  PokerMetrics: Stress and lie detection through non-invasive physiological sensing , 2005 .

[7]  Hideki Kawahara,et al.  YIN, a fundamental frequency estimator for speech and music. , 2002, The Journal of the Acoustical Society of America.

[8]  Matthew L. Jensen,et al.  Deception detection through automatic, unobtrusive analysis of nonverbal behavior , 2005, IEEE Intelligent Systems.

[9]  Jordi Vitrià,et al.  You are fired! Nonverbal role analysis in competitive meetings , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[10]  Alessandro Vinciarelli,et al.  Role recognition in multiparty recordings using social affiliation networks and discrete distributions , 2008, ICMI '08.

[11]  Andreas Stolcke,et al.  Combining Prosodic Lexical and Cepstral Systems for Deceptive Speech Detection , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[12]  E.,et al.  GROUPS : INTERACTION AND PERFORMANCE , 2001 .

[13]  Jithendra Vepa,et al.  The segmentation of multi-channel meeting recordings for automatic speech recognition , 2006, INTERSPEECH.

[14]  Alex Pentland,et al.  Social signal processing: state-of-the-art and future perspectives of an emerging domain , 2008, ACM Multimedia.