Play SMILE Game with ERiSA: a user study on game companions

This paper describes the evaluation of our fully integrated virtual game companions framework (ERiSA) [4]. We conducted three user studies with different scenarios using two versions of The Smile Game[4] in semi-public and public spaces. In our study, we show that the game companions' personality was successfully perceived by the participants while interacting and playing with the game companions. Topic about the game itself was the most popular topic with total 598 occurrences in our studies. Moreover, facial expressions is the most performed type of attack in the game. Finally, from the large number of video data collected, we aim to automatically learn the interaction rules and additional attack movements.

[1]  Stacy Marsella,et al.  Evaluating the modeling and use of emotion in virtual humans , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[2]  Maja Pantic,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON AFFECTIVE COMPUTING , 2022 .

[3]  Timothy W. Bickmore,et al.  Relational Agents Improve Engagement and Learning in Science Museum Visitors , 2011, IVA.

[4]  Marc Schröder,et al.  The SEMAINE API: Towards a Standards-Based Framework for Building Emotion-Oriented Systems , 2010, Adv. Hum. Comput. Interact..

[5]  Joëlle Coutaz,et al.  Applying the Wizard of Oz Technique to the Study of Multimodal Systems , 1993, EWHCI.

[6]  Stefan Kopp,et al.  A Conversational Agent as Museum Guide - Design and Evaluation of a Real-World Application , 2005, IVA.

[7]  Timothy W. Bickmore,et al.  Designing Relational Agents as Long Term Social Companions for Older Adults , 2012, IVA.

[8]  David R. Traum,et al.  What would you Ask a conversational Agent? Observations of Human-Agent Dialogues in a Museum Setting , 2008, LREC.

[9]  L. R. Goldberg,et al.  The language of personality: Lexical perspectives on the five-factor model. , 1996 .

[10]  Michel F. Valstar,et al.  ERiSA: Building Emotionally Realistic Social Game-Agents Companions , 2014, IVA.

[11]  J. F. Kelley,et al.  An iterative design methodology for user-friendly natural language office information applications , 1984, TOIS.

[12]  Etienne de Sevin,et al.  GRETA: Towards an interactive conversational virtual Companion , 2010 .

[13]  P. Green.  The Wizard of Oz: a tool for rapid development of user interfaces. Final report , 1985 .

[14]  Arne Jönsson,et al.  Wizard of Oz studies: why and how , 1993, IUI '93.

[15]  Hennie Brugman,et al.  Annotating Multi-media/Multi-modal Resources with ELAN , 2004, LREC.

[16]  Timothy W. Bickmore,et al.  A Robotic Companion for Social Support of Isolated Older Adults , 2015, HRI.