Intelligent user interfaces in digital games for empowerment and inclusion

In the context of the development of Serious Games, this position paper sheds light on their possible use to support and enhance social inclusion through the presentation of three research projects in this domain. We first describe the context of our works and research. We then report on several events joining the scientific community that focused on the research on Digital Games for Empowerment and Inclusion. Last, we propose some results of our experience in this domain. The presented work particularly highlights the importance of user-centered design in interdisciplinary cooperation with psychologists, sociologists, vulnerable end users and the practitioners. We stress the relevance of progress beyond the state-of-the-art in recently focused areas of AI, such as, in computational theory-of-mind, in affective multimodal computing, in learning of socio-emotional skills, and in recovery of human attention processes. Typical examples are given to illustrate the projects' research results.

[1]  Mark Gaved,et al.  Developing a digital game to support cultural learning amongst immigrants , 2013 .

[2]  Björn W. Schuller,et al.  Serious Gaming for Behavior Change: The State of Play , 2013, IEEE Pervasive Computing.

[3]  C. Pelachaud,et al.  GRETA. A BELIEVABLE EMBODIED CONVERSATIONAL AGENT , 2005 .

[4]  Tobias Baur,et al.  Who's Afraid of Job Interviews? Definitely a Question for User Modelling , 2014, UMAP.

[5]  Roger Crawfis,et al.  Games for therapy: Defining a grammar and implementation for the recognition of therapeutic gestures , 2013, FDG.

[6]  Catherine Pelachaud,et al.  The TARDIS Framework: Intelligent Virtual Agents for Social Coaching in Job Interviews , 2013, Advances in Computer Entertainment.

[7]  Rosalind W. Picard Affective computing: (526112012-054) , 1997 .

[8]  Mark Gaved,et al.  Assessing the Reach and Impact of Game-Based Learning Approaches to Cultural Competency and Behavioural Change , 2014, ArXiv.

[9]  Francesca Odone,et al.  Emotional Charades , 2014, ICMI.

[10]  Katie Salen,et al.  Rules of play: game design fundamentals , 2003 .

[11]  Erik Marchi,et al.  The state of play of ASC-Inclusion: An Integrated Internet-Based Environment for Social Inclusion of Children with Autism Spectrum Conditions , 2014, IUI 2014.

[12]  David R. Michael,et al.  Serious Games: Games That Educate, Train, and Inform , 2005 .

[13]  Sara Bernardini,et al.  ECHOES: An intelligent serious game for fostering social communication in children with autism , 2014, Inf. Sci..

[14]  Erik Marchi,et al.  Voice Emotion Games: Language and Emotion in the Voice of Children with Autism Spectrum Conditio , 2015, IUI 2015.

[15]  Stacy Marsella,et al.  A domain-independent framework for modeling emotion , 2004, Cognitive Systems Research.

[16]  Erik Marchi,et al.  Asc-inclusion: Interactive Emotion Games for Social Inclusion of Children with Autism Spectrum Conditions , 2022 .

[17]  Mann Oo. Hay Emotion recognition in human-computer interaction , 2012 .

[18]  Erik Marchi,et al.  Recent developments and results of ASC-Inclusion: An Integrated Internet-Based Environment for Social Inclusion of Children with Autism Spectrum Conditions , 2015, IUI 2015.

[19]  Mark Gaved,et al.  Challenges in Context-Aware Mobile Language Learning: The MASELTOV Approach , 2014, mLearn.

[20]  Rosalind W. Picard Affective Computing , 1997 .

[21]  Lucas Paletta,et al.  Smartphone eye tracking toolbox: accurate gaze recovery on mobile displays , 2014 .

[22]  A. Swiderska,et al.  Traveller–Intercultural training with intelligent agents for young adults , 2013, IUI 2013.

[23]  Mark Gaved,et al.  Advances in MASELTOV - Serious Games in a Mobile Ecology of Services for Social Inclusion and Empowerment of Recent Immigrants , 2013, Advances in Computer Entertainment.