Aliveness metaphor for an evolutive gesture interaction based on coupling between a human and a virtual agent

This paper presents a model that provides adaptive and evolutive interaction between a human and a virtual agent. After introducing the theoretical justifications, the aliveness metaphor and the notion of coupling are presented. Then, we propose a formalization of the model that relies on the temporal evolution of the coupling between participants and the existence of phases during the interaction. An example on a fitness exergame is provided and some illustrations show the behavior of the model during an interaction. A video complements this example.

[1]  Antonio Camurri,et al.  Towards a minimal representation of affective gestures (Extended abstract) , 2015, 2015 International Conference on Affective Computing and Intelligent Interaction (ACII).

[2]  Elisabetta Bevacqua,et al.  Effects of Coupling in Human-Virtual Agent Body Interaction , 2014, IVA.

[3]  Stefan Kopp,et al.  Multi-Level Analysis of Motor Actions as a Basis for Effective Coaching in Virtual Reality , 2016 .

[4]  B. Granström,et al.  NATURAL TURN-TAKING NEEDS NO MANUAL : COMPUTATIONAL THEORY AND MODEL , FROM PERCEPTION TO ACTION , 2002 .

[5]  Norman I. Badler,et al.  Efficient motion retrieval in large motion databases , 2013, I3D '13.

[6]  Louis-Philippe Morency,et al.  Predicting Listener Backchannels: A Probabilistic Multimodal Approach , 2008, IVA.

[7]  Satinder P. Gill,et al.  Entrainment and musicality in the human system interface , 2007, AI & SOCIETY.

[8]  J. Cappella.  The Biological Origins of Automated Patterns of Human Interaction , 1991 .

[9]  Etienne de Sevin,et al.  A listener model: introducing personality traits , 2012, Journal on Multimodal User Interfaces.

[10]  J. Burgoon,et al.  Interpersonal Adaptation: Dyadic Interaction Patterns , 1995 .

[11]  Roberto Pugliese,et al.  A Framework for Motion Based Bodily Enaction with Virtual Characters , 2011, IVA.

[12]  Anton Nijholt,et al.  Development of Multimodal Interfaces: Active Listening and Synchrony, Second COST 2102 International Training School, Dublin, Ireland, March 23-27, 2009, Revised Selected Papers , 2010, COST 2102 Training School.

[13]  A. Fogel,et al.  Alive communication. , 2007, Infant Behavior and Development.

[14]  T. Chartrand,et al.  The Chameleon Effect as Social Glue: Evidence for the Evolutionary Significance of Nonconscious Mimicry , 2003 .

[15]  Elisabetta Bevacqua,et al.  Real-time gesture recognition based on motion quality analysis , 2015, 2015 7th International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN).

[16]  Viktor Mikhaĭlovich Glushkov,et al.  An Introduction to Cybernetics , 1957, The Mathematical Gazette.

[17]  R. Mizen.  The embodied mind. , 2009, The Journal of analytical psychology.

[18]  Stefan Kopp,et al.  Modeling Embodied Feedback with Virtual Humans , 2006, ZiF Workshop.

[19]  David Vogt,et al.  Behavior generation for interactive virtual humans using context‐dependent interaction meshes and automated constraint extraction , 2015, Comput. Animat. Virtual Worlds.

[20]  Dana Kulic,et al.  Laban Effort and Shape Analysis of Affective Hand and Arm Movements , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[21]  John H. Holland.  Genetic Algorithms and Classifier Systems: Foundations and Future Directions , 1987, ICGA.

[22]  W. S. Condon,et al.  SOUND FILM ANALYSIS OF NORMAL AND PATHOLOGICAL BEHAVIOR PATTERNS , 1966, The Journal of nervous and mental disease.

[23]  D. Hoang.  FLOW: The Psychology of Optimal Experience , 2018 .