Multiparty Interactions for Coordination in a Mixed Human-Agent Teamwork

Virtual environments for human learning enable one or more users to interact with virtual agents in order to perform their tasks. This collaboration necessitates that the members of the team share a set of beliefs and reason about resources, plans and actions to be implemented. This article introduces a new multiparty coordination model allowing several virtual and human agents to dialogue and reason about the tasks that the user must learn. The proposed model relies on a shared plan based approach to represent the beliefs of the team members. The management of the multiparty aspect makes it possible to differentiate the behaviors to be produced according to the type of receiver of a communication: recipient or listener. Finally, in the context of learning a procedural activity, a study examines the effect of our multiparty model on a learner. Results show that the use of proactive pedagogical agents with multiparty competencies boosts the construction of common beliefs.

[1]  Pierre Chevaillier,et al.  A Continuous Model for the Management of Turn-Taking in User-Agent Spoken Interactions Based on the Variations of Prosodic Signals , 2015, IVA.

[2]  Mukesh Barange.  Task-Oriented Communicative Capabilities of Agents in Collaborative Virtual Environments for Training. (Des agents avec des capacités communicatives orientées tâche dans les Environnements de réalité Virtuelle Collaboratifs pour l'Apprentissage) , 2015 .

[3]  John Yen,et al.  Towards a Theory for Multiparty Proactive Communication in Agent Teams , 2007, Int. J. Cooperative Inf. Syst..

[4]  Julie Dugdale,et al.  A Pragmatic Development of a Computer Simulation of an Emergency Call Centre , 2000, COOP.

[5]  Milind Tambe,et al.  Towards Flexible Teamwork , 1997, J. Artif. Intell. Res..

[6]  Maarten Sierhuis,et al.  Coactive design , 2014, J. Hum. Robot Interact..

[7]  Hector J. Levesque,et al.  Confirmations and Joint Action , 1991, IJCAI.

[8]  Nicholas R. Jennings,et al.  The Cooperative Problem-solving Process , 1999, J. Log. Comput..

[9]  Barbara Dunin-Keplicz,et al.  A Logical View on Teamwork , 2012, Games, Actions and Social Software.

[10]  Nicholas R. Jennings,et al.  Formalizing Collaborative Decision-making and Practical Reasoning in Multi-agent Systems , 2002, J. Log. Comput..

[11]  Candace L. Sidner,et al.  COLLAGEN: Applying Collaborative Discourse Theory to Human-Computer Interaction , 2001, AI Mag..

[12]  Wenwu Yu,et al.  An Overview of Recent Progress in the Study of Distributed Multi-Agent Coordination , 2012, IEEE Transactions on Industrial Informatics.

[13]  Flavien Balbo,et al.  A Formal Model of Communication and Context Awareness in Multiagent Systems , 2014, J. Log. Lang. Inf..

[14]  Jeffrey M. Bradshaw,et al.  Human-Agent Teamwork and Adjustable Autonomy in Practice , 2003 .

[15]  Sarit Kraus,et al.  Collaborative Plans for Complex Group Action , 1996, Artif. Intell..

[16]  Hector J. Levesque,et al.  Semantics of Agent Communication Languages for Group Interaction , 2000, AAAI/IAAI.

[17]  Yu Zhang,et al.  Decision-theoretic proactive communication in multiagent teamwork , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[18]  David R. Traum,et al.  Embodied agents for multi-party dialogue in immersive virtual worlds , 2002, AAMAS '02.

[19]  Pierre Dillenbourg,et al.  Virtual Learning Environments , 2020, The SAGE Encyclopedia of Higher Education.

[20]  Ronan Querrec,et al.  Semantic modeling of Virtual Environments using MASCARET , 2012, 2012 5th Workshop on Software Engineering and Architectures for Realtime Interactive Systems (SEARIS).

[21]  Laurent Vercouter,et al.  Extraction de motifs dialogiques bidimensionnels , 2014, Rev. d'Intelligence Artif..

[22]  Catherine Pelachaud,et al.  Modelling multimodal expression of emotion in a virtual agent , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[23]  John Yen,et al.  Multiparty proactive communication in agent teamwork , 2005, 17th IEEE International Conference on Tools with Artificial Intelligence (ICTAI'05).

[24]  Hector J. Levesque,et al.  On Acting Together , 1990, AAAI.

[25]  Candace L. Sidner,et al.  DiamondHelp: A Generic Collaborative Task Guidance System , 2007, AI Mag..

[26]  Eric Horvitz,et al.  Multiparty Turn Taking in Situated Dialog: Study, Lessons, and Directions , 2011, SIGDIAL Conference.

[27]  Ronan Querrec,et al.  A methodology for the design of pedagogically adaptable learning environments. , 2016 .