A 'companion' ECA with planning and activity modelling

In this paper, we describe the development of an Embodied Conversational Agent (ECA) implementing the concept of a companion, i.e. an agent supporting the persistent representation of user activities and dialogue-based communication with the user. This first experiment implements a Health and Fitness companion aimed at promoting a healthier lifestyle. The system operates by generating an 'ideal' plan of daily activities from background knowledge and dialogue interaction with the user. This plan then becomes an activity model, which will later be instantiated by reports from the user and analysed by the agent from the perspective of initial objectives. At various stages of the day, the plan can still be adapted through further dialogue. The agent is embodied using a wireless rabbit (Nabaztag™) device situated in the user's home. After describing the planning component, based on Hierarchical Task Networks (HTN) and the spoken dialogue system, we present a working example from the system illustrating its behaviour through various phases of user activity generation, updating and re-planning.

[1]  Alexander I. Rudnicky,et al.  Ravenclaw: dialog management using hierarchical task decomposition and an expectation agenda , 2003, INTERSPEECH.

[2]  Valeria Carofiglio,et al.  Affective Advice Giving Dialogs , 2004, ADS.

[3]  John Levine,et al.  Using AI Planning Technology for Army Small Unit Operations , 2000, AIPS.

[4]  Oxford Ox,et al.  Artificial Companions as a new kind of interface to the future Internet , 2006 .

[5]  Paolo Traverso,et al.  Automated Planning: Theory & Practice , 2004 .

[6]  Milind Tambe,et al.  Conflict negotiation among personal calendar agents , 2006, AAMAS '06.

[7]  Paolo Traverso,et al.  Automated planning - theory and practice , 2004 .

[8]  Kenneth D. Forbus,et al.  Companion Cognitive Systems: A Step towards Human-Level AI , 2004, AI Mag..

[9]  Alexander Gruenstein,et al.  Using an Activity Model to Address Issues in Task-Oriented Dialogue Interaction over Extended Periods , 2004 .

[10]  Victor Zue,et al.  GALAXY-II: a reference architecture for conversational system development , 1998, ICSLP.

[11]  Douglas B. Moran,et al.  The Open Agent Architecture: A Framework for Building Distributed Software Systems , 1999, Appl. Artif. Intell..

[12]  Martha E. Pollack,et al.  Planning Technology for Intelligent Cognitive Orthotics , 2002, AIPS.

[13]  Alexander I. Rudnicky.  AN AGENDA-BASED DIALOG MANAGEMENT ARCHITECTURE FOR SPOKEN LANGUAGE SYSTEMS , 1999 .

[14]  Markku Turunen,et al.  An architecture and applications for speech-based accessibility systems , 2005, IBM Syst. J..

[15]  Martha E. Pollack,et al.  A Plan-Based Personalized Cognitive Orthotic , 2002, AIPS.

[16]  James F. Allen,et al.  TRAINS-95: Towards a Mixed-Initiative Planning Assistant , 1996, AIPS.

[17]  Karen L. Myers,et al.  Proactivity in an Intentionally Helpful Personal Assistive Agent , 2007, AAAI Spring Symposium: Intentions in Intelligent Systems.

[18]  James F. Allen,et al.  TRIPS: An Integrated Intelligent Problem-Solving Assistant , 1998, AAAI/IAAI.

[19]  Thomas Grechenig,et al.  Towards a Taxonomy for Ambient Information Systems , 2007, Ambient Information Systems.

[20]  Marilyn A. Walker,et al.  How Rude Are You?: Evaluating Politeness and Affect in Interaction , 2007, ACII.

[21]  Nathanael Chambers,et al.  PLOW: A Collaborative Task Learning Agent , 2007, AAAI.

[22]  Markku Turunen,et al.  Robust and adaptive architecture for multilingual spoken dialogue systems , 2004, INTERSPEECH.