The EMPATHIC project: mid-term achievements

The goal of active aging is to promote changes in the elderly community so as to maintain an active, independent and socially-engaged lifestyle. Technological advancements currently provide the necessary tools to foster and monitor such processes. This paper reports on mid-term achievements of the European H2020 EMPATHIC project, which aims to research, innovate, explore and validate new interaction paradigms and platforms for future generations of personalized virtual coaches to assist the elderly and their carers to reach the active aging goal, in the vicinity of their home. The project focuses on evidence-based, user-validated research and integration of intelligent technology, and context sensing methods through automatic voice, eye and facial analysis, integrated with visual and spoken dialogue system capabilities. In this paper, we describe the current status of the system, with a special emphasis on its components and their integration, the creation of a Wizard of Oz platform, and findings gained from user interaction studies conducted throughout the first 18 months of the project.

[1]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[2]  George A. Miller,et al.  WordNet: A Lexical Database for English , 1995, HLT.

[3]  Fred D. Davis,et al.  A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies , 2000, Management Science.

[4]  Cosmin Munteanu,et al.  MDWOZ: A Wizard of Oz Environment for Dialog Systems Development , 2000, LREC.

[5]  Alexander I. Rudnicky,et al.  Stochastic Language Generation for Spoken Dialogue Systems , 2000 .

[6]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[7]  R. H. Phaf,et al.  Automatic affective evaluation does not automatically predispose for arm flexion and extension. , 2004, Emotion.

[8]  Helmut Horacek,et al.  A Tool for Supporting Progressive Refinement of Wizard-of-Oz Experiments in Natural Language , 2004 .

[9]  Marc Hassenzahl,et al.  The Interplay of Beauty, Goodness, and Usability in Interactive Products , 2004, Hum. Comput. Interact..

[10]  N. Ambady,et al.  The effects of fear and anger facial expressions on approach- and avoidance-related behaviors. , 2005, Emotion.

[11]  Marc Hassenzahl,et al.  MARC HASSENZAHL CHAPTER 3 The Thing and I: Understanding the Relationship Between User and Product , 2003 .

[12]  T. Kirkwood,et al.  Understanding the Odd Science of Aging , 2005, Cell.

[13]  James A. Landay,et al.  SketchWizard: Wizard of Oz prototyping of pen-based user interfaces , 2007, UIST '07.

[14]  Claudia Pagliari,et al.  Design and Evaluation in eHealth: Challenges and Implications for an Interdisciplinary Field , 2007, Journal of medical Internet research.

[15]  Christopher D. Hundhausen,et al.  WOZ pro: a pen-based low fidelity prototyping environment to support wizard of oz studies , 2007, CHI Extended Abstracts.

[16]  Yuting Chen,et al.  QuickWoZ: a multi-purpose wizard-of-oz framework for experiments with embodied conversational agents , 2010, IUI '10.

[17]  Radoslaw Niewiadomski,et al.  How a Virtual Agent Should Smile? - Morphological and Dynamic Characteristics of Virtual Agent's Smiles , 2010, IVA.

[18]  Ben J. A. Kröse,et al.  Assessing Acceptance of Assistive Social Agent Technology by Older Adults: the Almere Model , 2010, Int. J. Soc. Robotics.

[19]  Charles R. Crowell,et al.  DOMER: A Wizard of Oz interface for using interactive robots to scaffold social skills for children with Autism Spectrum Disorders , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[20]  William D. Smart,et al.  Polonius: A wizard of Oz interface for HRI experiments , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[21]  Viswanath Venkatesh,et al.  Consumer Acceptance and Use of Information Technology: Extending the Unified Theory of Acceptance and Use of Technology , 2012, MIS Q..

[22]  Stefan Kopp,et al.  Virtual Agents as Daily Assistants for Elderly or Cognitively Impaired People - Studies on Acceptance and Interaction Feasibility , 2013, IVA.

[23]  Saturnino Luz,et al.  WebWOZ: A Platform for Designing and Conducting Web-based Wizard of Oz Experiments , 2013, SIGDIAL Conference.

[24]  Anna Esposito,et al.  Assessing Voice User Interfaces: The vassist system prototype , 2014, 2014 5th IEEE Conference on Cognitive Infocommunications (CogInfoCom).

[25]  Giovanni Scapagnini,et al.  Healthy aging diets other than the Mediterranean: A focus on the Okinawan diet , 2014, Mechanisms of Ageing and Development.

[26]  Gérard Chollet,et al.  Designing Language Technology Applications: A Wizard of Oz Driven Prototyping Framework , 2014, EACL.

[27]  Katarzyna Wac,et al.  Virtual assistive companions for older adults: qualitative field study and design implications , 2014, PervasiveHealth.

[28]  Ondrej Dusek,et al.  Training a Natural Language Generator From Unaligned Data , 2015, ACL.

[29]  María Inés Torres,et al.  First time encounters with Roberta : a humanoid assistant for conversational autobiography creation , 2017 .

[30]  Matt Shannon,et al.  Improved End-of-Query Detection for Streaming Speech Recognition , 2017, INTERSPEECH.

[31]  Nicole C. Krämer,et al.  A Categorization of Virtual Agent Appearances and a Qualitative Study on Age-Related User Preferences , 2017, IVA.

[32]  M. Inés Torres,et al.  Seniors' Sensing of Agents' Personality from Facial Expressions , 2018, ICCHP.

[33]  M. Inés Torres,et al.  Seniors' Acceptance of Virtual Humanoid Agents , 2018, ForItAAL.

[34]  Gabriel Skantze,et al.  Investigating Speech Features for Continuous Turn-Taking Prediction Using LSTMs , 2018, INTERSPEECH.

[35]  M. Inés Torres,et al.  The EMPATHIC Project: Building an Expressive, Advanced Virtual Coach to Improve Independent Healthy-Life-Years of the Elderly , 2018, ArXiv.