Improving quality of life with a narrative companion

A central component of the human self is the narrative history of shared interactions with others, which provides the foundation for social relations that develop over extended time. The loss of this narrative self progressively becomes catastrophic for aging subjects with degenerative disease of the memory system. A prosthetic device for narrative memory can provide an at least temporary solution to this problem. We identify requirements for a narrative memory capability that can allow individuals with diminished memory to continue to interact socially with partners with whom they have shared experiences. A memory prosthetic should provide access to past memories of the subject, and should accompany the subject in the formation, organization and retrieval of new memories. Based on these requirements, we have implemented the V1.0 narrative memory companion on the Pepper humanoid robot using the native Choregraph and NAOqi system capabilities. We exploit principals developed in our research in autobiographical memory and the organization of experience in cooperative humanoid robots, and the mapping of narrative structure onto this experience. In the narrative companion, past memories are first collected from the subject or members of their entourage via a template-based interview, and a small number of photographs that illustrate important people and events in the subject's past. New memories constructed via interaction with Pepper, and by simple narratives told by the human partner, are stored in the Autobiographical Memory (ABM) implemented in the ALKnolwedge base of the NAOqi system. Memories are then recalled and shared by narrative. Results from a naïve case study are presented, and future applications for improved quality of life are discussed.

[1]  Peter Ford Dominey,et al.  The basis of shared intentions in human and robot cognition , 2011 .

[2]  Peter Ford Dominey,et al.  The Coordinating Role of Language in Real-Time Multimodal Learning of Cooperative Tasks , 2013, IEEE Transactions on Autonomous Mental Development.

[3]  Rutvik H. Desai,et al.  The Semantics of Syntax: The Grounding of Transitive and Intransitive Constructions , 2016, Journal of Cognitive Neuroscience.

[4]  A. Aron,et al.  Inclusion of Other in the Self Scale and the structure of interpersonal closeness , 1992 .

[5]  W. Moyle,et al.  Exploring the effect of companion robots on emotional expression in older adults with dementia: a pilot randomized controlled trial. , 2013, Journal of gerontological nursing.

[6]  Peter Ford Dominey,et al.  Cooperative human robot interaction systems: IV. Communication of shared plans with Naïve humans using gaze and speech , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  M. Bourgeois,et al.  Effects of memory aids on the dyadic conversations of individuals with dementia. , 1993, Journal of applied behavior analysis.

[8]  Ho Seok Ahn,et al.  Long term study of Healthcare Robot system for senior people in Rest Home, Hospitals, and a Dementia Unit , 2014 .

[9]  Rachid Alami,et al.  Towards a Task-Aware Proactive Sociable Robot Based on Multi-state Perspective-Taking , 2013, Int. J. Soc. Robotics.

[10]  Katherine Nelson,et al.  Narrative and the Emergence of a Consciousness of Self , 2003 .

[11]  Peter Ford Dominey,et al.  Successive Developmental Levels of Autobiographical Memory for Learning Through Social Interaction , 2014, IEEE Transactions on Autonomous Mental Development.

[12]  Ulric Neisser,et al.  Chapter 2 – Criteria for an Ecological Self , 1995 .

[13]  Peter Ford Dominey,et al.  Embodied Simulation Based on Autobiographical Memory , 2013, Living Machines.

[14]  Peter Gärdenfors,et al.  Construals of meaning: The role of attention in robotic language production , 2016 .

[15]  Evelyn C. Ferstl,et al.  The extended language network: A meta‐analysis of neuroimaging studies on text comprehension , 2008, Human brain mapping.

[16]  Daniel D. Hutto The Narrative Practice Hypothesis: Origins and Applications of Folk Psychology , 2007, Royal Institute of Philosophy Supplement.

[17]  Wan Ling Chang,et al.  PARO robot affects diverse interaction modalities in group sensory therapy for older adults with dementia , 2013, 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR).

[18]  J. Bruner The Narrative Construction of Reality , 1991, Critical Inquiry.

[19]  Peter Ford Dominey,et al.  Dynamic Construction Grammar and Steps Towards the Narrative Construction of Meaning , 2017, AAAI Spring Symposia.

[20]  Shaun Gallagher,et al.  Understanding others through primary interaction and narrative practice , 2008 .

[21]  Kenneth J. Gergen,et al.  Narrative and the Self as Relationship , 1988 .

[22]  Rolf A. Zwaan,et al.  Situation models in language comprehension and memory. , 1998, Psychological bulletin.

[23]  Guillaume Gibert,et al.  Proof of concept for a user-centered system for sharing cooperative plan knowledge over extended periods and crew changes in space-flight operations , 2015, 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[24]  Robyn Fivush,et al.  Constructing narrative, emotion, and self in parent–child conversations about the past , 1994 .

[25]  E. Mordoch,et al.  Social Commitment Robots and Dementia* , 2012, Canadian Journal on Aging / La Revue canadienne du vieillissement.

[26]  K. Nelson,et al.  The emergence of autobiographical memory: a social cultural developmental theory. , 2004, Psychological review.

[27]  Moritz Tenorth,et al.  KnowRob: A knowledge processing infrastructure for cognition-enabled robots , 2013, Int. J. Robotics Res..

[28]  W. Kintsch The role of knowledge in discourse comprehension : a construction-integration model , 1991 .