An Analysis of Older Users' Interactions with Spoken Dialogue Systems

This study explores communication differences between older and younger users with a task-oriented spoken dialogue system. Previous analyses of the MATCH corpus show that older users have significantly longer dialogues than younger users and that they are less satisfied with the system. Open questions remain regarding the relationship between information recall and cognitive abilities. This study documents a length annotation scheme designed to explore causes of additional length in the dialogues and the relationships between length, cognitive abilities, user satisfaction, and information recall. Results show that primary causes of older users’ additional length include using polite vocabulary, providing additional information relevant to the task, and using full sentences to respond to the system. Regression models were built to predict length from cognitive abilities and user satisfaction from length. Overall, users with higher cognitive ability scores had shorter dialogues than users with lower cognitive ability scores, and users with shorter dialogues were more satisfied with the system than users with longer dialogues. Dialogue length and cognitive abilities were significantly correlated with information recall. Overall, older users tended to use a human-to-human communication style with the system, whereas younger users tended to adopt a factual interaction style.

[1]  Kallirroi Georgila,et al.  Reducing working memory load in spoken dialogue systems , 2009, Interact. Comput..

[2]  Stefan Evert,et al.  The NITE XML Toolkit: Flexible annotation for multimodal language data , 2003, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[3]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[4]  J. Raven,et al.  Manual for Raven's progressive matrices and vocabulary scales , 1962 .

[5]  Roy Harper,et al.  Implementing autonomy in a diabetes management system , 2005, Journal of telemedicine and telecare.

[6]  Kallirroi Georgila,et al.  Being Old Doesn’t Mean Acting Old: How Older Users Interact with Spoken Dialog Systems , 2009, TACC.

[7]  Kallirroi Georgila,et al.  The MATCH corpus: a corpus of older and younger users’ interactions with spoken dialogue systems , 2010, Lang. Resour. Evaluation.

[8]  Kallirroi Georgila,et al.  Learning Dialogue Strategies from Older and Younger Simulated Users , 2010, SIGDIAL Conference.

[9]  R. Engle,et al.  Individual differences in working memory capacity and learning: Evidence from the serial reaction time task , 2005, Memory & cognition.

[10]  Sara J. Czaja,et al.  The impact of aging on access to technology , 2005, ASAC.

[11]  Kallirroi Georgila,et al.  A Fully Annotated Corpus for Studying the Effect of Cognitive Ageing on Users' Interactions with Spoken Dialogue Systems , 2008, LREC.

[12]  Mary Zajicek,et al.  Successful and available: interface design exemplars for older users , 2004, Interact. Comput..

[13]  Maria Klara Wolters,et al.  Corpus Analysis of Spoken Smart-Home Interactions with Older Users , 2008, LREC.

[14]  Martha E. Pollack,et al.  Intelligent Technology for an Aging Population: The Use of AI to Assist Elders with Cognitive Impairment , 2005, AI Mag..

[15]  D. Wechsler Manual for the Wechsler Adult Intelligence Scale. , 1955 .

[16]  Hugo Van hamme,et al.  JASMIN-CGN: Extension of the Spoken Dutch Corpus with Speech of Elderly People, Children and Non-natives in the Human-Machine Interaction Modality , 2006, LREC.

[17]  Daniel Whiting,et al.  THE USE OF ‘USE’ , 2008 .

[18]  Janet L. Kolodner,et al.  Case-Based Reasoning , 1989, IJCAI 1989.