Being Old Doesn’t Mean Acting Old: How Older Users Interact with Spoken Dialog Systems

Most studies on adapting voice interfaces to older users work top-down by comparing the interaction behavior of older and younger users. In contrast, we present a bottom-up approach. A statistical cluster analysis of 447 appointment scheduling dialogs between 50 older and younger users and 9 simulated spoken dialog systems revealed two main user groups, a “social” group and a “factual” group. “Factual” users adapted quickly to the systems and interacted efficiently with them. “Social” users, on the other hand, were more likely to treat the system like a human, and did not adapt their interaction style. While almost all “social” users were older, over a third of all older users belonged in the “factual” group. Cognitive abilities and gender did not predict group membership. We conclude that spoken dialog systems should adapt to users based on observed behavior, not on age.

[1]  J. Pennebaker,et al.  Psychological aspects of natural language. use: our words, our selves. , 2003, Annual review of psychology.

[2]  Marilyn A. Walker,et al.  Using Linguistic Cues for the Automatic Recognition of Personality in Conversation and Text , 2007, J. Artif. Intell. Res..

[3]  Maxine Eskénazi,et al.  Doing research on a deployed spoken dialogue system: one year of let's go! experience , 2006, INTERSPEECH.

[4]  R. Darin Ellis,et al.  Modeling Computer Interest in Older Adults: The Role of Age, Education, Computer Knowledge, and Computer Anxiety , 1999, Hum. Factors.

[5]  J. Pennebaker,et al.  PERSONALITY PROCESSES AND INDIVIDUAL DIFFERENCES Words of Wisdom: Language Use Over the Life Span , 2003 .

[6]  Mark Liberman,et al.  Transcriber: Development and use of a tool for assisting speech corpora production , 2001, Speech Commun..

[7]  Sharon L. Oviatt,et al.  Toward adaptive conversational interfaces: Modeling speech convergence with animated personas , 2004, TCHI.

[8]  Jean Carletta,et al.  Unleashing the killer corpus: experiences in creating the multi-everything AMI Meeting Corpus , 2007, Lang. Resour. Evaluation.

[9]  Kallirroi Georgila,et al.  Speech Input from Older Users in Smart Environments: Challenges and Perspectives , 2009, HCI.

[10]  A. Koller,et al.  Speech Acts: An Essay in the Philosophy of Language , 1969 .

[11]  Martha E. Pollack,et al.  Autominder: an intelligent cognitive orthotic system for people with memory impairment , 2003, Robotics Auton. Syst..

[12]  Daniel Gildea,et al.  Skeletons in the parser: Using a shallow parser to improve deep parsing , 2004, COLING.

[13]  Philip Hanna,et al.  Using multiple strategies to manage spoken dialogue , 2007, INTERSPEECH.

[14]  D. Wechsler Manual for the Wechsler Adult Intelligence Scale. , 1955 .

[15]  Marilyn A. Walker,et al.  The AT&t-DARPA communicator mixed-initiative spoken dialog system , 2000, INTERSPEECH.

[16]  Claus Zinn,et al.  A 3-Tier Planning Architecture for Managing Tutorial Dialogue , 2002, Intelligent Tutoring Systems.

[17]  Arne Jönsson,et al.  Wizard of Oz studies -- why and how , 1993, Knowl. Based Syst..

[18]  Dan Klein,et al.  Accurate Unlexicalized Parsing , 2003, ACL.

[19]  Peter Gregor,et al.  “User sensitive inclusive design”— in search of a new paradigm , 2000, CUU '00.

[20]  Mary Zajicek,et al.  LONG PAPER , 2004 .

[21]  Kallirroi Georgila,et al.  Learning user simulations for information state update dialogue systems , 2005, INTERSPEECH.

[22]  C. Nicolle,et al.  Accessibility and Usability Requirements for ICTs for Disabled and Elderly People: a Functional Classification Approach : Helen Petrie , 2001 .

[23]  M. Pickering,et al.  Toward a mechanistic psychology of dialogue , 2004, Behavioral and Brain Sciences.

[24]  Elizabeth A Maylor,et al.  Does performance on theory of mind tasks decline in old age? , 2002, British journal of psychology.

[25]  Jennifer Chu-Carroll Evaluating Automatic Dialogue Strategy Adaptation for a Spoken Dialogue System , 2000, ANLP.

[26]  Johanna D. Moore,et al.  An Empirical Study of the Influence of Argument Conciseness on Argument Effectiveness , 2000, ACL.

[27]  Michel Hupet,et al.  Les manifestations du vieillissement normal dans le langage spontané oral et écrit , 1992 .

[28]  T. Salthouse What and When of Cognitive Aging , 2004 .

[29]  Phoebe E. Bailey,et al.  Growing less empathic with age: disinhibition of the self-perspective. , 2008, The journals of gerontology. Series B, Psychological sciences and social sciences.

[30]  J. Wade Davis,et al.  Statistical Pattern Recognition , 2003, Technometrics.

[31]  Sima'anKhalil,et al.  Wired for Speech: How Voice Activates and Advances the Human-Computer Relationship , 2006 .

[32]  Victor Zue,et al.  GALAXY-II: a reference architecture for conversational system development , 1998, ICSLP.

[33]  J. Pennebaker,et al.  Linguistic Style Matching in Social Interaction , 2002 .

[34]  Gabriel Skantze,et al.  Exploring human error recovery strategies: Implications for spoken dialogue systems , 2005, Speech Communication.

[35]  Marek Walesiak,et al.  Distance Measure for Ordinal Data , 1999 .

[36]  K. Jajuga,et al.  On The General Distance Measure , 2003 .

[37]  Johanna D. Moore,et al.  Generating Tailored, Comparative Descriptions in Spoken Dialogue , 2004, FLAIRS Conference.

[38]  Stefan Evert,et al.  The NITE XML Toolkit: Flexible annotation for multimodal language data , 2003, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[39]  Johanna D. Moore,et al.  Adaptive Tutorial Dialogue Systems Using Deep NLP Techniques , 2007, HLT-NAACL.

[40]  Johanna D. Moore,et al.  An intelligent interactive system for delivering individualized information to patients , 1995, Artif. Intell. Medicine.

[41]  Alexiei Dingli,et al.  Information Extraction Tools and Methods for Understanding Dialogue in a Companion , 2008, LREC.

[42]  E. Hulme,et al.  Production and perception of "verbosity" in younger and older adults. , 1998, Psychology and aging.

[43]  Stephen Young Probabilistic methods in spoken–dialogue systems , 2000, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[44]  Susan Kemper,et al.  Age differences in sentence production. , 2003, The journals of gerontology. Series B, Psychological sciences and social sciences.

[45]  William S Horton,et al.  Age-related differences in communication and audience design. , 2007, Psychology and aging.

[46]  Andrew R. Webb,et al.  Statistical Pattern Recognition , 1999 .

[47]  Marek Walesiak,et al.  Cluster analysis with clusterSim computer program and R environment , 2008 .

[48]  Doug Mahar,et al.  The effects of computer anxiety, state anxiety, and computer experience on users' performance of computer based tasks , 1997 .

[49]  R. G. Leiser Exploiting Convergence to Improve Natural Language Understanding , 1989, Interact. Comput..

[50]  Khalil Sima'an,et al.  Wired for Speech: How Voice Activates and Advances the Human-Computer Relationship , 2006, Computational Linguistics.

[51]  David R Traum,et al.  Towards a Computational Theory of Grounding in Natural Language Conversation , 1991 .

[52]  P. Verhaeghen Aging and vocabulary scores: a meta-analysis. , 2003, Psychology and aging.

[53]  Meredith A. Shafto,et al.  Aging and Language Production , 2004, Current directions in psychological science.

[54]  Kallirroi Georgila,et al.  A Fully Annotated Corpus for Studying the Effect of Cognitive Ageing on Users' Interactions with Spoken Dialogue Systems , 2008, LREC.

[55]  Peter Gregor,et al.  Cognitive difficulties and access to information systems: an interaction design perspective , 2005, ASAC.

[56]  Marilyn A. Walker,et al.  Generation and evaluation of user tailored responses in multimodal dialogue , 2004 .

[57]  P. Rabbitt Mild hearing loss can cause apparent memory failures which increase with age and reduce with IQ. , 1990, Acta oto-laryngologica. Supplementum.

[58]  N. Charness,et al.  Factors Predicting the Use of Technology: Findings From the Center for Research and Education on Aging and Technology Enhancement (CREATE) , 2006 .

[59]  Johanna D. Moore,et al.  Information Presentation in Spoken Dialogue Systems , 2006, EACL.

[60]  R. L. Babcock,et al.  Computer anxiety in young and older adults: Implications for human-computer interactions in older populations , 1997 .

[61]  Simulating the Behaviour of Older versus Younger Users when Interacting with Spoken Dialogue Systems , 2008, ACL.

[62]  Jeremy H. Wright,et al.  Automatically Training a Problematic Dialogue Predictor for a Spoken Dialogue System , 2011, J. Artif. Intell. Res..

[63]  Toni Giorgino,et al.  Automated Spoken Dialog System for Hypertensive Patient Home Management , 2004 .

[64]  Joelle Pineau,et al.  Spoken Dialogue Management Using Probabilistic Reasoning , 2000, ACL.

[65]  Sara J. Czaja,et al.  The impact of aging on access to technology , 2005, ASAC.

[66]  Vipin Kumar,et al.  Introduction to Data Mining, (First Edition) , 2005 .

[67]  K. Schaie The course of adult intellectual development. , 1994, The American psychologist.

[68]  Joseph Sharit,et al.  Effects of Age, Speech Rate, and Environmental Support in Using Telephone Voice Menu Systems , 2003, Hum. Factors.

[69]  Arne Jönsson,et al.  Wizard of Oz studies: why and how , 1993, IUI '93.

[70]  Sebastian Möller,et al.  Evaluating the speech output component of a smart-home system , 2006, Speech Commun..

[71]  Joseph Sharit,et al.  Factors predicting the use of technology: findings from the Center for Research and Education on Aging and Technology Enhancement (CREATE). , 2006, Psychology and aging.

[72]  D. Hawthorn,et al.  Possible implications of aging for interface designers , 2000, Interact. Comput..

[73]  Jiang Hu,et al.  Adaptive language behavior in HCI: how expectations and beliefs about a system affect users' word choice , 2006, CHI.

[74]  Johanna D. Moore,et al.  Evaluating information presentation strategies for spoken recommendations , 2007, RecSys '07.

[75]  Steve J. Young,et al.  A survey of statistical user simulation techniques for reinforcement-learning of dialogue management strategies , 2006, The Knowledge Engineering Review.

[76]  Lorraine Olson Ramig,et al.  The Aging Voice: A Review, Treatment Data and Familial and Genetic Perspectives , 2001, Folia Phoniatrica et Logopaedica.

[77]  David Maxwell Chickering,et al.  Improving command and control speech recognition on mobile devices: using predictive user models for language modeling , 2006, User Modeling and User-Adapted Interaction.

[78]  Diane J. Litman,et al.  ITSPOKE: An Intelligent Tutoring Spoken Dialogue System , 2004, NAACL.

[79]  Kallirroi Georgila,et al.  An ISU Dialogue System Exhibiting Reinforcement Learning of Dialogue Policies: Generic Slot-Filling in the TALK In-car System , 2006, EACL.

[80]  Sarah E. MacPherson,et al.  Midlife aging, open-ended planning, and laboratory measures of executive function. , 2001, Neuropsychology.

[81]  Ergonomic requirements for office work with visual display terminals ( VDTs ) — Part 11 : Guidance on usability , 1998 .

[82]  Clifford Nass,et al.  Syntactic alignment between computers and people: The role of belief about mental states , 2003 .

[83]  Kallirroi Georgila,et al.  Reducing working memory load in spoken dialogue systems , 2009, Interact. Comput..

[84]  P. Rousseeuw Silhouettes: a graphical aid to the interpretation and validation of cluster analysis , 1987 .

[85]  Elizabeth Zoltan-Ford,et al.  How to Get People to Say and Type What Computers Can Understand , 1991, Int. J. Man Mach. Stud..

[86]  Peter Gregor,et al.  Designing for dynamic diversity: interfaces for older people , 2002, Assets '02.

[87]  P. Tang,et al.  'Smart' homes and telecare for independent living , 2000, Journal of telemedicine and telecare.

[88]  Sebastian Möller,et al.  Analysis of communication failures for spoken dialogue systems , 2007, INTERSPEECH.

[89]  David Maxwell Chickering,et al.  Personalizing influence diagrams: applying online learning strategies to dialogue management , 2006, User Modeling and User-Adapted Interaction.

[90]  M. Pickering,et al.  Linguistic alignment between people and computers , 2010 .

[91]  J. Raven,et al.  Manual for Raven's progressive matrices and vocabulary scales , 1962 .

[92]  Johanna D. Moore,et al.  Generating and evaluating evaluative arguments , 2006, Artif. Intell..

[93]  Roy Harper,et al.  Implementing autonomy in a diabetes management system , 2005, Journal of telemedicine and telecare.

[94]  Peter Gregor,et al.  Cognitive difficulties and access to information systems: an interaction design perspective , 2005, ASAC.

[95]  R. Engle,et al.  Individual differences in working memory capacity and learning: Evidence from the serial reaction time task , 2005, Memory & cognition.

[96]  Klaus-Peter Engelbrecht,et al.  Study of a Speech-based Smart Home System with Older Users , 2008 .

[97]  Christian A. Müller,et al.  Exploiting speech for recognizing elderly users to respond to their special needs , 2003, INTERSPEECH.

[98]  Stacy Marsella,et al.  A Virtual Human Dialogue Model for Non-Team Interaction , 2008 .

[99]  Jennifer Balogh,et al.  Say it Like You Mean it: Priming for Structure in Caller Responses to a Spoken Dialog System , 2003, Int. J. Speech Technol..

[100]  Michael F. McTear,et al.  Handling errors and determining confirmation strategies - An object-based approach , 2003, Speech Commun..

[101]  Hua Ai,et al.  Comparing Spoken Dialog Corpora Collected with Recruited Subjects versus Real Users , 2007, SIGDIAL.

[102]  Ian J Deary,et al.  The impact of childhood intelligence on later life: following up the Scottish mental surveys of 1932 and 1947. , 2004, Journal of personality and social psychology.

[103]  Vipin Kumar,et al.  Introduction to Data Mining , 2022, Data Mining and Machine Learning Applications.

[104]  Joakim Nivre,et al.  Pseudo-Projective Dependency Parsing , 2005, ACL.

[105]  Alan F. Newell,et al.  Focussing on Extra-Ordinary Users , 2007, HCI.

[106]  Gregory A. Sanders,et al.  DARPA communicator: cross-system results for the 2001 evaluation , 2002, INTERSPEECH.