Trade-offs in the design of multimodal interaction for older adults

This paper presents key aspects that designers and Human–Computer Interaction practitioners might encounter when designing multimodal interaction for older adults, focusing on the trade-offs that m...

[1]  S. Goldin-Meadow,et al.  Why people gesture when they speak , 1998, Nature.

[2]  N. Charness,et al.  Designing for Older Adults , 2014 .

[3]  Dari Trendafilov,et al.  Designing and evaluating multimodal interaction for mobile contexts , 2008, ICMI '08.

[4]  Maria Grazia Carelli,et al.  Positive Attitudes towards Technologies and facets of Well-being in Older Adults , 2018, Journal of applied gerontology : the official journal of the Southern Gerontological Society.

[5]  W. Rogers,et al.  The Use of Communication Technologies by Older Adults: Exploring the Benefits from the User's Perspective , 2001 .

[6]  Antonella De Angeli,et al.  Integration and synchronization of input modes during multimodal human-computer interaction , 1997, CHI.

[7]  Julio Abascal,et al.  Universal accessibility as a multimodal design issue , 2007, CACM.

[8]  Martina Ziefle,et al.  Which Factors Form Older Adults' Acceptance of Mobile Information and Communication Technologies? , 2009, USAB.

[9]  Michel Vacher,et al.  Speech-based interaction in an AAL-context , 2012 .

[10]  Beat Signer,et al.  Design guidelines for adaptive multimodal mobile input solutions , 2013, MobileHCI '13.

[11]  Alexander H. Waibel,et al.  Multimodal interfaces , 1996, Artificial Intelligence Review.

[12]  Yvonne Barnard,et al.  Learning to use new technologies by older adults: Perceived difficulties, experimentation behaviour and usability , 2013, Comput. Hum. Behav..

[13]  James A. Larson,et al.  Guidelines for multimodal user interface design , 2004, CACM.

[14]  Per Ola Kristensson,et al.  Memorability of pre-designed and user-defined gesture sets , 2013, CHI.

[15]  Daniela Fogli,et al.  Design trade-offs in cultures of participation: empowering end users to improve their quality of life , 2020, Behav. Inf. Technol..

[16]  A C Bonacci,et al.  Living with complexity. , 1986, American journal of hospital pharmacy.

[17]  Rachel L. Franz,et al.  "My Hand Doesn't Listen to Me!": Adoption and Evaluation of a Communication Technology for the 'Oldest Old' , 2015, CHI.

[18]  Sharon L. Oviatt,et al.  Modeling multimodal integration patterns and performance in seniors: toward adaptive processing of individual differences , 2003, ICMI '03.

[19]  Ina Wechsung,et al.  Evaluation Methods for Multimodal Systems: A Comparison of Standardized Usability Questionnaires , 2008, PIT.

[20]  Katie Brittain,et al.  An Age-Old Problem: Examining the Discourses of Ageing in HCI and Strategies for Future Research , 2015, TCHI.

[21]  Gavriel Salvendy,et al.  Use and Design of Handheld Computers for Older Adults: A Review and Appraisal , 2012, Int. J. Hum. Comput. Interact..

[22]  Jörn Hurtienne,et al.  Multimodal interaction: A suitable strategy for including older users? , 2010, Interact. Comput..

[23]  M. Farage,et al.  Design Principles to Accommodate Older Adults , 2012, Global journal of health science.

[24]  David A. Shamma,et al.  The Design, Perception, and Practice of Tablet Photography , 2016, Conference on Designing Interactive Systems.

[25]  Fredrik Öhberg,et al.  Co-Creation with Older Adults to Improve User-Experience of a Smartphone Self-Test Application to Assess Balance Function , 2020, International journal of environmental research and public health.

[26]  James L. Alty,et al.  Investigating the Role of Redundancy in Multimodal Input Systems , 1997, Gesture Workshop.

[27]  Suhas Govind Joshi.  Designing for Experienced Simplicity. Why Analytic and Imagined Simplicity Fail in Design of Assistive Technology , 2015 .

[28]  Sharon L. Oviatt,et al.  Individual differences in multimodal integration patterns: what are they and why do they exist? , 2005, CHI.

[29]  Suleyman Al-Showarah,et al.  Effects of User Age on Smartphone and Tablet Use, Measured with an Eye-Tracker via Fixation Duration, Scan-Path Duration, and Saccades Proportion , 2014, HCI.

[30]  Stephen A. Brewster,et al.  Gesture and voice prototyping for early evaluations of social acceptability in multimodal interfaces , 2010, ICMI-MLMI '10.

[31]  Peter Caputi,et al.  Comparison of older and younger adults' attitudes towards and abilities with computers: Implications for training and learning , 2010, Br. J. Educ. Technol..

[32]  Cosmin Munteanu,et al.  Understanding Older Users' Acceptance of Wearable Interfaces for Sensor-based Fall Risk Assessment , 2018, CHI.

[33]  Matthew Turk,et al.  Multimodal interaction: A review , 2014, Pattern Recognit. Lett..

[34]  Daniel Gonçalves,et al.  Evaluation of in-air hand gestures interaction for older people , 2016, Universal Access in the Information Society.

[35]  Oded Lowengart,et al.  The paradox of simplicity: Effects of role on the preference and choice of product visual simplicity level , 2017, Int. J. Hum. Comput. Stud..

[36]  Albert Ali Salah,et al.  Multimodal technologies for seniors: challenges and opportunities , 2017, The Handbook of Multimodal-Multisensor Interfaces, Volume 1.

[37]  Stephen A. Brewster,et al.  Usable gestures for mobile interfaces: evaluating social acceptability , 2010, CHI.

[38]  Nadine Vigouroux,et al.  Comparison between Single-touch and Multi-touch Interaction for Older People , 2012, ICCHP.

[39]  Nadia Mana,et al.  Mobile for older adults: towards designing multimodal interaction , 2015, MUM.

[40]  Gavriel Salvendy,et al.  Older adults’ use of smart phones: an investigation of the factors influencing the acceptance of new functions , 2014, Behav. Inf. Technol..

[41]  Maria Klara Wolters,et al.  User-centred multimodal reminders for assistive living , 2011, CHI.

[42]  Manfred Tscheligi,et al.  Enabling accessibility through multimodality?: interaction modality choices of older adults , 2015, MUM.

[43]  D. Hawthorn,et al.  Possible implications of aging for interface designers , 2000, Interact. Comput..

[44]  Gerhard Fischer,et al.  Exploring design trade-offs for quality of life in human-centered design , 2017, Interactions.

[45]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[46]  Sharon L. Oviatt,et al.  Integration themes in multimodal human-computer interaction , 1994, ICSLP.

[47]  Jörg Niesenhaus,et al.  Measuring the impact of game controllers on player experience in FPS games , 2011, MindTrek.

[48]  Robert Graham,et al.  Towards a tool for the Subjective Assessment of Speech System Interfaces (SASSI) , 2000, Natural Language Engineering.

[49]  Richard A. Bolt,et al.  “Put-that-there”: Voice and gesture at the graphics interface , 1980, SIGGRAPH '80.

[50]  Stephen Lindsay,et al.  Engaging older people using participatory design , 2012, CHI.

[51]  Frederick Muench,et al.  Older adults and mobile technology: Factors that enhance and inhibit utilization in the context of behavioral health , 2017 .

[52]  Luciënne T. M. Blessing,et al.  Mobile device interaction gestures for older users , 2010, NordiCHI.

[53]  Jean Claude Marquié,et al.  The effect of motor difficulty on the acquisition of a computer task: a comparison between young and older adults , 2010, Behav. Inf. Technol..

[54]  Arthur D. Fisk,et al.  Designing for Older Adults: Principles and Creative Human Factors Approaches , 2004 .

[55]  Gerhard Fischer,et al.  Exploring design trade-offs for achieving social inclusion in multi-tiered design problems , 2019, Behav. Inf. Technol..

[56]  Nadia Mana,et al.  Designing mid-air gesture interaction with mobile devices for older adults , 2019 .

[57]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[58]  Timothy Brittain-Catlin.  Put it there , 2013 .

[59]  Sharon L. Oviatt,et al.  Perceptual user interfaces: multimodal interfaces that process what comes naturally , 2000, CACM.

[60]  Nadia Mana,et al.  Mobile multimodal interaction for older and younger users: exploring differences and similarities , 2017, MUM.

[61]  Sharon L. Oviatt,et al.  The Paradigm Shift to Multimodality in Contemporary Computer Interfaces , 2015, Synthesis Lectures on Human-Centered Informatics.

[62]  Speech and gestures for graphic image manipulation , 1989, CHI.

[63]  M. Albert,et al.  Social relationships, social support, and patterns of cognitive aging in healthy, high-functioning older adults: MacArthur studies of successful aging. , 2001, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.