Mobile multimodal interaction for older and younger users: exploring differences and similarities

Since they can integrate a wide range of interactive modalities, multimodal interfaces are considered to improve accessibility for a variety of users, including older adults. However, only few works have actually explored how older adults approach multimodal interaction outside specific contexts and have done so mainly in comparison to much younger users. This study explores how older (65+ years old), middle-aged (55-65 years old) and younger adults (25-35 years old) use mobile multimodal interaction in an everyday activity (i.e. taking photos with a tablet) by using midair gestures and voice commands, and investigates the differences and similarities between the considered age groups. Preliminary findings from a video-analysis show that all groups easily combine the proposed modalities when interacting with a tablet device. Furthermore, compared to younger adults, older and middle-aged adults show similarities in the way they perform gesture and voice commands.

[1]  David A. Shamma,et al.  The Design, Perception, and Practice of Tablet Photography , 2016, Conference on Designing Interactive Systems.

[2]  Jörn Hurtienne,et al.  Multimodal interaction: A suitable strategy for including older users? , 2010, Interact. Comput..

[3]  Patrick Langdon,et al.  Physical gestures for abstract concepts: Inclusive design with primary metaphors , 2010, Interact. Comput..

[4]  Matthew Turk,et al.  Multimodal interaction: A review , 2014, Pattern Recognit. Lett..

[5]  Luciënne T. M. Blessing,et al.  Mobile device interaction gestures for older users , 2010, NordiCHI.

[6]  Michitaka Hirose,et al.  Elderly User Evaluation of Mobile Touchscreen Interactions , 2011, INTERACT.

[7]  Jing Chen,et al.  Response–Effect Compatibility Defines the Natural Scrolling Direction , 2013, Hum. Factors.

[8]  Manfred Tscheligi,et al.  Hands free - care free: elderly people taking advantage of speech-only interaction , 2014, NordiCHI.

[9]  Manfred Tscheligi,et al.  Enabling accessibility through multimodality?: interaction modality choices of older adults , 2015, MUM.

[10]  Walter F. Bischof,et al.  Learning and performance with gesture guides , 2013, CHI.

[11]  Daniel Gonçalves,et al.  Evaluation of in-air hand gestures interaction for older people , 2016, Universal Access in the Information Society.

[12]  Sharon Oviatt,et al.  User-centered modeling and evaluation of multimodal interfaces , 2003, Proc. IEEE.

[13]  Stephen A. Brewster,et al.  Gesture and voice prototyping for early evaluations of social acceptability in multimodal interfaces , 2010, ICMI-MLMI '10.

[14]  Regan L. Mandryk,et al.  Is movement better?: comparing sedentary and motion-based game controls for older adults , 2013, Graphics Interface.

[15]  Mary Zajicek,et al.  Multimodality and interactional differences in older adults , 2003, Universal Access in the Information Society.

[16]  Joëlle Coutaz,et al.  Applying the Wizard of Oz Technique to the Study of Multimodal Systems , 1993, EWHCI.

[17]  Julio Abascal,et al.  Universal accessibility as a multimodal design issue , 2007, CACM.

[18]  Katja Neureiter,et al.  Wizard of Oz Studies with Older Adults : A Methodological Note , 2016 .