Enabling accessibility through multimodality?: interaction modality choices of older adults

In this work, we identify influencing factors on modality choices of older adults. In detail, we investigated when and why older adults prefer speech over touch interaction and vice versa when interacting with a mobile multimodal health and wellbeing service. We conducted a study with 19 older adults using a mobile application with a duration of three to six weeks. Due to this long duration of the study we were able to gain highly external valid insights as our results are based on real world experiences. We identify additional influencing factors within the areas of user characteristics, contextual factors and perceived system characteristics. We outline the impact of the factors and highlight the importance of several of these factors to enable accessible user interfaces. Our results provide first steps towards a more holistic model of modality choices taking into account interdependencies of different factors.

[1]  Alexander H. Waibel,et al.  Model-based and empirical evaluation of multimodal interactive error correction , 1999, CHI '99.

[2]  Dari Trendafilov,et al.  Designing and evaluating multimodal interaction for mobile contexts , 2008, ICMI '08.

[3]  Doug Beeferman,et al.  Say what? why users choose to speak their web queries , 2010, INTERSPEECH.

[4]  Sharon L. Oviatt,et al.  Multimodal Interfaces: A Survey of Principles, Models and Frameworks , 2009, Human Machine Interaction.

[5]  Stephan Schlögl,et al.  Designing Natural Language User Interfaces with Elderly Users , 2014 .

[6]  J. C. Flanagan.  Psychological Bulletin THE CRITICAL INCIDENT TECHNIQUE , 2022 .

[7]  Sebastian Möller,et al.  Modeling input modality choice in mobile graphical and speech interfaces , 2015, Int. J. Hum. Comput. Stud..

[8]  Frank Honold,et al.  Influencing factors on multimodal interaction during selection tasks , 2012, Journal on Multimodal User Interfaces.

[9]  D. Kahneman,et al.  A Survey Method for Characterizing Daily Life Experience: The Day Reconstruction Method , 2004, Science.

[10]  Antonio Krüger,et al.  Modality preferences in mobile and instrumented environments , 2006, IUI '06.

[11]  Emiel Krahmer,et al.  Preferred modalities in dialogue systems , 2000, INTERSPEECH.

[12]  Sebastian Möller,et al.  Factors Influencing Modality Choice in Multimodal Applications , 2008, PIT.

[13]  Sharon L. Oviatt,et al.  Ten myths of multimodal interaction , 1999, Commun. ACM.

[14]  Sanjay Ghosh,et al.  Exploration of multimodal input interaction based on goals , 2013, APCHI.

[15]  Patrizia Grifoni,et al.  A multimodal pervasive framework for ambient assisted living , 2009, PETRA '09.

[16]  Ina Wechsung.  An Evaluation Framework for Multimodal Interaction - Determining Quality Aspects and Modality Choice , 2014, T-Labs Series in Telecommunication Services.

[17]  Elisabeth Scheibelhofer,et al.  Combining Narration‐Based Interviews with Topical Interviews: Methodological Reflections on Research Practices , 2008 .

[18]  Sebastian Möller,et al.  Measuring the Quality of Service and Quality of Experience of multimodal human–machine interaction , 2012, Journal on Multimodal User Interfaces.

[19]  Paul A. Cairns,et al.  Tlk or txt? Using voice input for SMS composition , 2008, Personal and Ubiquitous Computing.

[20]  Cui Jian,et al.  Modality Preference in Multimodal Interaction for Elderly Persons , 2013, BIOSTEC.

[21]  Alexander I. Rudnicky.  Mode preference in a simple data-retrieval task , 1993, HLT.