Mobile for older adults: towards designing multimodal interaction

The paper presents the preliminary studies carried out in ECOMODE (Event-Driven Compressive Vision for Multimodal Interaction with Mobile Devices), an EU project aiming to design a multimodal interaction suitable for elderly people using mobile technology. The project exploits EDC (Event Driven Compressive) paradigm to realize a new generation of low-power multimodal human-computer interfaces for mobile devices. In our studies we investigated (1) how older adults interact with mobile devices and (2) how they use applications based on mid-air gesture interaction. Our studies basically confirm the findings of previous works about usability and accessibility issues, specifically characterizing elderly users' interaction with mobile technology.

[1]  Stephen Lindsay,et al.  Engaging older people using participatory design , 2012, CHI.

[2]  Patrick Langdon,et al.  Developing accessible TV applications , 2011, ASSETS '11.

[3]  Martina Ziefle,et al.  Which Factors Form Older Adults' Acceptance of Mobile Information and Communication Technologies? , 2009, USAB.

[4]  Andreas Holzinger,et al.  On Some Aspects of Improving Mobile Applications for the Elderly , 2007, HCI.

[5]  Cui Jian,et al.  Touch and Speech: Multimodal Interaction for Elderly Persons , 2012, BIOSTEC.

[6]  Bernabé Linares-Barranco,et al.  An Event-Driven Multi-Kernel Convolution Processor Module for Event-Driven Vision Sensors , 2012, IEEE Journal of Solid-State Circuits.

[7]  Michela Bertolotto,et al.  Towards Multimodal Mobile GIS for the Elderly , 2010 .

[8]  Bhuvana Ramabhadran,et al.  Automatic recognition of spontaneous speech for access to multilingual oral history archives , 2004, IEEE Transactions on Speech and Audio Processing.

[9]  Alvin Jude,et al.  Evaluating multimodal interaction with gestures and speech for point and select tasks , 2014, NordiCHI.

[10]  Bernabé Linares-Barranco,et al.  A 128$\,\times$ 128 1.5% Contrast Sensitivity 0.9% FPN 3 µs Latency 4 mW Asynchronous Frame-Free Dynamic Vision Sensor Using Transimpedance Preamplifiers , 2013, IEEE Journal of Solid-State Circuits.

[11]  Xiang 'Anthony' Chen,et al.  Air+touch: interweaving touch & in-air gestures , 2014, UIST.

[12]  Donald A. Norman,et al.  Natural user interfaces are not natural , 2010, INTR.

[13]  Steve Renals,et al.  Longitudinal study of ASR performance on ageing voices , 2008, INTERSPEECH.

[14]  Joseph J. LaViola,et al.  An introduction to 3D gestural interfaces , 2014, SIGGRAPH '14.

[15]  Fabio Pianesi,et al.  Useful, Social and Enjoyable: Mobile Phone Adoption by Older People , 2009, INTERACT.

[16]  Arthur D. Fisk,et al.  Designing for Older Adults: Principles and Creative Human Factors Approaches , 2004 .