Supporting Elderly People by Ad Hoc Generated Mobile Applications Based on Vocal Interaction

Mobile devices can be exploited for enabling people to interact with Internet of Things (IoT) services. The MicroApp Generator [1] is a service-composition tool for supporting the generation of mobile applications directly on the mobile device. The user interacts with the generated app by using the traditional touch-based interaction. This kind of interaction often is not suitable for elderly and special needs people that cannot see or touch the screen. In this paper, we extend the MicroApp Generator with an interaction approach enabling a user to interact with the generated app only by using his voice, which can be very useful to let special needs people live at home. To this aim, once the mobile app has been generated and executed, the system analyses and describes the user interface, listens to the user speech and performs the associated actions. A preliminary analysis has been conducted to assess the user experience of the proposed approach by a sample composed of elderly users by using a questionnaire as a research instrument.

[1]  Michele Risi,et al.  Visual Mobile Computing for Mobile End-Users , 2016, IEEE Transactions on Mobile Computing.

[2]  Georgios Kambourakis,et al.  Design and implementation of a VoiceXML-driven wiki application for assistive environments on the web , 2009, Personal and Ubiquitous Computing.

[3]  Noëlle Carbonell,et al.  Ambient multimodality: towards advancing computer accessibility and assisted living , 2006, Universal Access in the Information Society.

[4]  Carmelo Ardito,et al.  User-driven visual composition of service-based interactive spaces , 2014, J. Vis. Lang. Comput..

[5]  Ricarose Roque.  OpenBlocks : an extendable framework for graphical block programming systems , 2007 .

[6]  Nikolay Mehandjiev,et al.  Alternative Representations for End User Composition of Service-Based Systems , 2011, IS-EUD.

[7]  Michele Risi,et al.  Generating applications directly on the mobile device: an empirical evaluation , 2012, AVI.

[8]  Michele Risi,et al.  MicroApps Development on Mobile Phones , 2011, IS-EUD.

[9]  Chia-Ying Lee,et al.  A Cloud System for Mobile Medical Services of Traditional Chinese Medicine , 2013, Journal of Medical Systems.

[10]  Brigitte Meillon,et al.  Design and evaluation of a smart home voice interface for the elderly: acceptability and objection aspects , 2011, Personal and Ubiquitous Computing.

[11]  Athanasios K. Tsakalidis,et al.  easyHealthApps: e-Health Apps Dynamic Generation for Smartphones & Tablets , 2013, Journal of Medical Systems.

[12]  Mamun Bin Ibne Reaz,et al.  A Review of Smart Homes—Past, Present, and Future , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[13]  Nikolai Tillmann,et al.  TouchDevelop: programming cloud-connected mobile devices via touchscreen , 2011, Onward! 2011.

[14]  Gobbur Uday,et al.  Voice based Internet Browser , 2013 .

[15]  Arthur D. Fisk,et al.  Aware technologies for aging in place: understanding user needs and attitudes , 2004, IEEE Pervasive Computing.

[16]  Michele Risi,et al.  Management, Sharing and Reuse of Service-Based Mobile Applications , 2015, 2015 2nd ACM International Conference on Mobile Software Engineering and Systems.

[17]  Martin Schrepp,et al.  Construction and Evaluation of a User Experience Questionnaire , 2008, USAB.

[18]  Cesare Pautasso,et al.  End-User Development of Mashups with NaturalMash , 2014, J. Vis. Lang. Comput..

[19]  Dimitris Kanellopoulos,et al.  e-souvenir appification: QoS web based media delivery for museum apps , 2015, Electronic Commerce Research.