Measuring the Use of the Active and Assisted Living Prototype CARIMO for Home Care Service Users: Evaluation Framework and Results

To address the challenges of aging societies, various information and communication technology (ICT)-based systems for older people have been developed in recent years. Currently, the evaluation of these so-called active and assisted living (AAL) systems usually focuses on the analyses of usability and acceptance, while some also assess their impact. Little is known about the actual take-up of these assistive technologies. This paper presents a framework for measuring the take-up by analyzing the actual usage of AAL systems. This evaluation framework covers detailed information regarding the entire process including usage data logging, data preparation, and usage data analysis. We applied the framework on the AAL prototype CARIMO for measuring its take-up during an eight-month field trial in Austria and Italy. The framework was designed to guide systematic, comparable, and reproducible usage data evaluation in the AAL field; however, the general applicability of the framework has yet to be validated.

[1]  Susanne Boll,et al.  Identification and Classification of Usage Patterns in Long-Term Activity Tracking , 2017, CHI.

[2]  Sean A. Munson,et al.  Reconsidering the device in the drawer: lapses as a design opportunity in personal informatics , 2016, UbiComp.

[3]  Philip M Clarke,et al.  Optimal recall length in survey design. , 2008, Journal of health economics.

[4]  Bernard J. Jansen,et al.  Search log analysis: What it is, what's been done, how to do it , 2006 .

[5]  Matthew Chalmers,et al.  Experiences in Logging Everyday App Use , 2013 .

[6]  J. Gagné.  Literature Review , 2018, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[7]  Chris D. Nugent,et al.  A Novel Approach for the Population and Adaptation of Ontology-Based User Profiles , 2014, UCAmI.

[8]  Matthew Chalmers,et al.  Probabilistic Formal Analysis of App Usage to Inform Redesign , 2015, IFM.

[9]  P. Ray.  Home Health Hub Internet of Things (H3IoT): An architectural framework for monitoring health of elderly people , 2014, 2014 International Conference on Science Engineering and Management Research (ICSEMR).

[10]  S. Zwijsen,et al.  Ethics of using assistive technology in the care for community-dwelling elderly people: An overview of the literature , 2011, Aging & mental health.

[11]  Paul Panek,et al.  Integration of Cognitive and Physical Training in a Smart Home Environment for the Elderly People , 2010, MedInfo.

[12]  Michalis Faloutsos,et al.  ProfileDroid: multi-layer profiling of android applications , 2012, Mobicom '12.

[13]  W. Hofstee,et al.  The role of constructs in psychological and educational measurement. , 2001 .

[14]  R. K. Agrawal,et al.  An Introductory Study on Time Series Modeling and Forecasting , 2013, ArXiv.

[15]  Liliana Laranjo,et al.  The use of social features in mobile health interventions to promote physical activity: a systematic review , 2018, npj Digital Medicine.

[16]  Giorgio Maria Di Nunzio,et al.  Gathering and Mining Information from Web Log Files , 2007, DELOS.

[17]  Clemens Holzmann,et al.  Automated and unsupervised user interaction logging as basis for usability evaluation of mobile applications , 2012, MoMM '12.

[18]  Hong Cao,et al.  Mining smartphone data for app usage prediction and recommendations: A survey , 2017, Pervasive Mob. Comput..

[19]  Wil M. P. van der Aalst,et al.  Process mining can be applied to software too! , 2014, ESEM '14.

[20]  Zhaohui Wu,et al.  Discovering different kinds of smartphone users through their application usage behaviors , 2016, UbiComp.

[21]  Mukesh Kumar,et al.  Web Usage Mining: An Analysis , 2013 .

[22]  Michiel van Genuchten,et al.  A process-oriented methodology for evaluating the impact of IT: A proposal and an application in healthcare , 2013, Inf. Syst..

[23]  Gerald Craddock.  The AT continuum in education: Novice to power user , 2006, Disability and rehabilitation. Assistive technology.

[24]  Giorgio Maria Di Nunzio,et al.  Web log analysis: a review of a decade of studies about information acquisition, inspection and interpretation of user interaction , 2011, Data Mining and Knowledge Discovery.

[25]  Dermot Phelan,et al.  Accuracy of Wrist-Worn Heart Rate Monitors , 2017, JAMA cardiology.

[26]  Andrea Gaggioli,et al.  A Social Virtual Reality-Based Application for the Physical and Cognitive Training of the Elderly at Home , 2019, Sensors.

[27]  Cornelia Schneider,et al.  Selection and Assessment of Activity Trackers for Enthusiastic Seniors , 2017, ICT4AgeingWell.

[28]  Vera Colombo,et al.  Customization of domestic environment and physical training supported by virtual reality and semantic technologies: A use-case , 2017, 2017 IEEE 3rd International Forum on Research and Technologies for Society and Industry (RTSI).

[29]  M. Lawton,et al.  Assessment of Older People: Self-Maintaining and Instrumental Activities of Daily Living , 1969 .

[30]  M. A. Torsello,et al.  LOG DATA PREPARATION FOR MINING WEB USAGE PATTERNS , 2022 .

[31]  Lars Bo Larsen,et al.  Evaluating the usefulness of mobile services based on captured usage data from longitudinal field trials , 2007, Mobility '07.

[32]  Wiebren Zijlstra,et al.  Adherence to and effectiveness of an individually tailored home-based exercise program for frail older adults, driven by mobility monitoring: design of a prospective cohort study , 2014, BMC Public Health.

[33]  G. Jenks.  The Data Model Concept in Statistical Mapping , 1967 .

[34]  Alina Delia Calin,et al.  Interchangeability of Kinect and Orbbec Sensors for Gesture Recognition , 2018, 2018 IEEE 14th International Conference on Intelligent Computer Communication and Processing (ICCP).

[35]  Amihai Gottlieb,et al.  Virtual reality-based cognitive-motor training for middle-aged adults at high Alzheimer's disease risk: A randomized controlled trial , 2018, Alzheimer's & dementia.

[36]  R. Uauy,et al.  Adherence to a physical activity intervention among older adults in a post-transitional middle income country: A quantitative and qualitative analysis , 2012, The journal of nutrition, health & aging.

[37]  Arthur D. Fisk,et al.  Older adults talk technology: Technology usage and attitudes , 2010, Comput. Hum. Behav..

[38]  Lucas P. J. J. Noldus,et al.  Automated Mobile User Experience Measurement: Combining Movement Tracking with App Usage Logging , 2014 .

[39]  Edson Emílio Scalabrin,et al.  Process mining techniques and applications - A systematic mapping study , 2019, Expert Syst. Appl..

[40]  S. Webber,et al.  Mobility in older adults: a comprehensive framework. , 2010, The Gerontologist.

[41]  K. Patrick,et al.  Physical Activity and Public Health: A Recommendation From the Centers for Disease Control and Prevention and the American College of Sports Medicine , 1995 .

[42]  Barbara E Ainsworth,et al.  Prevalence of Physical Activity in the United States: Behavioral Risk Factor Surveillance System, 2001 , 2005, Preventing chronic disease.

[43]  Chris D. Nugent,et al.  Mining usage data for adaptive personalisation of smartphone based help-on-demand services , 2013, PETRA '13.

[44]  Bastiaan Van Grootven,et al.  The European Union's Ambient and Assisted Living Joint Programme: An evaluation of its impact on population health and well-being , 2019, Health Informatics J..

[45]  C. Kawas,et al.  Lower likelihood of falling at age 90+ is associated with daily exercise a quarter of a century earlier: The 90+ Study , 2017, Age and ageing.

[46]  David E. Wiley,et al.  Socially Desirable Responding: The Evolution of a Construct , 2001 .

[47]  Susan H. Komsky.  A Profile of Users of Electronic Mail in a University , 1991 .

[48]  R. Pate.  Physical Activity and Public Health-Reply , 1995 .