AGNES: Connecting people in a multimodal way

Western societies are confronted with a number of challenges caused by the increasing number of older citizens. One important aspect is the need and wish of older people to live as long as possible in their own home and maintain an independent life. As people grew older, their social networks disperse, with friends and families moving to other parts of town, other cities or even countries. Additionally, people become less mobile with age, leading to less active participation in societal life. Combined, this normal, age-related development leads to increased loneliness and social isolation of older people, with negative effects on mental and physical health of those people. In the AGNES project, a home-based system has been developed that allows connecting elderly with their families, friends and other significant people over the Internet. As most older people have limited experience with computers and often special requirements on technology, one focus of AGNES was to develop with the users novel technological means for interacting with their social network. The resulting system uses ambient displays, tangible interfaces and wearable devices providing ubiquitous options for interaction with the network, and secondary sensors for additionally generating carefully chosen information on the person to be relayed to significant persons. Evaluations show that the chosen modalities for interaction are well adopted by the users. Further it was found that use of the AGNES system had positive effects on the mental state of the users, compared to the control group without the technology.

[1]  Steve Benford,et al.  Physical manipulation: evaluating the potential for tangible designs , 2009, TEI.

[2]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[3]  B. Uchino,et al.  Social and emotional support and its implication for health , 2008, Current opinion in psychiatry.

[4]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[5]  Gregory D. Abowd,et al.  Charting past, present, and future research in ubiquitous computing , 2000, TCHI.

[6]  Christian Peter,et al.  The role of ICT and networking in healthy ageing , 2012, PETRA '12.

[7]  Nadia Mana,et al.  What is happening now? Detection of activities of daily living from simple visual features , 2010, Personal and Ubiquitous Computing.

[8]  L. Hawkley,et al.  Loneliness as a specific risk factor for depressive symptoms: cross-sectional and longitudinal analyses. , 2006, Psychology and aging.

[9]  Anind K. Dey,et al.  Heuristic evaluation of ambient displays , 2003, CHI '03.

[10]  F. Mahoney,et al.  FUNCTIONAL EVALUATION: THE BARTHEL INDEX. , 2018, Maryland state medical journal.

[11]  Mirina Grosz,et al.  World Wide Web Consortium , 2010 .

[12]  Anne Boomsma,et al.  Dimensions Of Well-Being And Their Measurement: The Spf-Il Scale , 2005 .

[13]  Sriram Subramanian,et al.  Talking about tactile experiences , 2013, CHI.

[14]  Denise C. Park,et al.  Cognitive aging: New directions for old theories , 2012 .

[15]  J. Schneider,et al.  Loneliness and risk of Alzheimer disease. , 2007, Archives of general psychiatry.

[16]  Hiroshi Ishii,et al.  Tangible bits: beyond pixels , 2008, TEI.

[17]  Richard W. Devaul,et al.  Real-time motion classi ca-tion for wearable computing applications , 2001 .

[18]  V. Leirer,et al.  Development and validation of a geriatric depression screening scale: a preliminary report. , 1982, Journal of psychiatric research.

[19]  B. Winblad,et al.  Influence of social network on occurrence of dementia: a community-based longitudinal study , 2000, The Lancet.

[20]  Mark Weiser,et al.  Designing Calm Technology , 2004 .

[21]  S. Rathus Psychology, 3rd ed. , 1987 .

[22]  Paul Dourish,et al.  A handle on what's going on: combining tangible interfaces and ambient displays for collaborative groups , 2007, TEI.

[23]  S. Folstein,et al.  "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. , 1975, Journal of psychiatric research.

[24]  Kamiar Aminian,et al.  Ambulatory system for human motion analysis using a kinematic sensor: monitoring of daily physical activity in the elderly , 2003, IEEE Transactions on Biomedical Engineering.

[25]  Henry A. Kautz,et al.  Fine-grained activity recognition by aggregating abstract object usage , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[26]  Carla H. Lagorio,et al.  Psychology , 1929, Nature.

[27]  Hiroshi Ishii,et al.  Water lamp and pinwheels: ambient projection of digital information into architectural space , 1998, CHI Conference Summary.

[28]  Gerald Bieber,et al.  Activity Recognition for Everyday Life on Mobile Phones , 2009, HCI.

[29]  Lars-Göran Nilsson,et al.  New frontiers in cognitive aging , 2004 .

[30]  Vern L. Bengtson,et al.  Cognitive Changes Across the Lifespan , 2005 .

[31]  Henry A. Kautz,et al.  Inferring activities from interactions with objects , 2004, IEEE Pervasive Computing.

[32]  Hiroshi Ishii,et al.  Emerging frameworks for tangible user interfaces , 2000, IBM Syst. J..

[33]  Anthony Rowe,et al.  Location and Activity Recognition Using eWatch: A Wearable Sensor Platform , 2006, Ambient Intelligence in Everyday.

[34]  James A. Landay,et al.  The Mobile Sensing Platform: An Embedded Activity Recognition System , 2008, IEEE Pervasive Computing.

[35]  D. Schacter Implicit memory: History and current status. , 1987 .

[36]  Christian Peter,et al.  Seniors in charge of ICT innovation , 2012, PETRA '12.