TACTILE - A Novel Mixed Reality System for Training and Social Interaction

Elderly people are frequently affected by a decline of mental and physical abilities, which results in anxiety, frailty and reclusiveness. Often, they live alone, spatially separated from their families or friends, unable to meet them on a regular basis. The TACTILE project addresses these challenges and fosters an active lifestyle and well-being of older adults via an enjoyable, innovative, and user-friendly Mixed Reality (MR) solution. The system enables training both the cognitive and physical state using MR technology and maintaining social contacts by connecting seniors with family and friends. Cognitive trainings are provided by conventional and physically available board games - such as Ludo - that are completed with virtual game pieces of a remote partner. Since the system uses real physical game pieces, the user experiences a tactile feedback that enables a more familiar feeling and thus novel way of digital interaction. Physical trainings are provided by a virtual avatar that explains and shows dedicated exercises, adaptable to the individual needs and physical restrictions of the user. Thus, the avatar accompanies the user during the physical training in a more natural way.

[1]  Luciano Gamberini,et al.  Controlling Memory Impairment in Elderly Adults Using Virtual Reality Memory Training: A Randomized Controlled Pilot Study , 2010, Neurorehabilitation and neural repair.

[2]  Katsunori Kondo,et al.  Social interaction and cognitive decline: Results of a 7-year community intervention , 2016, Alzheimer's & dementia.

[3]  G. Cohen,et al.  The impact of professionally conducted cultural programs on the physical health, mental health, and social functioning of older adults. , 2006, The Gerontologist.

[4]  A. Barnes Obesity and sedentary lifestyles: risk for cardiovascular disease in women. , 2012, Texas Heart Institute journal.

[5]  Shi Cao,et al.  Virtual Reality Applications in Rehabilitation , 2016, HCI.

[6]  M. Albert,et al.  Social relationships, social support, and patterns of cognitive aging in healthy, high-functioning older adults: MacArthur studies of successful aging. , 2001, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[7]  R. Rubira,et al.  Augmented Reality in Educational Inclusion. A Systematic Review on the Last Decade , 2019, Front. Psychol..

[8]  M. Slater,et al.  Virtual reality in the assessment, understanding, and treatment of mental health disorders , 2017, Psychological Medicine.

[9]  Arindam Dey,et al.  A Systematic Review of 10 Years of Augmented Reality Usability Studies: 2005 to 2014 , 2018, Front. Robot. AI.

[10]  H. Buschke,et al.  Leisure activities and the risk of dementia in the elderly. , 2003, The New England journal of medicine.

[11]  Edwin Olson,et al.  AprilTag: A robust and flexible visual fiducial system , 2011, 2011 IEEE International Conference on Robotics and Automation.

[12]  P. Scarborough,et al.  Physical Activity Statistics 2015 , 2012 .