Augmented Reality-Based Remote Family Visits in Nursing Homes

During the COVID-19 pandemic, many nursing homes had to restrict visitations. This had a major negative impact on the wellbeing of residents and their family members. In response, residents and family members increasingly resorted to mediated communication to maintain social contact. To facilitate high-quality mediated social contact between residents in nursing homes and remote family members, we developed an augmented reality (AR)-based communication tool. In this study, we compared the user experience (UX) of AR-communication with that of video calling, for 10 pairs of residents and family members. We measured enjoyment, spatial presence and social presence, attitudes, behavior and conversation duration. In the AR-communication condition, residents perceived a 3D projection of their remote family member onto a chair placed in front of them. In the video calling condition, the family member was shown using 2D video. In both conditions, the family member perceived the resident in the video calling mode on a 2D screen. While residents reported no differences in their UX between both conditions, family members reported higher spatial presence for the AR-communication condition compared to video-calling. Conversation durations were significantly longer during AR-communication than during video calling. We tentatively suggest that there may be (unconscious) differences in UX during AR-based communication compared to video calling.

[1]  E. Georgousopoulou,et al.  A Mini-Review of Virtual Reality-Based Interventions to Promote Well-Being for People Living with Dementia and Mild Cognitive Impairment , 2019, Gerontology.

[2]  H. Bastiaens,et al.  Living in a nursing home: a phenomenological study exploring residents’ loneliness and other feelings , 2018, Scandinavian journal of caring sciences.

[3]  Guda van Noort,et al.  Shopping in augmented reality: The effects of spatial presence, personalization and intrusiveness on app and brand responses , 2020, Journal of Business Research.

[4]  M. Driessnack,et al.  Video-Mediated Communication to Support Distant Family Connectedness , 2013, Clinical nursing research.

[5]  Greg Welch,et al.  A Systematic Review of Social Presence: Definition, Antecedents, and Implications , 2018, Front. Robot. AI.

[6]  K. Laumann,et al.  Questionnaire Measures and Physiological Correlates of Presence: A Systematic Review , 2020, Frontiers in Psychology.

[7]  Abdallah El Ali,et al.  Measuring and Understanding Photo Sharing Experiences in Social Virtual Reality , 2019, CHI.

[8]  Christopher Ball,et al.  Augmented Versus Virtual Reality in Education: An Exploratory Study Examining Science Knowledge Retention When Using Augmented Reality/Virtual Reality Mobile Applications , 2019, Cyberpsychology Behav. Soc. Netw..

[9]  Mel Slater,et al.  A Framework for Immersive Virtual Environments (FIVE): Speculations on the Role of Presence in Virtual Environments , 1997, Presence: Teleoperators & Virtual Environments.

[10]  Judith Redi,et al.  Adjunct Publication of the 2017 ACM International Conference on Interactive Experiences for TV and Online Video , 2017, TVX.

[11]  M. Orrell,et al.  A preliminary psychometric evaluation of Music in Dementia Assessment Scales (MiDAS) , 2014, International Psychogeriatrics.

[12]  R. Nadler,et al.  Understanding “Zoom fatigue”: Theorizing spatial dynamics as third skins in computer-mediated communication , 2020 .

[13]  Ray B. Jones,et al.  Video-calls to reduce loneliness and social isolation within care environments for older people: an implementation study using collaborative action research , 2018, BMC Geriatrics.

[14]  Jennifer L. Gregg,et al.  The Networked Minds Measure of Social Presence : Pilot Test of the Factor Structure and Concurrent Validity , 2001 .

[15]  Mathew B. Chylinski,et al.  Augmenting the eye of the beholder: exploring the strategic potential of augmented reality to enhance online service experiences , 2017, Journal of the Academy of Marketing Science.

[16]  K. Dwan,et al.  Video calls for reducing social isolation and loneliness in older people: a rapid review. , 2020, The Cochrane database of systematic reviews.

[17]  Won Ju Hwang,et al.  Potential of Augmented Reality and Virtual Reality Technologies to Promote Wellbeing in Older Adults , 2019, Applied Sciences.

[18]  Hans Stokking,et al.  Social VR Platform: Building 360-degree Shared VR Spaces , 2017, TVX.

[19]  J. Bailenson,et al.  Social interaction in augmented reality , 2019, PloS one.