When No One is Watching: Ecological Momentary Assessment to Understand Situated Social Robot Use in Healthcare

∗Socially-Assistive Robots (SARs) hold great potential to revolutionize the way we manage chronic illness outside clinical settings, but a current limitation to their broad adoption for this purpose is the lack of “ground truth” around interactions between robots and humans in in-home settings. Such ground truth is a necessity for using robotic sensor data for machine learning models of patient activity patterns or to create AI to customize robotic interactive behavior autonomously. Traditional subjective recall-based data collection methods lack the fine-grained temporal detail to support such AI development, as well as suffering from “recall bias” effects. One potential solution to this challenge is to adapt novel forms of interaction assessment, such as ecological momentary assessment (EMA), to collect patient interaction data in real-time. Here we describe a pilot study utilizing such an EMA system with SARs. We describe the development of the EMA framework, theoretical design issues, and lessons learned. Preliminary machine learning results indicate 75-80% accuracy for detecting specific interaction modalities. We also discuss the potential utility of EMA for exploring cross-cultural differences with in-the-wild robot use, and as a tool to support participatory design research on robotics in healthcare settings. ∗Corresponding Author: Casey C. Bennett, Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from permissions@acm.org. HAI ’21, November 09–11, 2021, Virtual Event, Japan © 2021 Association for Computing Machinery. ACM ISBN 978-1-4503-8620-3/21/11. . . $15.00 https://doi.org/10.1145/3472307.3484670 CCS CONCEPTS • ; • Human-centered computing → Human computer interaction (HCI); HCI design and evaluation methods; • Computer systems organization→ Embedded and cyber-physical systems; Robotics; • Applied computing→ Life and medical sciences; Health informatics;