Mood Mirroring with an Embodied Virtual Agent: A Pilot Study on the Relationship Between Personalized Visual Feedback and Adherence

Human support is thought to increase adherence to internet-based interventions for common mental health disorders, but can be costly and reduce treatment accessibility. Embodied virtual agents may be used to deliver automated support, but while many solutions have been shown to be feasible, there is still little controlled research that empirically validates their clinical effectiveness in this context. This study uses a controlled and randomized paradigm to investigate whether feedback from an embodied virtual agent can increase adherence. In a three-week ecological momentary assessment smartphone study, 68 participants were asked to report their mood three times a day. An embodied virtual agent could mirror participant-reported mood states when thanking them for their answers. A two-stage randomization into a text and personalized visual feedback group, versus a text-only control group, was applied to control for individual differences (study onset) and feedback history (after two weeks). Results indicate that while personalized visual feedback did not increase adherence, it did manage to keep adherence constant over a three-week period, whereas fluctuations in adherence could be observed in the text-only control group. Although this was a pilot study, and its results should be interpreted with some caution, this paper shows how virtual agent feedback may have a stabilizing effect on adherence, how controlled experiments on the relationship between virtual agent support and clinically relevant measures such as adherence can be conducted, and how results may be analyzed.

[1]  Harri Oinas-Kukkonen,et al.  Persuasive Systems Design: Key Issues, Process Model, and System Features , 2009, Commun. Assoc. Inf. Syst..

[2]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[3]  H. Riper,et al.  Mobile Phone-Based Unobtrusive Ecological Momentary Assessment of Day-to-Day Mood: An Explorative Study , 2016, Journal of medical Internet research.

[4]  Derek Richards,et al.  Computer-based psychological treatments for depression: a systematic review and meta-analysis. , 2012, Clinical psychology review.

[5]  Timothy W. Bickmore,et al.  DTask and LiteBody: Open Source, Standards-Based Tools for Building Web-Deployed Embodied Conversational Agents , 2009, IVA.

[6]  Bruce Neal,et al.  A Systematic Review of the Impact of Adherence on the Effectiveness of e-Therapies , 2011, Journal of medical Internet research.

[7]  Issues in Designing Agents for Long Term Behavior Change , 2008 .

[8]  Per Carlbring,et al.  Guided Internet‐based vs. face‐to‐face cognitive behavior therapy for psychiatric and somatic disorders: a systematic review and meta‐analysis , 2014, World psychiatry : official journal of the World Psychiatric Association.

[9]  Stacy Marsella,et al.  Virtual Humans: A New Toolkit for Cognitive Science Research , 2013, CogSci.

[10]  Rosalind W. Picard,et al.  Affective learning companions: strategies for empathetic agents with real-time multimodal affective sensing to foster meta-cognitive and meta-affective approaches to learning, motivation, and perseverance , 2006 .

[11]  S. Shiffman,et al.  Ecological momentary assessment. , 2008, Annual review of clinical psychology.

[12]  D. Ebert,et al.  Reactivity to smartphone-based ecological momentary assessment of depressive symptoms (MoodMonitor): protocol of a randomised controlled trial , 2016, BMC Psychiatry.

[13]  Gerhard Andersson,et al.  Adherence to Internet-Based and Face-to-Face Cognitive Behavioural Therapy for Depression: A Meta-Analysis , 2014, PloS one.

[14]  J. Russell A circumplex model of affect. , 1980 .

[15]  D. Mohr,et al.  Integrating Human Support Into Behavioral Intervention Technologies: The Efficiency Model of Support , 2017 .

[16]  S. Shiffman,et al.  Signaling does not adequately improve diary compliance , 2003, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[17]  P. Cuijpers,et al.  Supportive Accountability: A Model for Providing Human Support to Enhance Adherence to eHealth Interventions , 2011, Journal of medical Internet research.

[18]  S. Kelders,et al.  Persuasive System Design Does Matter: A Systematic Review of Adherence to Web-Based Interventions , 2012, Journal of medical Internet research.

[19]  Bilge Mutlu,et al.  Designing motivational agents: The role of praise, social comparison, and embodiment in computer feedback , 2011, Comput. Hum. Behav..

[20]  Katherine Isbister,et al.  The Blind Men and the Elephant Revisited , 2004, From Brows to Trust.

[21]  Martijn H. Vastenburg,et al.  Pick-a-mood; development and application of a pictorial mood-reporting instrument , 2012 .

[22]  I. Miller,et al.  Use of ecological momentary assessment in mood disorders research. , 2010, Clinical psychology review.

[23]  Maria Klara Wolters,et al.  Psychosocial Implications of Avatar Use in Supporting Therapy for Depression , 2012, Annual Review of Cybertherapy and Telemedicine.

[24]  Ho Ming Lau,et al.  Embodied Conversational Agents in Clinical Psychology: A Scoping Review , 2017, Journal of medical Internet research.