Human-Human Health Coaching via Text Messages: Corpus, Annotation, and Analysis

Our goal is to develop and deploy a virtual assistant health coach that can help patients set realistic physical activity goals and live a more active lifestyle. Since there is no publicly shared dataset of health coaching dialogues, the first phase of our research focused on data collection. We hired a certified health coach and 28 patients to collect the first round of human-human health coaching interaction which took place via text messages. This resulted in 2853 messages. The data collection phase was followed by conversation analysis to gain insight into the way information exchange takes place between a health coach and a patient. This was formalized using two annotation schemas: one that focuses on the goals the patient is setting and another that models the higher-level structure of the interactions. In this paper, we discuss these schemas and briefly talk about their application for automatically extracting activity goals and annotating the second round of data, collected with different health coaches and patients. Given the resource-intensive nature of data annotation, successfully annotating a new dataset automatically is key to answer the need for high quality, large datasets.

[1]  G. Hillis,et al.  Effect of Lifestyle-Focused Text Messaging on Risk Factor Modification in Patients With Coronary Heart Disease: A Randomized Clinical Trial. , 2015, JAMA.

[2]  Luke S. Zettlemoyer,et al.  Deep Contextualized Word Representations , 2018, NAACL.

[3]  Denise Ernst,et al.  The Motivational Interviewing Treatment Integrity Code (MITI 4): Rationale, Preliminary Reliability and Validity. , 2016, Journal of substance abuse treatment.

[4]  Takemi Sugiyama,et al.  Perceived barriers to leisure-time physical activity in adults: an ecological perspective. , 2010, Journal of physical activity & health.

[5]  Verónica Pérez-Rosas,et al.  Building a Motivational Interviewing Dataset , 2016, CLPsych@HLT-NAACL.

[6]  Hannes Schulz,et al.  Frames: a corpus for adding memory to goal-oriented dialogue systems , 2017, SIGDIAL Conference.

[7]  Arlen C. Moller,et al.  Social embeddedness in an online weight management programme is linked to greater weight loss , 2015, Journal of The Royal Society Interface.

[8]  Timothy Bickmore,et al.  An Internet-Based Virtual Coach to Promote Physical Activity Adherence in Overweight Adults: Randomized Controlled Trial , 2012, Journal of medical Internet research.

[9]  Patricia M Sheean,et al.  Study design and protocol for moving forward: a weight loss intervention trial for African-American breast cancer survivors , 2015, BMC Cancer.

[10]  Bing Liu,et al.  Goal Summarization for Human-Human Health Coaching Dialogues , 2020, FLAIRS.

[11]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[12]  Michel C. A. Klein,et al.  Towards Fully Automated Psychotherapy for Adults - BAS - Behavioral Activation Scheduling Via Web and Mobile Phone , 2010, HEALTHINF.

[13]  Rodney Nielsen,et al.  Annotating Reflections for Health Behavior Change Therapy , 2018, LREC.

[14]  Verónica Pérez-Rosas,et al.  Analyzing the Quality of Counseling Conversations: the Tell-Tale Signs of High-quality Counseling , 2018, LREC.

[15]  Alexander I. Rudnicky,et al.  Acquiring Domain-Specific Dialog Information from Task-Oriented Human-Human Interaction through an Unsupervised Learning , 2008, EMNLP.

[16]  D. Wade,et al.  Writing SMART rehabilitation goals and achieving goal attainment scaling: a practical guide , 2009, Clinical rehabilitation.

[17]  Timothy W. Bickmore,et al.  A reusable framework for health counseling dialogue systems based on a behavioral medicine ontology , 2011, J. Biomed. Informatics.

[18]  Dean Schillinger,et al.  Using action plans to help primary care patients adopt healthy behaviors: a descriptive study. , 2006, Journal of the American Board of Family Medicine : JABFM.

[19]  H. Holman,et al.  Helping Patients Adopt Healthier Behaviors , 2007 .

[20]  Bing Liu,et al.  Modeling Health Coaching Dialogues for Behavioral Goal Extraction , 2019, 2019 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[21]  Maria Kääriäinen,et al.  The effects of health coaching on adult patients with chronic diseases: a systematic review. , 2014, Patient education and counseling.

[22]  Antoine Raux,et al.  The Dialog State Tracking Challenge , 2013, SIGDIAL Conference.

[23]  Matthew Henderson,et al.  The Second Dialog State Tracking Challenge , 2014, SIGDIAL Conference.

[24]  Nicos Maglaveras,et al.  Development of an innovative mHealth platform for remote physical activity monitoring and health coaching of cardiac rehabilitation patients , 2017, 2017 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI).

[25]  Hamish Cunningham,et al.  GATE-a General Architecture for Text Engineering , 1996, COLING.

[26]  F. Booth,et al.  Role of Inactivity in Chronic Diseases: Evolutionary Insight and Pathophysiological Mechanisms. , 2017, Physiological reviews.