Predictive modeling in e-mental health: A common language framework

Recent developments in mobile technology, sensor devices, and artificial intelligence have created new opportunities for mental health care research. Enabled by large datasets collected in e-mental health research and practice, clinical researchers and members of the data mining community increasingly join forces to build predictive models for health monitoring, treatment selection, and treatment personalization. This paper aims to bridge the historical and conceptual gaps between the distant research domains involved in this new collaborative research by providing a conceptual model of common research goals. We first provide a brief overview of the data mining field and methods used for predictive modeling. Next, we propose to characterize predictive modeling research in mental health care on three dimensions: 1) time, relative to treatment (i.e., from screening to post-treatment relapse monitoring), 2) types of available data (e.g., questionnaire data, ecological momentary assessments, smartphone sensor data), and 3) type of clinical decision (i.e., whether data are used for screening purposes, treatment selection or treatment personalization). Building on these three dimensions, we introduce a framework that identifies four model types that can be used to classify existing and future research and applications. To illustrate this, we use the framework to classify and discuss published predictive modeling mental health research. Finally, in the discussion, we reflect on the next steps that are required to drive forward this promising new interdisciplinary field.

[1]  Galit Shmueli,et al.  To Explain or To Predict? , 2010, 1101.0891.

[2]  Olga V. Demler,et al.  Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. , 2005, Archives of general psychiatry.

[3]  S. Lord,et al.  Implementation of a Substance Use Recovery Support Mobile Phone App in Community Settings: Qualitative Study of Clinician and Staff Perspectives of Facilitators and Barriers , 2016, JMIR mental health.

[4]  A. Feigl,et al.  The Global Economic Burden of Noncommunicable Diseases , 2012 .

[5]  Arvid Sj Propensity scores and M-structures , 2009 .

[6]  Shinichi Morishita,et al.  On Classification and Regression , 1998, Discovery Science.

[7]  S. Shiffman,et al.  Ecological momentary assessment. , 2008, Annual review of clinical psychology.

[8]  Michel C. A. Klein,et al.  Modeling an Ambient Agent to Support Depression Relapse Prevention , 2009, 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology.

[9]  Barry L. Duncan,et al.  Using Formal Client Feedback to Improve Retention and Outcome: Making Ongoing, Real-time Assessment Feasible , 2006 .

[10]  A. Leenaars,et al.  Suicide Note Classification Using Natural Language Processing: A Content Analysis , 2010, Biomedical informatics insights.

[11]  Tommi Härkänen,et al.  Association of Socio-Demographic Factors, Sick-Leave and Health Care Patterns with the Risk of Being Granted a Disability Pension among Psychiatric Outpatients with Depression , 2014, PloS one.

[12]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[13]  Alberto RibesAbstract,et al.  Multi agent systems , 2019, Proceedings of the 2005 International Conference on Active Media Technology, 2005. (AMT 2005)..

[14]  David Lazer,et al.  Inferring friendship network structure by using mobile phone data , 2009, Proceedings of the National Academy of Sciences.

[15]  Mark Hoogendoorn,et al.  Machine Learning for the Quantified Self - On the Art of Learning from Sensory Data , 2017, Cognitive Systems Monographs.

[16]  J. D. Runyan,et al.  A Smartphone Ecological Momentary Assessment/Intervention “App” for Collecting Real-Time Data and Promoting Self-Awareness , 2013, PloS one.

[17]  Mark Hoogendoorn,et al.  Predicting Social Anxiety Treatment Outcome Based on Therapeutic Email Conversations , 2017, IEEE Journal of Biomedical and Health Informatics.

[18]  David Weller,et al.  Functional Somatic Symptoms and Psychological States: An Electronic Diary Study , 2009, Psychosomatic medicine.

[19]  Peter A. Flach,et al.  Confirmation-Guided Discovery of First-Order Rules with Tertius , 2004, Machine Learning.

[20]  Helen Christensen,et al.  Impact of a mobile phone and web program on symptom and functional outcomes for people with mild-to-moderate depression, anxiety and stress: a randomised controlled trial , 2013, BMC Psychiatry.

[21]  Bruce Neal,et al.  Rethinking the Dose-Response Relationship Between Usage and Outcome in an Online Intervention for Depression: Randomized Controlled Trial , 2013, Journal of medical Internet research.

[22]  Daniel Gatica-Perez,et al.  StressSense: detecting stress in unconstrained acoustic environments using smartphones , 2012, UbiComp.

[23]  Morten Hesse,et al.  A simple risk scoring system for prediction of relapse after inpatient alcohol treatment. , 2009, The American journal on addictions.

[24]  Marcel Abendroth,et al.  Data Mining Practical Machine Learning Tools And Techniques With Java Implementations , 2016 .

[25]  R. Perlis A Clinical Risk Stratification Tool for Predicting Treatment Resistance in Major Depressive Disorder , 2013, Biological Psychiatry.

[26]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[27]  Gavin Andrews,et al.  Internet Treatment for Generalized Anxiety Disorder: A Randomized Controlled Trial Comparing Clinician vs. Technician Assistance , 2010, PloS one.

[28]  Mason A. Porter,et al.  Commun Nonlinear Sci Numer Simulat , 2009 .

[29]  P. Mitchell,et al.  Evaluation of an Online Relapse Prevention Program for Bipolar Disorder , 2007 .

[30]  Gordon Parker,et al.  Breaking Open the Black Box: Isolating the Most Potent Features of a Web and Mobile Phone-Based Intervention for Depression, Anxiety, and Stress , 2015, JMIR mental health.

[31]  P. Steerenberg,et al.  Targeting pathophysiological rhythms: prednisone chronotherapy shows sustained efficacy in rheumatoid arthritis. , 2010, Annals of the rheumatic diseases.

[32]  R. Dawes Judgment under uncertainty: The robust beauty of improper linear models in decision making , 1979 .

[33]  J. Smyth,et al.  Ecological momentary interventions: incorporating mobile technology into psychosocial and health behaviour treatments. , 2010, British journal of health psychology.

[34]  L. Clark,et al.  Reducing relapse and recurrence in unipolar depression: a comparative meta-analysis of cognitive-behavioral therapy's effects. , 2007, Journal of consulting and clinical psychology.

[35]  Arnoud Arntz,et al.  Predicting Optimal Outcomes in Cognitive Therapy or Interpersonal Psychotherapy for Depressed Individuals Using the Personalized Advantage Index Approach , 2015, PloS one.

[36]  Michel C. A. Klein,et al.  Computational Modeling and Analysis of Therapeutical Interventions for Depression , 2010, Brain Informatics.

[37]  Gregory L. Stuart,et al.  Transporting an empirically supported treatment for panic disorder to a service clinic setting: a benchmarking strategy. , 1998, Journal of consulting and clinical psychology.

[38]  Zachary D. Cohen,et al.  The Personalized Advantage Index: Translating Research on Prediction into Individualized Treatment Recommendations. A Demonstration , 2014, PloS one.

[39]  C. Botella,et al.  Predictors of treatment dropout in self-guided web-based interventions for depression: an ‘individual patient data’ meta-analysis , 2015, Psychological Medicine.

[40]  Kiran Gawande,et al.  Identifying associations between smartphone usage and mental health during depression, anxiety and stress , 2015, 2015 International Conference on Communication, Information & Computing Technology (ICCICT).

[41]  David A. Landgrebe,et al.  A survey of decision tree classifier methodology , 1991, IEEE Trans. Syst. Man Cybern..

[42]  Hsuan-Tien Lin,et al.  Learning From Data , 2012 .

[43]  Saskia M Kelders,et al.  Understanding the Usage of Content in a Mental Health Intervention for Depression: An Analysis of Log Data , 2014, Journal of medical Internet research.

[44]  D. Mohr,et al.  Harnessing Context Sensing to Develop a Mobile Intervention for Depression , 2011, Journal of medical Internet research.

[45]  B. Roberts,et al.  Theory-driven intervention for changing personality: expectancy value theory, behavioral activation, and conscientiousness. , 2014, Developmental psychology.

[46]  Anirban Basu,et al.  Predicting Future Risk of Depressive Episode in Adolescents: The Chicago Adolescent Depression Risk Assessment (CADRA) , 2008, The Annals of Family Medicine.

[47]  Toru Nakamura,et al.  Covariation of Depressive Mood and Spontaneous Physical Activity in Major Depressive Disorder: Toward Continuous Monitoring of Depressive Mood , 2015, IEEE Journal of Biomedical and Health Informatics.

[48]  Cynthia S Jacelon,et al.  Participant Diaries as a Source of Data in Research With Older Adults , 2005, Qualitative health research.

[49]  R A Gould,et al.  An effect-size analysis of the relative efficacy and tolerability of serotonin selective reuptake inhibitors for panic disorder. , 2001, The American journal of psychiatry.

[50]  N. Altman An Introduction to Kernel and Nearest-Neighbor Nonparametric Regression , 1992 .

[51]  Bernard P. Zeigler,et al.  Theory of Modeling and Simulation: Integrating Discrete Event and Continuous Complex Dynamic Systems , 2000 .

[52]  Ton Dijkstra,et al.  Computer Aided Diagnosis for Mental Health Care - On the Clinical Validation of Sensitive Machines , 2012, HEALTHINF.

[53]  Michael J. Lambert,et al.  "Yes, it is time for clinicians to routinely monitor treatment outcome" , 2010 .

[54]  G. Andersson,et al.  Two-year outcome of internet-based relapse prevention for partially remitted depression. , 2013, Behaviour research and therapy.

[55]  J. Os,et al.  Momentary assessment technology as a tool to help patients with depression help themselves , 2011, Acta psychiatrica Scandinavica.

[56]  Olga V. Demler,et al.  Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the National Comorbidity Survey Replication. , 2005, Archives of general psychiatry.

[57]  Sarah L. Noble Control-theoretic scheduling of psychotherapy and pharmacotherapy for the treatment of post-traumatic stress disorder , 2014 .

[58]  Gerhard Andersson,et al.  MindSpot Clinic: An Accessible, Efficient, and Effective Online Treatment Service for Anxiety and Depression. , 2015, Psychiatric services.

[59]  Casey C. Bennett,et al.  Data Mining Session-Based Patient Reported Outcomes (PROs) in a Mental Health Setting: Toward Data-Driven Clinical Decision Support and Personalized Treatment , 2011, 2011 IEEE First International Conference on Healthcare Informatics, Imaging and Systems Biology.

[60]  J. Canny,et al.  AMMON : A Speech Analysis Library for Analyzing Affect , Stress , and Mental Health on Mobile Phones , 2011 .

[61]  Mark Hoogendoorn,et al.  A feature representation learning method for temporal datasets , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[62]  Stefan Priebe,et al.  Does the Therapeutic Relationship Predict Outcomes of Psychiatric Treatment in Patients with Psychosis? A Systematic Review , 2010, Psychotherapy and Psychosomatics.

[63]  R. Kessler,et al.  Effects of daily stress on negative mood. , 1989, Journal of personality and social psychology.

[64]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[65]  Patrick C. Staples,et al.  Realizing the Potential of Mobile Mental Health: New Methods for New Data in Psychiatry , 2015, Current Psychiatry Reports.

[66]  Robert A Schoevers,et al.  Does early response predict outcome in psychotherapy and combined therapy for major depression? , 2008, Journal of affective disorders.

[67]  Konrad Paul Kording,et al.  Mobile Phone Sensor Correlates of Depressive Symptom Severity in Daily-Life Behavior: An Exploratory Study , 2015, Journal of medical Internet research.

[68]  J. Smyth,et al.  Ecological Momentary Assessment Research in Behavioral medicine , 2003 .

[69]  David M. Gute,et al.  Baseline Socio-demographic Characteristics and Self-Reported Diet and Physical Activity Shifts Among Recent Immigrants Participating in the Randomized Controlled Lifestyle Intervention: “Live Well” , 2014, Journal of Immigrant and Minority Health.

[70]  Stephanie P Goldstein,et al.  Review of smartphone applications for the treatment of eating disorders. , 2015, European eating disorders review : the journal of the Eating Disorders Association.

[71]  J. Pearl Myth, Confusion, and Science in Causal Analysis , 2009 .

[72]  Oscar Mayora-Ibarra,et al.  Monitoring activity of patients with bipolar disorder using smart phones , 2013, MoMM '13.

[73]  George C. Anastassopoulos,et al.  A Contextual Data Mining Approach Toward Assisting the Treatment of Anxiety Disorders , 2010, IEEE Transactions on Information Technology in Biomedicine.

[74]  K. Demi̇rci̇,et al.  Relationship of Smartphone Use Severity with Sleep Quality, Depression, and Anxiety in University Students , 2015, Journal of behavioral addictions.

[75]  Ayse Canan Yazici,et al.  Comparison of logistic regression model and classification tree: An application to postpartum depression data , 2007, Expert Syst. Appl..

[76]  David L. Olson,et al.  Advanced Data Mining Techniques , 2008 .

[77]  Burkhardt Funk,et al.  How to Predict Mood? Delving into Features of Smartphone-Based Data , 2016, AMCIS.

[78]  Michael F. Armey,et al.  Ecological momentary assessment (EMA) of depression-related phenomena. , 2015, Current opinion in psychology.

[79]  D. Gustafson,et al.  Predictive modeling of addiction lapses in a mobile health application. , 2014, Journal of substance abuse treatment.

[80]  Yunxin Liu,et al.  MoodScope: building a mood sensor from smartphone usage patterns , 2013, MobiSys.

[81]  John Zimmerman,et al.  Detection of Behavior Change in People with Depression , 2014, AAAI Workshop: Modern Artificial Intelligence for Health Analytics.

[82]  Carol A Gotway Crawford,et al.  A New Source of Data for Public Health Surveillance: Facebook Likes , 2015, Journal of medical Internet research.

[83]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[84]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[85]  Michel C. A. Klein,et al.  Validation of a Model for Coping and Mood for Virtual Agents , 2012, 2012 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology.

[86]  P J Diggle,et al.  Feasibility and acceptability of web-based enhanced relapse prevention for bipolar disorder (ERPonline): trial protocol. , 2015, Contemporary clinical trials.

[87]  Sen Cheng,et al.  Modeling the Dynamics of Disease States in Depression , 2014, PloS one.

[88]  John P. A. Ioannidis,et al.  Big data meets public health , 2014, Science.

[89]  A. Sjölander Propensity scores and M‐structures , 2009, Statistics in medicine.

[90]  Christoph Flückiger,et al.  Predicting Psychotherapy Dropouts: A Multilevel Approach. , 2015, Clinical psychology & psychotherapy.

[91]  Michael Wooldridge,et al.  Handbook of Knowledge Representation Edited Situation Calculus , 2022 .

[92]  Lars Vedel Kessing,et al.  Severity of depressive episodes according to ICD-10: prediction of risk of relapse and suicide , 2004, British Journal of Psychiatry.

[93]  D. Moskowitz,et al.  Ecological momentary assessment: what it is and why it is a method of the future in clinical psychopharmacology. , 2006, Journal of psychiatry & neuroscience : JPN.

[94]  Peter M. ten Klooster,et al.  Dropout prediction in a public mental health intervention for sub-threshold and mild panic disorder , 2015, The Cognitive Behaviour Therapist.

[95]  Burkhardt Funk,et al.  Predicting the Individual Mood Level based on diary Data , 2017, ECIS.

[96]  Dhavan V. Shah,et al.  A smartphone application to support recovery from alcoholism: a randomized clinical trial. , 2014, JAMA psychiatry.

[97]  Pat Langley,et al.  An Analysis of Bayesian Classifiers , 1992, AAAI.

[98]  Heleen Riper,et al.  Mobile cognitive therapy : Adherence and acceptability of an online intervention in remitted recurrently depressed patients , 2014 .

[99]  H. Riper,et al.  Mobile Phone-Based Unobtrusive Ecological Momentary Assessment of Day-to-Day Mood: An Explorative Study , 2016, Journal of medical Internet research.

[100]  Patricia A. Berglund,et al.  Lifetime prevalence and age of onset distributions of mental disorders in the World Mental Health Survey Initiative. , 2008 .

[101]  C. Farren,et al.  Prognostic factors of 2-year outcomes of patients with comorbid bipolar disorder or depression with alcohol dependence: importance of early abstinence. , 2013, Alcohol and alcoholism.

[102]  Malcolm R. Forster,et al.  How to Tell When Simpler, More Unified, or Less Ad Hoc Theories will Provide More Accurate Predictions , 1994, The British Journal for the Philosophy of Science.

[103]  Brian Neelon,et al.  Accurately Predicting Bipolar Disorder Mood Outcomes: Implications for the use of Electronic Databases , 2012, Medical care.

[104]  C. M. Hill Computer-aided diagnosis. , 1992, Dental update.

[105]  Emiliano Miluzzo,et al.  A survey of mobile phone sensing , 2010, IEEE Communications Magazine.

[106]  Simon Haykin,et al.  Neural Networks and Learning Machines , 2010 .

[107]  Fiemke Griffioen-Both,et al.  Utilization of a Virtual Patient Model to Enable Tailored Therapy for Depressed Patients , 2011, ICONIP.

[108]  S. Patten Markov models of major depression for linking psychiatric epidemiology to clinical practice , 2005, Clinical practice and epidemiology in mental health : CP & EMH.

[109]  Guodong Sun,et al.  Daily Mood Assessment Based on Mobile Phone Sensing , 2012, 2012 Ninth International Conference on Wearable and Implantable Body Sensor Networks.

[110]  Peter de Jonge,et al.  Major depressive episodes and random mood. , 2006, Archives of general psychiatry.

[111]  C. Farren,et al.  Predictive factors for relapse after an integrated inpatient treatment programme for unipolar depressed and bipolar alcoholics. , 2010, Alcohol and alcoholism.

[112]  Burkhardt Funk,et al.  How Big Does Big Data Need to Be , 2016 .