Accelerating Digital Mental Health Research From Early Design and Creation to Successful Implementation and Sustainment

Mental health problems are common and pose a tremendous societal burden in terms of cost, morbidity, quality of life, and mortality. The great majority of people experience barriers that prevent access to treatment, aggravated by a lack of mental health specialists. Digital mental health is potentially useful in meeting the treatment needs of large numbers of people. A growing number of efficacy trials have shown strong outcomes for digital mental health treatments. Yet despite their positive findings, there are very few examples of successful implementations and many failures. Although the research-to-practice gap is not unique to digital mental health, the inclusion of technology poses unique challenges. We outline some of the reasons for this gap and propose a collection of methods that can result in sustainable digital mental health interventions. These methods draw from human-computer interaction and implementation science and are integrated into an Accelerated Creation-to-Sustainment (ACTS) model. The ACTS model uses an iterative process that includes 2 basic functions (design and evaluate) across 3 general phases (Create, Trial, and Sustain). The ultimate goal in using the ACTS model is to produce a functioning technology-enabled service (TES) that is sustainable in a real-world treatment setting. We emphasize the importance of the service component because evidence from both research and practice has suggested that human touch is a critical ingredient in the most efficacious and used digital mental health treatments. The Create phase results in at least a minimally viable TES and an implementation blueprint. The Trial phase requires evaluation of both effectiveness and implementation while allowing optimization and continuous quality improvement of the TES and implementation plan. Finally, the Sustainment phase involves the withdrawal of research or donor support, while leaving a functioning, continuously improving TES in place. The ACTS model is a step toward bringing implementation and sustainment into the design and evaluation of TESs, public health into clinical research, research into clinics, and treatment into the lives of our patients.

[1]  D. Mohr,et al.  Behavioral intervention technologies: evidence review and recommendations for future research in mental health. , 2013, General hospital psychiatry.

[2]  D. Mohr,et al.  Barriers to psychotherapy among depressed and nondepressed primary care patients , 2006, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[3]  Andreas Maercker,et al.  Internet-based versus face-to-face cognitive-behavioral intervention for depression: a randomized controlled non-inferiority trial. , 2014, Journal of affective disorders.

[4]  G. Aarons,et al.  Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors , 2010, Administration and Policy in Mental Health and Mental Health Services Research.

[5]  B. Everitt,et al.  Computerized, interactive, multimedia cognitive-behavioural program for anxiety and depression in general practice , 2003, Psychological Medicine.

[6]  William T Riley,et al.  Trials of Intervention Principles: Evaluation Methods for Evolving Behavioral Intervention Technologies , 2015, Journal of medical Internet research.

[7]  Ricardo Araya,et al.  Computerised cognitive behaviour therapy (cCBT) as treatment for depression in primary care (REEACT trial): large scale pragmatic randomised controlled trial , 2016, BMJ : British Medical Journal.

[8]  G. Eysenbach CONSORT-EHEALTH: Improving and Standardizing Evaluation Reports of Web-based and Mobile Health Interventions , 2011, Journal of medical Internet research.

[9]  Elisa M. Torres,et al.  The Roles of System and Organizational Leadership in System-Wide Evidence-Based Intervention Sustainment: A Mixed-Method Study , 2016, Administration and Policy in Mental Health and Mental Health Services Research.

[10]  D. Brody,et al.  Patients' perspectives on the management of emotional distress in primary care settings , 1997, Journal of General Internal Medicine.

[11]  Kathleen M Griffiths,et al.  Web-based Cognitive Behavior Therapy: Analysis of Site Usage and Changes in Depression and Anxiety Scores , 2002, Journal of medical Internet research.

[12]  James B. Dabney,et al.  Error Cost Escalation Through the Project Life Cycle , 2004 .

[13]  Jennifer L. Pomeranz,et al.  The Delivery of Public Health Interventions via the Internet: Actualizing Their Potential , 2011 .

[14]  C. Mathers,et al.  Projections of Global Mortality and Burden of Disease from 2002 to 2030 , 2006, PLoS medicine.

[15]  A. Kazdin,et al.  Rebooting Psychotherapy Research and Practice to Reduce the Burden of Mental Illness , 2011, Perspectives on psychological science : a journal of the Association for Psychological Science.

[16]  T. Hu Perspectives: an international review of the national cost estimates of mental illness, 1990-2003. , 2006, The journal of mental health policy and economics.

[17]  Amy P Abernethy,et al.  Rapid, responsive, relevant (R3) research: a call for a rapid learning health research enterprise , 2013, Clinical and Translational Medicine.

[18]  Madhu Reddy,et al.  Three Problems With Current Digital Mental Health Research . . . and Three Things We Can Do About Them. , 2017, Psychiatric services.

[19]  Martin Wolf,et al.  Cerebral near infrared spectroscopy oximetry in extremely preterm infants: phase II randomised clinical trial , 2015, BMJ : British Medical Journal.

[20]  P. Cuijpers,et al.  Effect of a Web-Based Guided Self-help Intervention for Prevention of Major Depression in Adults With Subthreshold Depression: A Randomized Clinical Trial. , 2016, JAMA.

[21]  Aaron R. Lyon,et al.  User-Centered Design for Psychosocial Intervention Development and Implementation. , 2016, Clinical psychology : a publication of the Division of Clinical Psychology of the American Psychological Association.

[22]  Shumin Zhai,et al.  Principles, Techniques and Perspectives on Optimization and HCI , 2015, CHI Extended Abstracts.

[23]  Olga V. Demler,et al.  Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the National Comorbidity Survey Replication. , 2005, Archives of general psychiatry.

[24]  R G Priest,et al.  Lay people's attitudes to treatment of depression: results of opinion poll for Defeat Depression Campaign just before its launch , 1996, BMJ.

[25]  Daniel E. Rivera,et al.  Agile science: creating useful products for behavior change in the real world , 2016, Translational behavioral medicine.

[26]  Gerhard Andersson,et al.  Computer‐Aided Psychotherapy for Anxiety Disorders: A Meta‐Analytic Review , 2009, Cognitive behaviour therapy.

[27]  G. Andersson,et al.  Does Internet-based guided-self-help for depression cause harm? An individual participant data meta-analysis on deterioration rates and its moderators in randomized controlled trials , 2016, Psychological Medicine.

[28]  M. Ogihara,et al.  Blending Qualitative and Computational Linguistics Methods for Fidelity Assessment: Experience with the Familias Unidas Preventive Intervention , 2015, Administration and Policy in Mental Health and Mental Health Services Research.

[29]  David A. Chambers,et al.  Implementation Research in Mental Health Services: an Emerging Science with Conceptual, Methodological, and Training challenges , 2008, Administration and Policy in Mental Health and Mental Health Services Research.

[30]  E. Balas,et al.  Managing Clinical Knowledge for Health Care Improvement , 2000, Yearbook of Medical Informatics.

[31]  Derek Richards,et al.  Computer-based psychological treatments for depression: a systematic review and meta-analysis. , 2012, Clinical psychology review.

[32]  Chi-Hong Tseng,et al.  Effectiveness of a Smartphone Application for Weight Loss Compared With Usual Care in Overweight Primary Care Patients , 2014, Annals of Internal Medicine.

[33]  Stephen Sutton,et al.  IDEAS (Integrate, Design, Assess, and Share): A Framework and Toolkit of Strategies for the Development of More Effective Digital Interventions to Change Health Behavior , 2016, Journal of medical Internet research.

[34]  Claude Ghaoui,et al.  Encyclopedia of Human Computer Interaction , 2005 .

[35]  Adam A. Lewis,et al.  Multimodal E-Mental Health Treatment for Depression: A Feasibility Trial , 2010, Journal of medical Internet research.

[36]  Ger Koole,et al.  Costs and effects of Internet cognitive behavioral treatment blended with face-to-face treatment: Results from a naturalistic study , 2015 .

[37]  R. Pea User Centered System Design: New Perspectives on Human-Computer Interaction , 1987 .

[38]  James H. Ford,et al.  Successful Organizational Strategies to Sustain Use of A-CHESS: A Mobile Intervention for Individuals With Alcohol Use Disorders , 2015, Journal of medical Internet research.

[39]  Barry Boehm,et al.  Top 10 list [software development] , 2001 .

[40]  Wendy E. Mackay,et al.  The interactive thread: exploring methods for multi-disciplinary design , 2004, DIS '04.

[41]  Suzanne Bakken,et al.  Review of health information technology usability study methodologies , 2011, J. Am. Medical Informatics Assoc..

[42]  Raj M. Ratwani,et al.  Electronic health record usability: analysis of the user-centered design processes of eleven electronic health record vendors , 2015, J. Am. Medical Informatics Assoc..

[43]  Vijay N. Nair,et al.  A strategy for optimizing and evaluating behavioral interventions , 2005, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[44]  Andrew Lee,et al.  Treating depression in general practice: factors affecting patients' treatment preferences. , 2000, The British journal of general practice : the journal of the Royal College of General Practitioners.

[45]  Manfred Tscheligi,et al.  Paper prototyping - what is it good for?: a comparison of paper- and computer-based low-fidelity prototyping , 2003, CHI Extended Abstracts.

[46]  Geoffrey M. Curran,et al.  Effectiveness-implementation Hybrid Designs: Combining Elements of Clinical Effectiveness and Implementation Research to Enhance Public Health Impact , 2012, Medical care.

[47]  Per Carlbring,et al.  Guided Internet‐based vs. face‐to‐face cognitive behavior therapy for psychiatric and somatic disorders: a systematic review and meta‐analysis , 2014, World psychiatry : official journal of the World Psychiatric Association.

[48]  David C Mohr,et al.  Continuous evaluation of evolving behavioral intervention technologies. , 2013, American journal of preventive medicine.

[49]  Nara L. Newcomer,et al.  User Centered Design , 2014, Encyclopedia of Database Systems.

[50]  J. Kimberly,et al.  The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research , 2012, Implementation Science.

[51]  John Bessant,et al.  DEVELOPING RADICAL SERVICE INNOVATIONS IN HEALTHCARE — THE ROLE OF DESIGN METHODS , 2009 .

[52]  Jakob Nielsen,et al.  Finding usability problems through heuristic evaluation , 1992, CHI.

[53]  R. Glasgow,et al.  Why don't we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. , 2003, American journal of public health.

[54]  Barry W. Boehm,et al.  Software Defect Reduction Top 10 List , 2001, Computer.

[55]  Ross C Brownson,et al.  Designing for dissemination among public health researchers: findings from a national survey in the United States. , 2013, American journal of public health.

[56]  Michael J. Muller,et al.  Participatory design: the third space in HCI , 2002 .

[57]  M. Dewey,et al.  Assessing effectiveness of treatment of depression in primary care. Partially randomised preference trial. , 2000, The British journal of psychiatry : the journal of mental science.

[58]  Madhu C. Reddy,et al.  Technology, work, and information flows: Lessons from the implementation of a wireless alert pager system , 2005, J. Biomed. Informatics.

[59]  Janet Mancini Billson,et al.  Focus Groups: A Practical Guide for Applied Research , 1989 .

[60]  Douglas Schuler,et al.  Participatory Design: Principles and Practices , 1993 .

[61]  Philip J. Barnard,et al.  THE HANDBOOK OF TASK ANALYSIS FOR HUMAN-COMPUTER INTERACTION , 2003 .

[62]  Clay Spinuzzi,et al.  The Methodology of Participatory Design , 2005 .

[63]  S. King,et al.  Co-Design: A Process of Design Participation , 1989 .

[64]  Dean L. Fixsen,et al.  Core Implementation Components , 2009 .

[65]  David A. Chambers,et al.  The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change , 2013, Implementation Science.

[66]  Aaron R. Lyon,et al.  The Contextualized Technology Adaptation Process (CTAP): Optimizing Health Information Technology to Improve Mental Health Systems , 2016, Administration and Policy in Mental Health and Mental Health Services Research.

[67]  Per Carlbring,et al.  Consensus statement on defining and measuring negative effects of Internet interventions , 2014 .

[68]  C. Sherbourne,et al.  Treatment preferences among depressed primary care patients , 2000, Journal of General Internal Medicine.

[69]  Muin J Khoury,et al.  Convergence of Implementation Science, Precision Medicine, and the Learning Health Care System: A New Model for Biomedical Research. , 2016, JAMA.

[70]  Karel Vredenburg,et al.  A survey of user-centered design practice , 2002, CHI.

[71]  Madhu C. Reddy,et al.  Evaluating collaborative features of critical care systems: A methodological study of information technology in surgical intensive care units , 2008, J. Biomed. Informatics.

[72]  R. Hutton,et al.  Applied cognitive task analysis (ACTA): a practitioner's toolkit for understanding cognitive task demands. , 1998, Ergonomics.

[73]  Dror Ben-Zeev,et al.  Clinical technology specialists , 2015, BMJ : British Medical Journal.

[74]  Joseph A. Cafazzo,et al.  mHealth consumer apps: the case for user-centered design. , 2012, Biomedical instrumentation & technology.

[75]  Predrag V. Klasnja,et al.  Mind the theoretical gap: interpreting, using, and developing behavioral theory in HCI research , 2013, CHI.

[76]  G. Aarons,et al.  Dissemination and implementation of evidence-based practices for child and adolescent mental health: a systematic review. , 2013, Journal of the American Academy of Child and Adolescent Psychiatry.

[77]  M. Marcus,et al.  Effect of Wearable Technology Combined With a Lifestyle Intervention on Long-term Weight Loss: The IDEA Randomized Clinical Trial. , 2016, JAMA.

[78]  Erik Olsson,et al.  Is online treatment adherence affected by presentation and therapist support? A randomized controlled trial , 2016, Comput. Hum. Behav..

[79]  B. Rounsaville,et al.  A Stage Model of Behavioral Therapies Research: Getting Started and Moving on From Stage I , 2006 .

[80]  H. Christensen,et al.  Smartphones for Smarter Delivery of Mental Health Programs: A Systematic Review , 2013, Journal of medical Internet research.

[81]  Neville A. Stanton,et al.  Book preview , 2003, INTR.

[82]  Joyce Ho,et al.  Perceived barriers to psychological treatments and their relationship to depression. , 2010, Journal of clinical psychology.

[83]  C. Knaevelsrud,et al.  Internet-based interventions for posttraumatic stress: A meta-analysis of randomized controlled trials. , 2016, Clinical psychology review.

[84]  Ross C Brownson,et al.  A glossary for dissemination and implementation research in health. , 2008, Journal of public health management and practice : JPHMP.

[85]  Bonnie Spring,et al.  Practical behavioral trials to advance evidence-based behavioral medicine , 2006, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[86]  Randolph G. Bias,et al.  Research Methods for Human-Computer Interaction , 2010, J. Assoc. Inf. Sci. Technol..

[87]  Alicia C. Bunger,et al.  Outcomes for Implementation Research: Conceptual Distinctions, Measurement Challenges, and Research Agenda , 2010, Administration and Policy in Mental Health and Mental Health Services Research.

[88]  Sonja K Schoenwald,et al.  The ARC Organizational and Community Intervention Strategy for Implementing Evidence-Based Children's Mental Health Treatments , 2005, Mental health services research.

[89]  B. Cuthbert,et al.  Reenvisioning Clinical Science , 2014, Clinical psychological science : a journal of the Association for Psychological Science.