User-Centered Design for Psychosocial Intervention Development and Implementation.

The current paper articulates how common difficulties encountered when attempting to implement or scale-up evidence-based treatments are exacerbated by fundamental design problems, which may be addressed by a set of principles and methods drawn from the contemporary field of user-centered design. User-centered design is an approach to product development that grounds the process in information collected about the individuals and settings where products will ultimately be used. To demonstrate the utility of this perspective, we present four design concepts and methods: (a) clear identification of end users and their needs, (b) prototyping/rapid iteration, (c) simplifying existing intervention parameters/procedures, and (d) exploiting natural constraints. We conclude with a brief design-focused research agenda for the developers and implementers of evidence-based treatments.

[1]  P. Kendall,et al.  Training Therapists in Evidence-Based Practice: A Critical Review of Studies From a Systems-Contextual Perspective. , 2010, Clinical psychology : a publication of the Division of Clinical Psychology of the American Psychological Association.

[2]  Jonathan Grudin,et al.  Personas, Participatory Design and Product Development: An Infrastructure for Engagement , 2002 .

[3]  Aaron R. Lyon,et al.  Developing the Mental Health Workforce: Review and Application of Training Approaches from Multiple Disciplines , 2011, Administration and Policy in Mental Health and Mental Health Services Research.

[4]  Leslie J. Briggs,et al.  Principles of Instructional Design , 1974 .

[5]  Bruce F Chorpita,et al.  Structuring the Collaboration of Science and Service in Pursuit of a Shared Vision , 2014, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[6]  Naihua Duan,et al.  Integrating Science and Engineering to Implement Evidence-Based Practices in Health Care Settings , 2015, Administration and Policy in Mental Health and Mental Health Services Research.

[7]  Alan E. Kazdin,et al.  Novel Models for Delivering Mental Health Services and Reducing the Burdens of Mental Illness , 2013 .

[8]  Ann F Garland,et al.  Identifying common elements of evidence-based psychosocial treatments for children's disruptive behavior problems. , 2008, Journal of the American Academy of Child and Adolescent Psychiatry.

[9]  Dallas Swendeman,et al.  Disruptive innovations for designing and diffusing evidence-based interventions. , 2012, The American psychologist.

[10]  M. Andersson,et al.  Barriers in implementation of evidence-based practice: Supported employment in Swedish context. , 2011, Journal of health organization and management.

[11]  A. Simons,et al.  A Pilot Study Disseminating Cognitive Behavioral Therapy for Depression: Therapist Factors and Perceptions of Barriers to Implementation , 2011, Administration and Policy in Mental Health and Mental Health Services Research.

[12]  Martin C. Maguire,et al.  Methods to support human-centred design , 2001, Int. J. Hum. Comput. Stud..

[13]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[14]  Brad J. Nakamura,et al.  Knowledge of and Attitudes Towards Evidence-Based Practices in Community Child Mental Health Practitioners , 2011, Administration and Policy in Mental Health and Mental Health Services Research.

[15]  Jakob Nielsen,et al.  Prioritizing Web Usability , 2006 .

[16]  M. Quirk,et al.  The Role of Lean Process Improvement in Implementation of Evidence-Based Practices in Behavioral Health Care , 2015, The Journal of Behavioral Health Services & Research.

[17]  Danielle L. Fettes,et al.  Collaboration, Negotiation, and Coalescence for Interagency-Collaborative Teams to Scale-Up Evidence-Based Practice , 2014, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[18]  M. Sanders,et al.  Surviving or Thriving: Quality Assurance Mechanisms to Promote Innovation in the Development of Evidence-Based Parenting Interventions , 2014, Prevention Science.

[19]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[20]  Bryce D. McLeod,et al.  Development and Dissemination of Child and Adolescent Psychotherapies: Milestones, Methods, and a New Deployment-Focused Model. , 2005 .

[21]  Marjo Kauppinen,et al.  Identifying and selecting users for user-centered design , 2004, NordiCHI '04.

[22]  M. Eccles,et al.  Welcome to Implementation Science , 2006, Implementation Science.

[23]  B. Marx.  The Visual Display of Quantitative Information , 1985 .

[24]  G. Glover,et al.  Improving access to psychological therapies: a review of the progress made by sites in the first roll-out year , 2010 .

[25]  Michael J. Lambert,et al.  Is It Time for Clinicians to Routinely Track Patient Outcome? A Meta‐Analysis , 2006 .

[26]  Eric L. Daleiden,et al.  Driving with Roadmaps and Dashboards: Using Information Resources to Structure the Decision Models in Service Organizations , 2008, Administration and Policy in Mental Health and Mental Health Services Research.

[27]  W. Agras,et al.  An experimental analysis of the effectiveness of "shaping" in reducing maladaptive avoidance behavior: an analoguestudy. , 1970, Behaviour research and therapy.

[28]  Catherine Courage,et al.  Understanding Your Users: A Practical Guide to User Requirements Methods, Tools, and Techniques , 2005 .

[29]  A. Spirito,et al.  Perceptions of ‘Evidence-Based Practice’ among the consumers of adolescent substance use treatment , 2016, Health education journal.

[30]  R. Ascherl,et al.  Rapid Prototyping , 1997, IEEE Robotics & Automation Magazine.

[31]  B. Chorpita,et al.  Dissemination and Implementation of Evidence Based Treatments for Youth: Challenges and Recommendations , 2012 .

[32]  M. Broscio.  When is it time? , 1990, Healthcare executive.

[33]  Lindsey M. Knowles,et al.  Emergent life events and their impact on service delivery: Should we expect the unexpected? , 2014 .

[34]  T. Marteau,et al.  nicotine dependence: an analogue study The impact of learning of a genetic predisposition to , 2005 .

[35]  John P. A. Ioannidis,et al.  Methodological standards and patient-centeredness in comparative effectiveness research: the PCORI perspective. , 2012, JAMA.

[36]  R. Peters,et al.  Challenges in implementing evidence-based treatment practices for co-occurring disorders in the criminal justice system. , 2004, Behavioral sciences & the law.

[37]  J. Kimberly,et al.  The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research , 2012, Implementation Science.

[38]  Erik L. Olson,et al.  Implementing the lead user method in a high technology firm: A longitudinal study of intentions versus actions , 2001 .

[39]  B. Chorpita,et al.  From data to wisdom: quality improvement strategies supporting large-scale implementation of evidence-based services. , 2005, Child and adolescent psychiatric clinics of North America.

[40]  Julie M. Skutch,et al.  Shifting Paradigms in Clinical Psychology: How Innovative Technologies Are Shaping Treatment Delivery , 2010 .

[41]  K. Weingardt.  The Role of Instructional Design and Technology in the Dissemination of Empirically Supported, Manual-Based Therapies , 2006 .

[42]  Leonard Bickman,et al.  The Technology of Measurement Feedback Systems. , 2012, Couple & family psychology.

[43]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[44]  Alan Cooper,et al.  The Inmates Are Running the Asylum: Why High Tech Products Drive Us Crazy and How to Restore the Sanity (2nd Edition) , 1999 .

[45]  S. Thomaes,et al.  Bringing parenting interventions back to the future: How randomized microtrials may benefit parenting intervention efficacy , 2015 .

[46]  J. Wyatt,et al.  Evaluating computerised health information systems: hard lessons still to be learnt , 2003, BMJ : British Medical Journal.

[47]  C. Sherbourne,et al.  Delivery of evidence-based treatment for multiple anxiety disorders in primary care: a randomized controlled trial. , 2010, JAMA.

[48]  D. Norman,et al.  User Centered System Design: New Perspectives on Human-Computer Interaction , 1988 .

[49]  L. Schilling,et al.  Systematic Review of Health Information Exchange in Primary Care Practices , 2010, The Journal of the American Board of Family Medicine.

[50]  K. Koerner,et al.  What must you know and do to get good outcomes with DBT? , 2013, Behavior therapy.

[51]  L. G. Zomerdijk,et al.  Service Design for Experience-Centric Services , 2010 .

[52]  Manuel Riemer,et al.  Effects of routine feedback to clinicians on mental health outcomes of youths: results of a randomized trial. , 2011, Psychiatric services.

[53]  Gilbert Cockton,et al.  People and Computers XIV — Usability or Else! , 2000, Springer London.

[54]  Donald A. Norman,et al.  User Centered System Design: New Perspectives on Human-Computer Interaction , 1988 .

[55]  Bruce F Chorpita,et al.  Identifying and Selecting the Common Elements of Evidence Based Interventions: A Distillation and Matching Model , 2005, Mental health services research.

[56]  W. Pelham,et al.  Effects of Deviant Child Behavior on Parental Distress and Alcohol Consumption in Laboratory Interactions , 1997, Journal of abnormal child psychology.

[57]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[58]  M. Holmqvist,et al.  Web- vs. telehealth-based delivery of cognitive behavioral therapy for insomnia: a randomized controlled trial. , 2014, Sleep medicine.

[59]  Rachel Haine-Schlagel,et al.  Searching for Elements of Evidence-Based Practices in Children's Usual Care and Examining Their Impact , 2014, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[60]  Alicia C. Bunger,et al.  Outcomes for Implementation Research: Conceptual Distinctions, Measurement Challenges, and Research Agenda , 2010, Administration and Policy in Mental Health and Mental Health Services Research.

[61]  M. Crowe,et al.  Training of Therapists , 2008 .

[62]  B. Rounsaville,et al.  A Stage Model of Behavioral Therapies Research: Getting Started and Moving on From Stage I , 2006 .

[63]  John C. Wright,et al.  Researching clients' experiences: A review of qualitative studies , 2007 .

[64]  Gavin Yamey,et al.  Scaling Up Global Health Interventions: A Proposed Framework for Success , 2011, PLoS medicine.

[65]  Donald M. Baer,et al.  A Component Analysis , 1977 .

[66]  Robert D Gibbons,et al.  Testing standard and modular designs for psychotherapy treating depression, anxiety, and conduct problems in youth: a randomized effectiveness trial. , 2012, Archives of general psychiatry.

[67]  Kelli Scott,et al.  Using Measurement-Based Care to Enhance Any Treatment. , 2015, Cognitive and behavioral practice.

[68]  Eric von Hippel,et al.  New Product Ideas from ‘Lead Users’ , 1989 .

[69]  Thomas S. Tullis,et al.  A Comparison of Questionnaires for Assessing Website Usability , 2004 .

[70]  B. Larsson,et al.  Consumer satisfaction with the Child and Adolescent Mental Health Service and its association with treatment outcome: A 3–4-year follow-up study , 2015, Nordic journal of psychiatry.

[71]  A. Whaley,et al.  Cultural competence and evidence-based practice in mental health services: a complementary perspective. , 2007, The American psychologist.

[72]  Francis Creed,et al.  Cognitive behaviour therapy-based intervention by community health workers for mothers with depression and their infants in rural Pakistan: a cluster-randomised controlled trial , 2008, The Lancet.

[73]  G. Aarons,et al.  Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors , 2010, Administration and Policy in Mental Health and Mental Health Services Research.

[74]  J. Weisz,et al.  Provider attitudes toward evidence-based practices: are the concerns with the evidence or with the manuals? , 2009, Psychiatric services.

[75]  J. Lowery,et al.  Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science , 2009, Implementation science : IS.

[76]  Jeremy Roschelle,et al.  Designing Formative Assessment Software with Teachers: an Analysis of the Co-Design Process , 2007, Res. Pract. Technol. Enhanc. Learn..

[77]  Dennis D. Embry,et al.  Evidence-based Kernels: Fundamental Units of Behavioral Influence , 2008, Clinical child and family psychology review.

[78]  Christopher R. Thomas,et al.  Child and Adolescent Therapy: Cognitive-Behavioral Procedures , 2001 .

[79]  B. Karsh.  Beyond usability: designing effective technology implementation systems to promote patient safety , 2004, Quality and Safety in Health Care.

[80]  Clayton M. Christensen,et al.  Disruptive innovation in health care delivery: a framework for business-model innovation. , 2008, Health affairs.

[81]  Alan E Kazdin,et al.  Evidence-based treatment and practice: new opportunities to bridge clinical research and practice, enhance the knowledge base, and improve patient care. , 2008, The American psychologist.

[82]  Shekhar Saxena,et al.  Human resources for mental health care: current situation and strategies for action , 2011, The Lancet.

[83]  M. Addis,et al.  Barriers to dissemination of evidence-based practices: Addressing practitioners' concerns about manual-based psychotherapies. , 2006 .

[84]  David A. Chambers,et al.  The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change , 2013, Implementation Science.

[85]  Aaron R. Lyon,et al.  The Contextualized Technology Adaptation Process (CTAP): Optimizing Health Information Technology to Improve Mental Health Systems , 2016, Administration and Policy in Mental Health and Mental Health Services Research.

[86]  Aaron R. Lyon,et al.  Taking evidence-based practices to school: using expert opinion to develop a brief, evidence-informed school-based mental health intervention , 2014 .

[87]  Alan Cooper,et al.  About Face 3: the essentials of interaction design , 1995 .

[88]  L. Palinkas,et al.  Dynamic adaptation process to implement an evidence-based child maltreatment intervention , 2012, Implementation Science.

[89]  J. Weisz,et al.  Evidence-based youth psychotherapies versus usual clinical care: a meta-analysis of direct comparisons. , 2006, The American psychologist.

[90]  T H Ollendick,et al.  Empirically supported psychological interventions: controversies and evidence. , 2001, Annual review of psychology.

[91]  B. Thorn,et al.  Evidence-based practice in psychology. , 2006, The American psychologist.

[92]  Victor Kaptelinin,et al.  Affordances and Design , 2014 .

[93]  D. Kaysen,et al.  Psychological Trauma: Theory, Research, Practice, and Policy Adaptation of Cognitive Processing Therapy for Treatment of Torture Victims: Experience in Kurdistan, Iraq , 2011 .

[94]  E. Balas,et al.  Managing Clinical Knowledge for Health Care Improvement , 2000, Yearbook of Medical Informatics.

[95]  C. Baird,et al.  The pilot study. , 2000, Orthopedic nursing.

[96]  A. Rahman,et al.  Challenges and opportunities in developing a psychological intervention for perinatal depression in rural Pakistan – a multi-method study , 2007, Archives of Women's Mental Health.

[97]  Jonathan Boote,et al.  Public involvement at the design stage of primary health research: a narrative review of case examples. , 2010, Health policy.

[98]  J. Weisz,et al.  Performance of evidence-based youth psychotherapies compared with usual clinical care: a multilevel meta-analysis. , 2013, JAMA psychiatry.

[99]  K. Krishnan.  Evidence-based mental health. , 2002, Psychopharmacology bulletin.

[100]  E. Proctor,et al.  Writing implementation research grant proposals: ten key ingredients , 2012, Implementation Science.

[101]  Aaron R. Lyon,et al.  A case for modular design: Implications for implementing evidence-based interventions with culturally-diverse youth. , 2014, Professional psychology, research and practice.

[102]  L. Hill,et al.  Component analysis of adherence in a family intervention. , 2013, Health education.

[103]  Apa Presidential Task Force on Evidence-Based Practice.  Evidence-based practice in psychology. , 2006 .

[104]  Karen Holtzblatt,et al.  Rapid Contextual Design: A How-To Guide to Key Techniques for User-Centered Design , 2004, UBIQ.

[105]  K. Koerner,et al.  Training Research: Practical Recommendations for Maximum Impact , 2011, Administration and Policy in Mental Health and Mental Health Services Research.

[106]  K. Kelleher,et al.  Building Bridges to Evidence-based Practice: The MacArthur Foundation Child System and Treatment Enhancement Projects (Child STEPs) , 2008, Administration and Policy in Mental Health and Mental Health Services Research.

[107]  Aaron R. Lyon,et al.  The Brief Intervention for School Clinicians (BRISC): A Mixed-Methods Evaluation of Feasibility, Acceptability, and Contextual Appropriateness , 2015, School Mental Health.

[108]  L. A. Valle,et al.  Parent-child interaction therapy with physically abusive parents: efficacy for reducing future abuse reports. , 2004, Journal of consulting and clinical psychology.

[109]  James Wilson,et al.  Rapid Prototyping for User Interface Design , 1988 .

[110]  Foutse Khomh,et al.  Do faster releases improve software quality? An empirical case study of Mozilla Firefox , 2012, 2012 9th IEEE Working Conference on Mining Software Repositories (MSR).

[111]  Bryan J Weiner,et al.  The Society for Implementation Research Collaboration Instrument Review Project: A methodology to promote rigorous evaluation , 2015, Implementation Science.

[112]  Bill Moggridge,et al.  Designing interactions , 2006 .

[113]  Joseph P. McFall,et al.  The efficacy of evidence-based psychotherapies versus usual care for youths: Controlling confounds in a meta-reanalysis , 2010, Psychotherapy research : journal of the Society for Psychotherapy Research.

[114]  Shannon Wiltsey Stirman,et al.  Development of a framework and coding system for modifications and adaptations of evidence-based interventions , 2013, Implementation Science.

[115]  Audra K. Langley,et al.  Evidence-Based Mental Health Programs in Schools: Barriers and Facilitators of Successful Implementation , 2010, School mental health.

[116]  P. Kirschner,et al.  Taking the Load Off a Learner's Mind: Instructional Design for Complex Learning , 2003 .

[117]  David H. Barlow,et al.  Toward a Unified Treatment for Emotional Disorders , 2004, The Neurotic Paradox.

[118]  Andrew Dillon,et al.  User analysis in HCI - the historical lessons from individual differences research , 1996, Int. J. Hum. Comput. Stud..

[119]  S. Beach,et al.  Microtrial Methods for Translating Gene-environment Dynamics into Preventive Interventions , 2010, Prevention Science.

[120]  M. Addis,et al.  A national survey of practicing psychologists' attitudes toward psychotherapy treatment manuals. , 2000, Journal of consulting and clinical psychology.

[121]  Martti Mäntylä,et al.  How Effective Are User Studies? , 2000, BCS HCI.

[122]  Christina Martin,et al.  Cultural competence. , 2008, Kentucky nurse.

[123]  Karen A. Blase,et al.  Implementation Research: A Synthesis of the , 2005 .

[124]  A. Jensen-Doss,et al.  Who's using treatment manuals? A national survey of practicing therapists. , 2013, Behaviour research and therapy.

[125]  John M. Keller,et al.  Principles of instructional design, 5th edition , 2005 .

[126]  V. Patel,et al.  The future of psychiatry in low- and middle-income countries , 2009, Psychological Medicine.

[127]  Robert Johnston,et al.  The service concept: the missing link in service design research? , 2002 .

[128]  J. Kirchner,et al.  A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project , 2015, Implementation Science.

[129]  James M. Bieman,et al.  Rapid Prototyping: Lessons Learned , 1995, IEEE Softw..

[130]  Cathleen Willging,et al.  Interagency Collaborative Team Model for Capacity Building to Scale-Up Evidence-Based Practice. , 2014, Children and youth services review.

[131]  S. Hollon,et al.  Does Publication Bias Inflate the Apparent Efficacy of Psychological Treatment for Major Depressive Disorder? A Systematic Review and Meta-Analysis of US National Institutes of Health-Funded Trials , 2015, PloS one.

[132]  John R. Weisz,et al.  Modularity in the design and application of therapeutic interventions , 2005 .

[133]  C. Lucas,et al.  Comparing the Validity of Clinician-Generated Diagnosis of Conduct Disorder to the Diagnostic Interview Schedule for Children , 2004, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[134]  David H Barlow,et al.  The dissemination and implementation of evidence-based psychological treatments. A review of current efforts. , 2010, The American psychologist.

[135]  J. De,et al.  Will disruptive innovations cure health care , 2000 .

[136]  Karl L. Smart,et al.  The effect of documentation on customer perception of product quality , 1996 .

[137]  Aaron R. Lyon,et al.  Using Modular Psychotherapy in School Mental Health: Provider Perspectives on Intervention-Setting Fit , 2014, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[138]  Richard Layard,et al.  Improving access to psychological therapy: Initial evaluation of two UK demonstration sites , 2009, Behaviour research and therapy.

[139]  Wendi Cross,et al.  Show Me, Don't Tell Me: Behavioral Rehearsal as a Training and Analogue Fidelity Tool. , 2014, Cognitive and behavioral practice.

[140]  B. Chorpita,et al.  Empirically guided coordination of multiple evidence-based treatments: an illustration of relevance mapping in children's mental health services. , 2011, Journal of consulting and clinical psychology.

[141]  W. Pelham,et al.  The Summer Treatment Program Meets the South Side of Chicago: Bridging Science and Service in Urban After-School Programs. , 2012, Child and adolescent mental health.