Psychosocial Interventions for Mental and Substance Use Disorders: A Framework for Establishing Evidence-Based Standards

Mental health and substance use disorders affect approximately 20 percent of Americans and are associated with significant morbidity and mortality. Although a wide range of evidence-based psychosocial interventions are currently in use, most consumers of mental health care find it difficult to know whether they are receiving high-quality care. Although the current evidence base for the effects of psychosocial interventions is sizable, subsequent steps in the process of bringing a psychosocial intervention into routine clinical care are less well defined. Psychosocial Interventions for Mental and Substance Use Disorders details the reasons for the gap between what is known to be effective and current practice and offers recommendations for how best to address this gap by applying a framework that can be used to establish standards for psychosocial interventions. The framework described in Psychosocial Interventions for Mental and Substance Use Disorders can be used to chart a path toward the ultimate goal of improving the outcomes. The framework highlights the need to (1) support research to strengthen the evidence base on the efficacy and effectiveness of psychosocial interventions; (2) based on this evidence, identify the key elements that drive an intervention's effect; (3) conduct systematic reviews to inform clinical guidelines that incorporate these key elements; (4) using the findings of these systematic reviews, develop quality measures - measures of the structure, process, and outcomes of interventions; and (5) establish methods for successfully implementing and sustaining these interventions in regular practice including the training of providers of these interventions. The recommendations offered in this report are intended to assist policy makers, health care organizations, and payers that are organizing and overseeing the provision of care for mental health and substance use disorders while navigating a new health care landscape. The recommendations also target providers, professional societies, funding agencies, consumers, and researchers, all of whom have a stake in ensuring that evidence-based, high-quality care is provided to individuals receiving mental health and substance use services.

[1]  J. Elliott Psychosocial Interventions for Mental and Substance Use Disorders: A Framework for Establishing Evidence-Based Standards, by Institute of Medicine (IOM) , 2016 .

[2]  A. Butler,et al.  COMMITTEE ON DEVELOPING EVIDENCE-BASED STANDARDS FOR PSYCHOSOCIAL INTERVENTIONS FOR MENTAL DISORDERS , 2015 .

[3]  R. Layard,et al.  Thrive: How Better Mental Health Care Transforms Lives and Saves Money , 2015 .

[4]  C. Berridge,et al.  An Integrated Model of Co-ordinated Community-Based Care. , 2015, The Gerontologist.

[5]  Richard J. Goscha,et al.  Exploring the Experiences of Client Involvement in Medication Decisions Using a Shared Decision Making Model: Results of a Qualitative Study , 2015, Community Mental Health Journal.

[6]  John Toussaint,et al.  Innovation and Best Practices in Health Care Scheduling , 2015 .

[7]  Behavioral Domains,et al.  Capturing Social and Behavioral Domains and Measures in Electronic Health Records: Phase 2 , 2015 .

[8]  Kimberly S. Canter,et al.  Professional Psychology: Research and Practice , 2015 .

[9]  Bethany R. Lee,et al.  The Common Elements of Engagement in Children's Mental Health Services: Which Elements for Which Outcomes? , 2015, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[10]  B. Wampold,et al.  Expanding the lens of evidence-based practice in psychotherapy: a common factors perspective. , 2014, Psychotherapy.

[11]  M. Crawford,et al.  Service user involvement: impact and participation: a survey of service user and staff perspectives , 2014, BMC Health Services Research.

[12]  Bradley E. Karlin,et al.  Enhancing access, fidelity, and outcomes in the national dissemination of evidence-based psychotherapies. , 2014, The American psychologist.

[13]  Sepheen C. Byron,et al.  Developing measures for pediatric quality: methods and experiences of the CHIPRA pediatric quality measures program grantees. , 2014, Academic pediatrics.

[14]  Bethany R. Lee,et al.  Identifying the Common Elements of Treatment Engagement Interventions in Children’s Mental Health Services , 2014, Clinical child and family psychology review.

[15]  David Cella,et al.  Patient-Reported Outcomes Measurement Information System (PROMIS): efficient, standardized tools to measure self-reported health and quality of life. , 2014, Nursing outlook.

[16]  A. Zaslavsky,et al.  Examining the Role of Patient Experience Surveys in Measuring Health Care Quality , 2014, Medical care research and review : MCRR.

[17]  M. Ashworth,et al.  User-generated quality standards for youth mental health in primary care: a participatory research design using mixed methods , 2014, BMJ quality & safety.

[18]  S. Teich,et al.  A critical appraisal of the systematic review process: systematic reviews of zirconia single crowns. , 2014, The Journal of prosthetic dentistry.

[19]  Hans Förstl,et al.  Efficacy of pharmacotherapy and psychotherapy for adult psychiatric disorders: a systematic overview of meta-analyses. , 2014, JAMA psychiatry.

[20]  B. D'avanzo,et al.  Involvement of Users and Relatives in Mental Health Service Evaluation , 2014, The Journal of nervous and mental disease.

[21]  S. Scholle,et al.  Strategies for Measuring the Quality of Psychotherapy: A White Paper to Inform Measure Development and Implementation , 2014 .

[22]  A. Kazdin Evidence-based psychotherapies I: qualifiers and limitations in what we know , 2014 .

[23]  Brian Shiner,et al.  Implementation of evidence-based psychotherapies for posttraumatic stress disorder in VA specialty clinics. , 2014, Psychiatric services.

[24]  Quality. National Healthcare Disparities Report , 2014 .

[25]  John Landsverk,et al.  The Cost of Implementing New Strategies (COINS): A Method for Mapping Implementation Resources Using the Stages of Implementation Completion. , 2014, Children and youth services review.

[26]  M. Salzer,et al.  Advancing recovery science: reliability and validity properties of the Recovery Assessment Scale. , 2014, Psychiatric services.

[27]  S. Hollon,et al.  Development of clinical practice guidelines. , 2014, Annual review of clinical psychology.

[28]  Enola K Proctor,et al.  A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions , 2014, Research on social work practice.

[29]  H. Pincus,et al.  Acceptance of insurance by psychiatrists and the implications for access to mental health care. , 2014, JAMA psychiatry.

[30]  Wendi Cross,et al.  Show Me, Don't Tell Me: Behavioral Rehearsal as a Training and Analogue Fidelity Tool. , 2014, Cognitive and behavioral practice.

[31]  Michelle P. Salyers,et al.  Illness management and recovery: a review of the literature. , 2014, Psychiatric services.

[32]  Panel on Measuring Subjective Well-Being in aPolicy-Rele Framework,et al.  Subjective Well-Being: Measuring Happiness, Suffering, and Other Dimensions of Experience , 2014 .

[33]  R. Taylor,et al.  Impact of the National Institute for Health and Care Excellence (NICE) guidance on medical technology uptake: analysis of the uptake of spinal cord stimulation in England 2008–2012 , 2014, BMJ Open.

[34]  R. Kessler,et al.  Comorbidity of common mental disorders with cancer and their treatment gap: findings from the World Mental Health Surveys , 2014, Psycho-oncology.

[35]  B. Druss,et al.  State parity laws and access to treatment for substance use disorder in the United States: implications for federal parity legislation. , 2013, JAMA psychiatry.

[36]  T. Vos,et al.  Global burden of disease attributable to mental and substance use disorders: findings from the Global Burden of Disease Study 2010 , 2013, The Lancet.

[37]  L. Palinkas,et al.  Continued use of evidence-based treatments after a randomized controlled effectiveness trial: a qualitative study. , 2013, Psychiatric services.

[38]  N. Volkow,et al.  Physician education in addiction medicine. , 2013, JAMA.

[39]  David A. Chambers,et al.  The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change , 2013, Implementation Science.

[40]  Winston R. Liaw,et al.  Clinical and community delivery systems for preventive care: an integration framework. , 2013, American journal of preventive medicine.

[41]  W. Hiller,et al.  Drop-out and treatment outcome of outpatient cognitive-behavioral therapy for anorexia nervosa and bulimia nervosa. , 2013, Comprehensive psychiatry.

[42]  E. Mayo-Wilson,et al.  Protocol for CONSORT-SPI: an extension for social and psychological interventions , 2013, Implementation Science.

[43]  N. Petry,et al.  Nationwide dissemination of contingency management: the Veterans Administration initiative. , 2013, The American journal on addictions.

[44]  Hua Xu,et al.  A hybrid system for temporal information extraction from clinical text , 2013, J. Am. Medical Informatics Assoc..

[45]  Pat Turnbull,et al.  Service user involvement: inspiring student nurses to make a difference to patient care. , 2013, Nurse education in practice.

[46]  C. Taylor,et al.  Training in and implementation of Acceptance and Commitment Therapy for depression in the Veterans Health Administration: therapist and patient outcomes. , 2013, Behaviour research and therapy.

[47]  J. Deluca,et al.  Recovery in Severe Mental Illnesses: A Literature Review of Recovery Measures , 2013 .

[48]  Brad J. Nakamura,et al.  Long-term outcomes for the Child STEPs randomized effectiveness trial: a comparison of modular and standard treatment designs with usual care. , 2013, Journal of consulting and clinical psychology.

[49]  Ross C Brownson,et al.  Designing for dissemination among public health researchers: findings from a national survey in the United States. , 2013, American journal of public health.

[50]  K. Hawley,et al.  Mental health clinicians' motivation to invest in training: results from a practice-based research network survey. , 2013, Psychiatric services.

[51]  D. Polsky,et al.  The effect of pay-for-performance in nursing homes: evidence from state Medicaid programs. , 2013, Health services research.

[52]  C. B. Taylor,et al.  Effectiveness of acceptance and commitment therapy for depression: Comparison among older and younger veterans , 2013, Aging & mental health.

[53]  Genevieve M. Kenney,et al.  Health status, risk factors, and medical conditions among persons enrolled in Medicaid vs uninsured low-income adults potentially eligible for Medicaid under the Affordable Care Act. , 2013, JAMA.

[54]  M. Otto,et al.  Patient preference for psychological vs pharmacologic treatment of psychiatric disorders: a meta-analytic review. , 2013, The Journal of clinical psychiatry.

[55]  G. Andersson,et al.  The efficacy of psychotherapy and pharmacotherapy in treating depressive and anxiety disorders: a meta‐analysis of direct comparisons , 2013, World psychiatry : official journal of the World Psychiatric Association.

[56]  S. Scott,et al.  Development of a checklist to assess the quality of reporting of knowledge translation interventions using the Workgroup for Intervention Development and Evaluation Research (WIDER) recommendations , 2013, Implementation Science.

[57]  Jason E. Chapman,et al.  Comparison of youth, caregiver, therapist, trained, and treatment expert raters of therapist adherence to a substance abuse treatment protocol. , 2013, Journal of consulting and clinical psychology.

[58]  Peter Jüni,et al.  Comparative Efficacy of Seven Psychotherapeutic Interventions for Patients with Depression: A Network Meta-Analysis , 2013, PLoS medicine.

[59]  C. B. Taylor,et al.  National dissemination of cognitive behavioral therapy for insomnia in veterans: therapist- and patient-level outcomes. , 2013, Journal of consulting and clinical psychology.

[60]  W. Godolphin,et al.  Patients as educators: Interprofessional learning for patient-centred care , 2013, Medical teacher.

[61]  J. Troup,et al.  Nasty or Nice? Findings from a UK Survey to evaluate the impact of the National Institute for Health and Clinical Excellence (NICE) clinical guidelines on the management of prostate cancer. , 2013, Clinical oncology (Royal College of Radiologists (Great Britain)).

[62]  Siddhartha Jonnalagadda,et al.  A new iterative method to reduce workload in systematic review process , 2013, Int. J. Comput. Biol. Drug Des..

[63]  J. Hibbard,et al.  What the evidence shows about patient activation: better health outcomes and care experiences; fewer data on costs. , 2013, Health affairs.

[64]  C. Fisher,et al.  Developing mental health-care quality indicators: toward a common framework. , 2013, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[65]  Louise Deléger,et al.  A sequence labeling approach to link medications and their attributes in clinical notes and clinical trial announcements for information extraction , 2012, J. Am. Medical Informatics Assoc..

[66]  W. Hiller,et al.  What Predicts Outcome, Response, and Drop-out in CBT of Depressive Adults? A Naturalistic Study , 2012, Behavioural and Cognitive Psychotherapy.

[67]  Ellen Meara,et al.  Spending differences associated with the Medicare Physician Group Practice Demonstration. , 2012, JAMA.

[68]  Junichi Tsujii,et al.  Feature engineering combined with machine learning and rule-based methods for structured information extraction from narrative clinical discharge summaries , 2012, J. Am. Medical Informatics Assoc..

[69]  D. Sudak,et al.  Trends in Psychotherapy Training: A National Survey of Psychiatry Residency Training , 2012, Academic Psychiatry.

[70]  J. Weiner,et al.  Risk adjustment in health insurance exchanges for individuals with mental illness. , 2012, The American journal of psychiatry.

[71]  Jane M. Young,et al.  Audit and feedback: effects on professional practice and healthcare outcomes. , 2012, The Cochrane database of systematic reviews.

[72]  J. Grimshaw,et al.  Knowledge translation of research findings , 2012, Implementation Science.

[73]  R. Raghavan The role of economic evaluation in dissemination and implementation research , 2012 .

[74]  Jennifer L. Bellamy,et al.  Considering the Multiple Service Contexts in Cultural Adaptations of Evidence-Based Practice , 2012 .

[75]  J. Fairbank,et al.  Use of the Breakthrough Series Collaborative to Support Broad and Sustained Use of Evidence-Based Trauma Treatment for Children in Community Practice Settings , 2012, Administration and Policy in Mental Health and Mental Health Services Research.

[76]  J. Fortney,et al.  Implementation outcomes of evidence-based quality improvement for depression in VA community based outpatient clinics , 2012, Implementation Science.

[77]  A. Qaseem,et al.  Guidelines International Network: Toward International Standards for Clinical Practice Guidelines , 2012, Annals of Internal Medicine.

[78]  G. Aarons,et al.  Leadership, innovation climate, and attitudes toward evidence-based practice during a statewide implementation. , 2012, Journal of the American Academy of Child and Adolescent Psychiatry.

[79]  Enola K. Proctor,et al.  A Compilation of Strategies for Implementing Clinical Innovations in Health and Mental Health , 2012, Medical care research and review : MCRR.

[80]  B. Mittman,et al.  Effectiveness-implementation Hybrid Designs: Combining Elements of Clinical Effectiveness and Implementation Research to Enhance Public Health Impact , 2012, Medical care.

[81]  Russell E Glasgow,et al.  Patient-reported measures of psychosocial issues and health behavior should be added to electronic health records. , 2012, Health affairs.

[82]  A. Dembe,et al.  The Use of a “Mystery Shopper” Methodology to Evaluate Children’s Access to Psychiatric Services , 2012, The Journal of Behavioral Health Services & Research.

[83]  M. Harrow,et al.  Do all schizophrenia patients need antipsychotic treatment continuously throughout their lifetime? A 20-year longitudinal study , 2012, Psychological Medicine.

[84]  H. Lyneham,et al.  A Model of Therapist Competencies for the Empirically Supported Interpersonal Psychotherapy for Adolescent Depression , 2012, Clinical child and family psychology review.

[85]  Shin-Ping Tu,et al.  Systems Antecedents for Dissemination and Implementation , 2012, Health education & behavior : the official publication of the Society for Public Health Education.

[86]  D. Mechanic Seizing opportunities under the Affordable Care Act for transforming the mental and behavioral health system. , 2012, Health affairs.

[87]  D. Veltman,et al.  Differences between effects of psychological versus pharmacological treatments on functional and morphological brain alterations in anxiety disorders and major depressive disorder: A systematic review , 2012, Neuroscience & Biobehavioral Reviews.

[88]  B. Chorpita,et al.  Adherence Measurement in Treatments for Disruptive Behavior Disorders: Pursuing Clear Vision through Varied Lenses. , 2011, Clinical psychology : a publication of the Division of Clinical Psychology of the American Psychological Association.

[89]  M. Menear,et al.  Knowledge translation in mental health: a scoping review. , 2011, Healthcare policy = Politiques de sante.

[90]  J. Braithwaite,et al.  How and why are communities of practice established in the healthcare sector? A systematic review of the literature , 2011, BMC health services research.

[91]  Sergey Goryachev,et al.  Automated concept-level information extraction to reduce the need for custom software and rules development , 2011, J. Am. Medical Informatics Assoc..

[92]  Min Li,et al.  A knowledge discovery and reuse pipeline for information extraction in clinical notes , 2011, J. Am. Medical Informatics Assoc..

[93]  H. Korda,et al.  Value-based purchasing: the evidence. , 2011, The American journal of managed care.

[94]  D. Clark,et al.  Implementing NICE guidelines for the psychological treatment of depression and anxiety disorders: The IAPT experience , 2011, International review of psychiatry.

[95]  G. Andersson,et al.  Interpersonal psychotherapy for depression: a meta-analysis. , 2011, The American journal of psychiatry.

[96]  Andrew Georgiou,et al.  A realist evaluation of the role of communities of practice in changing healthcare practice , 2011, Implementation science : IS.

[97]  Joel D. Martin,et al.  Machine-learned solutions for three stages of clinical information extraction: the state of the art at i2b2 2010 , 2011, J. Am. Medical Informatics Assoc..

[98]  G. Wilensky ACO regs, round 1. , 2011, Healthcare financial management : journal of the Healthcare Financial Management Association.

[99]  Jerry L. Grenard,et al.  Depression and Medication Adherence in the Treatment of Chronic Diseases in the United States: A Meta-Analysis , 2011, Journal of General Internal Medicine.

[100]  J. Lave,et al.  The impact of national health care reform on adults with severe mental disorders. , 2011, The American journal of psychiatry.

[101]  W. Thomson Lifting the shroud on depression and premature mortality: a 49-year follow-up study. , 2011, Journal of affective disorders.

[102]  R. Rapee,et al.  A Model of Therapist Competencies for the Empirically Supported Cognitive Behavioral Treatment of Child and Adolescent Anxiety and Depressive Disorders , 2011, Clinical child and family psychology review.

[103]  S. Green-Hennessy,et al.  A review of mental health interventions in SAMHSA's National Registry of Evidence-Based Programs and Practices. , 2011, Psychiatric services.

[104]  Harold Alan Pincus,et al.  Measurement-based care in psychiatric practice: a policy framework for implementation. , 2011, The Journal of clinical psychiatry.

[105]  J. M. Kahn Book Review: Knowledge Translation in Health Care: Moving From Evidence to Practice. Sharon Straus MD FRCPC MSc, Jacqueline Tetroe MA, Ian D Graham PhD, editors. West Sussex: Wiley-Blackwell. 2009. Soft cover, 336 pages, $62.95. , 2010 .

[106]  M. Olfson,et al.  National trends in the treatment for depression from 1998 to 2007. , 2010, Archives of general psychiatry.

[107]  Robert B. Penfold,et al.  Health care use and decision making among lower-income families in high-deductible health plans. , 2010, Archives of internal medicine.

[108]  M. Rosenthal,et al.  Assessing the evidence for value-based insurance design. , 2010, Health affairs.

[109]  T. Mark,et al.  The effects of antidepressant step therapy protocols on pharmaceutical and medical utilization and expenditures. , 2010, The American journal of psychiatry.

[110]  Harold Alan Pincus,et al.  Challenges and Opportunities in Measuring the Quality of Mental Health Care , 2010, Canadian journal of psychiatry. Revue canadienne de psychiatrie.

[111]  N. Dreyer,et al.  Registries for Evaluating Patient Outcomes: A User’s Guide , 2010 .

[112]  Anthony L. Hemmelgarn,et al.  Randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy. , 2010, Journal of consulting and clinical psychology.

[113]  Stan Matwin,et al.  A new algorithm for reducing the workload of experts in performing systematic reviews , 2010, J. Am. Medical Informatics Assoc..

[114]  F. Mcmanus,et al.  Establishing evidence-based training in cognitive behavioral therapy: A review of current empirical findings and theoretical guidance. , 2010, Clinical psychology review.

[115]  R. Heinssen,et al.  Research domain criteria (RDoC): toward a new classification framework for research on mental disorders. , 2010, The American journal of psychiatry.

[116]  D. Kolko,et al.  The role of therapist training in the implementation of psychosocial treatments: a review and critique with recommendations. , 2010, Clinical psychology review.

[117]  M. Kunik,et al.  Can paraprofessionals deliver cognitive-behavioral therapy to treat anxiety and depressive symptoms? , 2010, Bulletin of the Menninger Clinic.

[118]  P. Kendall,et al.  Training Therapists in Evidence-Based Practice: A Critical Review of Studies From a Systems-Contextual Perspective. , 2010, Clinical psychology : a publication of the Division of Clinical Psychology of the American Psychological Association.

[119]  P. Schnurr,et al.  Do all psychological treatments really work the same in posttraumatic stress disorder? , 2010, Clinical psychology review.

[120]  Jill G. Grant Embracing an Emerging Structure in Community Mental Health Services , 2010 .

[121]  Gerhard Andersson,et al.  Efficacy of cognitive–behavioural therapy and other psychological treatments for adult depression: meta-analytic study of publication bias , 2010, British Journal of Psychiatry.

[122]  G. Greenwood,et al.  Development of a Clinician Report Measure to Assess Psychotherapy for Depression in Usual Care Settings , 2010, Administration and Policy in Mental Health and Mental Health Services Research.

[123]  J. Shedler The efficacy of psychodynamic psychotherapy. , 2010, The American psychologist.

[124]  Gerhard Andersson,et al.  Psychotherapy for chronic major depression and dysthymia: a meta-analysis. , 2010, Clinical psychology review.

[125]  I. Janszky,et al.  Supported local implementation of clinical guidelines in psychiatry: a two-year follow-up , 2010, Implementation science : IS.

[126]  Jill Thistlethwaite,et al.  Active patient involvement in the education of health professionals , 2010, Medical education.

[127]  Christine Y. Lu,et al.  Unintended Impacts of a Medicaid Prior Authorization Policy on Access to Medications for Bipolar Illness , 2010, Medical care.

[128]  J. Lochman,et al.  Implementation of a school-based prevention program: Effects of counselor and school characteristics. , 2009 .

[129]  G. Greenwood,et al.  Development of a Patient-Report Measure of Psychotherapy for Depression , 2009, Administration and Policy in Mental Health and Mental Health Services Research.

[130]  D. Wiersma,et al.  A systematic review of the international published literature relating to quality of institutional care for people with longer term mental health problems , 2009, BMC psychiatry.

[131]  A. Mitchell,et al.  Clinical diagnosis of depression in primary care: a meta-analysis , 2009, The Lancet.

[132]  J. Guevara,et al.  Nonpharmacological intervention for agitation in dementia: A systematic review and meta-analysis , 2009, Aging & mental health.

[133]  D. Berwick What 'patient-centered' should mean: confessions of an extremist. , 2009, Health affairs.

[134]  B. Chorpita,et al.  Mapping evidence-based treatments for children and adolescents: application of the distillation and matching model to 615 treatments from 322 randomized trials. , 2009, Journal of consulting and clinical psychology.

[135]  Christine Y. Lu,et al.  Prior authorization for antidepressants in Medicaid: effects among disabled dual enrollees. , 2009, Archives of internal medicine.

[136]  Kathleen J. Mullen,et al.  Can You Get What You Pay For? Pay-for-Performance and the Quality of Healthcare Providers , 2009, The Rand journal of economics.

[137]  Y. Zhang,et al.  Effects of prior authorization on medication discontinuation among Medicaid beneficiaries with bipolar disorder. , 2009, Psychiatric services.

[138]  C. Clancy,et al.  Transformation of health care at the front line. , 2009, JAMA.

[139]  G. McHugo,et al.  Assertive community treatment: facilitators and barriers to implementation in routine mental health settings. , 2009, Psychiatric services.

[140]  R. Carter,et al.  Long-Term Youth Criminal Outcomes in MST Transport: The Impact of Therapist Adherence and Organizational Climate and Structure , 2009, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[141]  G. Sullivan Complacent care and the quality gap. , 2008, Psychiatric services.

[142]  M. Jordans,et al.  School-based mental health intervention for children affected by political violence in Indonesia: a cluster randomized trial. , 2008, JAMA.

[143]  Richard R. Cline,et al.  Retrospective assessment of Medicaid step-therapy prior authorization policy for atypical antipsychotic medications. , 2008, Clinical therapeutics.

[144]  H. Pincus,et al.  Depression and Diabetes: A Potentially Lethal Combination , 2008, Journal of General Internal Medicine.

[145]  M. Slade,et al.  Recovery: an international perspective , 2008, Epidemiologia e Psichiatria Sociale.

[146]  S. Soumerai,et al.  Effect of prior authorization of second-generation antipsychotic agents on pharmacy utilization and reimbursements. , 2008, Psychiatric services.

[147]  M. Matthieu,et al.  Evaluation of Gatekeeper Training for Suicide Prevention in Veterans , 2008, Archives of suicide research : official journal of the International Academy for Suicide Research.

[148]  S. Pilling,et al.  Using an Evidence-Based Methodology to Identify the Competences Required to Deliver Effective Cognitive and Behavioural Therapy for Depression and Anxiety Disorders , 2008, Behavioural and Cognitive Psychotherapy.

[149]  Amy N. Cohen,et al.  EQUIP: Implementing chronic care principles and applying formative evaluation methods to improve care for schizophrenia: QUERI Series , 2008, Implementation science : IS.

[150]  J. Inman,et al.  Randomized trial of a gatekeeper program for suicide prevention: 1-year impact on secondary school staff. , 2008, Journal of consulting and clinical psychology.

[151]  P. Shekelle,et al.  Systematic Review: The Evidence That Publishing Patient Care Performance Data Improves Quality of Care , 2008, Annals of Internal Medicine.

[152]  C. Horgan,et al.  Are Washington Circle performance measures associated with decreased criminal activity following treatment? , 2007, Journal of substance abuse treatment.

[153]  M. Matthieu,et al.  Proximate outcomes of gatekeeper training for suicide prevention in the workplace. , 2007, Suicide & life-threatening behavior.

[154]  Sarah E. Bledsoe,et al.  Empirically Supported Psychotherapy in Social Work Training Programs: Does the Definition of Evidence Matter? , 2007 .

[155]  Kimberley R. Isett,et al.  The state policy context of implementation issues for evidence-based practices in mental health. , 2007, Psychiatric services.

[156]  C. Saldaña,et al.  The efficacy of cognitive-behavioral therapy and the problem of drop-out. , 2007, Journal of clinical psychology.

[157]  D. Miklowitz,et al.  Family-focused treatment for bipolar disorder in adults and youth. , 2007, Journal of clinical psychology.

[158]  Bruce F Chorpita,et al.  Understanding the common elements of evidence-based practice: misconceptions and clinical examples. , 2007, Journal of the American Academy of Child and Adolescent Psychiatry.

[159]  R. Hermann,et al.  Risk-adjusting outcomes of mental health and substance-related care: a review of the literature. , 2007, Harvard review of psychiatry.

[160]  Jane M. Young,et al.  Does telling people what they have been doing change what they do? A systematic review of the effects of audit and feedback , 2006, Quality and Safety in Health Care.

[161]  Z. Austin,et al.  Peer-mentoring workshop for continuous professional development. , 2006, American journal of pharmaceutical education.

[162]  Lloyd I. Sederer,et al.  Improving Mental Health Care: A Guide to Measurement-Based Quality Improvement , 2006 .

[163]  Laura Mufson,et al.  National survey of psychotherapy training in psychiatry, psychology, and social work. , 2006, Archives of general psychiatry.

[164]  T. Mills,et al.  Measuring Health: A Guide to Rating Scales and Questionnaires , 2006 .

[165]  B. Chorpita,et al.  Getting better at getting them better: health outcomes and evidence-based practice within a system of care. , 2006, Journal of the American Academy of Child and Adolescent Psychiatry.

[166]  S. Pilling,et al.  Developing and implementing clinical guidelines: lessons from the NICE Schizophrenia Guideline , 2006, Epidemiologia e Psichiatria Sociale.

[167]  B. Löwe,et al.  A brief measure for assessing generalized anxiety disorder: the GAD-7. , 2006, Archives of internal medicine.

[168]  J. Jerrell,et al.  Psychometrics of the Recovery Process Inventory , 2006, The Journal of Behavioral Health Services & Research.

[169]  N. Petry,et al.  Contingency management for treatment of substance abuse. , 2006, Annual review of clinical psychology.

[170]  Craig W. Colton,et al.  Congruencies in Increased Mortality Rates, Years of Potential Life Lost, and Causes of Death Among Public Mental Health Clients in Eight States , 2006, Preventing chronic disease.

[171]  Sonja K Schoenwald,et al.  The ARC Organizational and Community Intervention Strategy for Implementing Evidence-Based Children's Mental Health Treatments , 2005, Mental health services research.

[172]  E. Fineout-Overholt,et al.  Teaching EBP: getting to the gold: how to search for the best evidence. , 2005, Worldviews on evidence-based nursing.

[173]  E. Hing,et al.  National Ambulatory Medical Care Survey: 2003 Summary , 2005 .

[174]  K. Carroll,et al.  Behavioral therapies for drug abuse. , 2005, The American journal of psychiatry.

[175]  Michael R. Kauth,et al.  Supporting clinicians in the development of best practice innovations in education. , 2005, Psychiatric services.

[176]  R. Kessler,et al.  Twelve-month use of mental health services in the United States: results from the National Comorbidity Survey Replication. , 2005, Archives of general psychiatry.

[177]  Bruce F Chorpita,et al.  Identifying and Selecting the Common Elements of Evidence Based Interventions: A Distillation and Matching Model , 2005, Mental health services research.

[178]  T. Louis,et al.  Assessing the implementation of the chronic care model in quality improvement collaboratives. , 2005, Health services research.

[179]  Wayne Katon,et al.  Relationship of depression and diabetes self-care, medication adherence, and preventive care. , 2004, Diabetes care.

[180]  M. Prince,et al.  The impact of NICE guidelines on the diagnosis and treatment of Alzheimer's disease among general medical hospital inpatients , 2004, International journal of geriatric psychiatry.

[181]  E. Cox,et al.  Plan-sponsor savings and member experience with point-of-service prescription step therapy. , 2004, The American journal of managed care.

[182]  J. Bryce,et al.  Evidence-based public health: moving beyond randomized trials. , 2004, American journal of public health.

[183]  Leonard Bickman,et al.  Psychometric properties of the Vanderbilt ADHD diagnostic parent rating scale in a referred population. , 2003, Journal of pediatric psychology.

[184]  P. Basch Quality of health care delivered to adults in the United States. , 2003, The New England journal of medicine.

[185]  D. Stryer,et al.  Practical clinical trials: increasing the value of clinical research for decision making in clinical and health policy. , 2003, JAMA.

[186]  Michelle P. Salyers,et al.  Is it ACT yet? real-world examples of evaluating the degree of implementation for assertive community treatment , 2003, The Journal of Behavioral Health Services & Research.

[187]  M. Addis,et al.  Implicit and Untested Assumptions About the Role of Psychotherapy Treatment Manuals in Evidence‐ Based Mental Health Practice , 2002 .

[188]  M. Dulcan,et al.  Psychiatric disorders in youth in juvenile detention. , 2002, Archives of general psychiatry.

[189]  A. House,et al.  Involving users in the delivery and evaluation of mental health services: systematic review , 2002, BMJ : British Medical Journal.

[190]  H. Kraemer,et al.  Mediators and moderators of treatment effects in randomized clinical trials. , 2002, Archives of general psychiatry.

[191]  D. Linhorst,et al.  Involving People with Severe Mental Illness in Evaluation and Performance Improvement , 2002, Evaluation & the health professions.

[192]  M. Bauer A review of quantitative studies of adherence to mental health clinical practice guidelines. , 2002, Harvard review of psychiatry.

[193]  S. Schoenwald,et al.  Effectiveness, transportability, and dissemination of interventions: what matters when? , 2001, Psychiatric services.

[194]  Robert A. Greenes,et al.  Methods of Cognitive Analysis to Support the Design and Evaluation of Biomedical Systems: The Case of Clinical Practice Guidelines , 2001, J. Biomed. Informatics.

[195]  John E. Ware,et al.  SF-36 Health Survey Update , 2000, Spine.

[196]  K. Boydell,et al.  Effects of client interviewers on client-reported satisfaction with mental health services. , 1999, Psychiatric services.

[197]  P. Corrigan,et al.  Recovery as a Psychological Construct , 1999, Community Mental Health Journal.

[198]  P. Greenbaum,et al.  Prevalence of DSM-IV substance abuse and dependence disorders among prison inmates. , 1998, The American journal of drug and alcohol abuse.

[199]  E. McGlynn,et al.  Choosing and evaluating clinical performance measures. , 1998, The Joint Commission journal on quality improvement.

[200]  Diane M. Strong,et al.  Data quality in context , 1997, CACM.

[201]  L. Mynors-Wallis,et al.  Problem-Solving Treatment: Evidence for Effectiveness and Feasibility in Primary Care , 1996, International journal of psychiatry in medicine.

[202]  I. Wilson,et al.  Linking clinical variables with health-related quality of life. A conceptual model of patient outcomes. , 1995, JAMA.

[203]  T. Rice,et al.  Patient Cost Sharing for Medical Services: A Review of the Literature and Implications for Health Care Reform , 1994, Medical care review.

[204]  M. Hillman,et al.  Youth participation , 1994, Promotion & education.

[205]  B. Williams Patient satisfaction: a valid concept? , 1994, Social science & medicine.

[206]  B. Mondell The state of health care , 1993 .

[207]  P. Deegan Recovering our sense of value after being labeled mentally ill. , 1993, Journal of psychosocial nursing and mental health services.

[208]  J. Sorensen,et al.  The costs of depression , 1993, International clinical psychopharmacology.

[209]  K N Lohr,et al.  Medicare: A Strategy for Quality Assurance , 1991, Journal of quality assurance : a publication of the National Association of Quality Assurance Professionals.

[210]  A. Donabedian,et al.  The quality of care. How can it be assessed? , 1988, JAMA.

[211]  P. Deegan Recovery: The lived experience of rehabilitation. , 1988 .

[212]  J. Strauss,et al.  The Vermont longitudinal study of persons with severe mental illness, II: Long-term outcome of subjects who retrospectively met DSM-III criteria for schizophrenia. , 1987, The American journal of psychiatry.

[213]  E. Keeler,et al.  Health insurance and the demand for medical care: evidence from a randomized experiment. , 1987, The American economic review.

[214]  P. Hughes,et al.  National Health Service , 1986, The Lancet.

[215]  C. Horgan The demand for ambulatory mental health services from specialty providers. , 1986, Health services research.

[216]  C. Horgan Specialty and general ambulatory mental health services. Comparison of utilization and expenditures. , 1985, Archives of general psychiatry.

[217]  J. LoGerfo Explorations in Quality Assessment and Monitoring. Volume I: The Definitions of Quality and Approaches to its Assessment , 1981 .

[218]  G. Fillenbaum,et al.  The development, validity, and reliability of the OARS multidimensional functional assessment questionnaire. , 1981, Journal of gerontology.

[219]  L. Stein,et al.  Alternative to mental hospital treatment. I. Conceptual model, treatment program, and clinical evaluation. , 1980, Archives of general psychiatry.

[220]  S. Altshul,et al.  Alternatives to Mental Hospital Treatment , 1979 .

[221]  Q. Hill Appendix A , 1967, Intratextual Baudelaire.

[222]  José Maria Paganni,et al.  Evaluating the quality of medical care. , 1966, The Milbank Memorial Fund quarterly.

[223]  E. Rogers Diffusion of Innovations , 1964 .

[224]  G. Aarons,et al.  The role of organizational processes in dissemination and implementation research , 2017 .

[225]  Enjámin,et al.  PROSETTA STONE ANALYSIS REPORT A ROSETTA STONE FOR PATIENT REPORTED OUTCOMES , 2015 .

[226]  Anthony R. Pisani,et al.  Measuring trainer fidelity in the transfer of suicide prevention training. , 2014, Crisis.

[227]  Lucy Berliner,et al.  Clinician Use of Standardized Assessments Following a Common Elements Psychotherapy Training and Consultation Program , 2014, Administration and Policy in Mental Health and Mental Health Services Research.

[228]  Yinglin Xia,et al.  Observational Measures of Implementer Fidelity for a School-Based Preventive Intervention: Development, Reliability, and Validity , 2014, Prevention Science.

[229]  José M Arce,et al.  Designing a method to assess and improve the quality of healthcare in Nephrology by means of the Delphi technique. , 2014, Nefrologia : publicacion oficial de la Sociedad Espanola Nefrologia.

[230]  Bradley E. Karlin,et al.  From the laboratory to the therapy room: National dissemination and implementation of evidence-based psychotherapies in the U.S. Department of Veterans Affairs Health Care System. , 2014, The American psychologist.

[231]  S. Grant Development of a CONSORT extension for social and psychological interventions , 2014 .

[232]  A. Wu,et al.  Outcome Definition and Measurement , 2013 .

[233]  A. Mack Testing Standard and Modular Designs for Psychotherapy Treating Depression, Anxiety, and Conduct Problems in Youth: A Randomized Effectiveness Trial , 2013 .

[234]  K. Chard,et al.  Dissemination and experience with cognitive processing therapy. , 2012, Journal of rehabilitation research and development.

[235]  H. Pincus,et al.  Analysis & commentary: The case for measuring quality in mental health and substance abuse care. , 2011, Health affairs.

[236]  Clinical Excellence,et al.  Common mental health disorders : identification and pathways to care , 2011 .

[237]  Patricia E Deegan,et al.  A web application to support recovery and shared decision making in psychiatric medication clinics. , 2010, Psychiatric rehabilitation journal.

[238]  Jennifer A. Rolls Reutz,et al.  Design Elements in Implementation Research: A Structured Review of Child Welfare and Child Mental Health Studies , 2010, Administration and Policy in Mental Health and Mental Health Services Research.

[239]  Robert E Drake,et al.  The promise of shared decision making in mental health. , 2010, Psychiatric rehabilitation journal.

[240]  H. Pincus From PORT to policy to patient outcomes: crossing the quality chasm. , 2010, Schizophrenia bulletin.

[241]  F. Dickerson,et al.  The 2009 schizophrenia PORT psychosocial treatment recommendations and summary statements. , 2010, Schizophrenia bulletin.

[242]  D. Takanishi,et al.  The need for a standardized evaluation method to assess efficacy of cultural competence initiatives in medical education and residency programs. , 2009, Hawaii medical journal.

[243]  E. Proctor,et al.  Implementation Research in Mental Health Services , 2009 .

[244]  H. Guyatt GRADE: What is "Quality of Evidence" and Why is It Important to Clinicians? , 2009 .

[245]  J. Talbott Effect of Prior Authorization of Second-Generation Antipsychotic Agents on Pharmacy Utilization and Reimbursements , 2009 .

[246]  R. Beinecke,et al.  Commentary: Client Involvement in Public Administration Research and Evaluation , 2008 .

[247]  Greer Sullivan,et al.  Implementation Science BioMed Central Debate , 2008 .

[248]  David A. Chambers,et al.  Implementation Research in Mental Health Services: an Emerging Science with Conceptual, Methodological, and Training challenges , 2008, Administration and Policy in Mental Health and Mental Health Services Research.

[249]  Amy J. Schulz,et al.  Critical issues in developing and following community based participatory research principles , 2008 .

[250]  H. Fineberg Cancer care for the whole patient. , 2008, Medscape journal of medicine.

[251]  Jonathan Delman Consumer Driven and Conducted Survey Research in Action , 2007 .

[252]  A D Oxman,et al.  Audit and feedback: effects on professional practice and health care outcomes. , 2006, The Cochrane database of systematic reviews.

[253]  I. McDowell,et al.  Measuring health: A guide to rating scales and questionnaires, 3rd ed. , 2006 .

[254]  D. Linhorst,et al.  Promoting participation in organizational decision making by clients with severe mental illness. , 2005, Social work.

[255]  M. Dow,et al.  Manual for Using the Functional Assessment Rating Scale (FARS) , 2004 .

[256]  A. Young,et al.  An Instrument to Assess Competencies of Providers Treating Severe Mental Illness , 2003, Mental health services research.

[257]  Everett M. Rogers,et al.  Diffusion of innovations (5. ed.) , 2003 .

[258]  J. Pyne,et al.  The relationship between quality and outcomes in routine depression care. , 2001, Psychiatric services.

[259]  R. Spitzer,et al.  The PHQ-9: validity of a brief depression severity measure. , 2001, Journal of general internal medicine.

[260]  C. Sherbourne,et al.  The quality of care for depressive and anxiety disorders in the United States. , 2001, Archives of general psychiatry.

[261]  R. Drake,et al.  Psychosocial approaches to dual diagnosis. , 2000, Schizophrenia bulletin.

[262]  H. Huskamp Episodes of mental health and substance abuse treatment under a managed behavioral health care carve-out. , 1999, Inquiry : a journal of medical care organization, provision and financing.

[263]  J. Newhouse,et al.  Risk adjustment of mental health and substance abuse payments. , 1998, Inquiry : a journal of medical care organization, provision and financing.

[264]  Thomas D. Bixby Network Adequacy: The Regulation of HMO's Network of Health Care Providers , 1998 .

[265]  I. Hickie,et al.  Evaluating psychotherapy. , 1994, The Australian and New Zealand journal of psychiatry.

[266]  J. Newhouse Free for All?: Lessons from the RAND Health Insurance Experiment , 1993 .

[267]  R. Clements,et al.  Prevention of the complications of diabetes. , 1988, Primary care.

[268]  J. Strauss,et al.  The Vermont longitudinal study of persons with severe mental illness, I: Methodology, study sample, and overall status 32 years later. , 1987, The American journal of psychiatry.

[269]  C. E. Lewis Hospital accreditation. , 1984, New Zealand hospital.

[270]  J. Lebow,et al.  Research assessing consumer satisfaction with mental health treatment: a review of findings. , 1983, Evaluation and program planning.

[271]  M. Kovács Cognitive therapy in depression. , 1980, The Journal of the American Academy of Psychoanalysis.