A novel approach for evaluating programs designed to serve military veterans: Using an adapted common components analysis.

Evaluators are challenged to keep pace with the vast array of Veteran support programs operating in the United States, resulting in a situation in which many programs lack any evidence of impact. Due to this lack of evidence, there is no efficient way to suggest which programs are most effective in helping Veterans in need of support. One potential solution to this dilemma is to reconceptualize program evaluation, by moving away from evaluating programs individually to evaluating what is common across programs. The Common Components Analysis (CCA) is one such technique that aggregates findings from programs that have undergone rigorous evaluation at the level of program components (e.g., content, process, barrier reduction). Given that many Veteran programs lack outcome evidence from rigorous studies, an adaptation to CCA is needed. This report examines cross-sectional data from a pilot study using an adapted CCA across five domains of well-being (i.e., employment, education, legal/financial/housing, mental/physical health, and social/personal relationships). The purpose of this preliminary study is to determine the feasibility of eliciting program nominations and program components from Veterans via an online survey. When coupled with a longitudinal research design, this adaptation to CCA will allow for stronger causal claims about the expected impact of different program components within and across a variety of domains.

[1]  Bruce F Chorpita,et al.  Identifying and Selecting the Common Elements of Evidence Based Interventions: A Distillation and Matching Model , 2005, Mental health services research.

[2]  Lawrence Dyche,et al.  The effect of physician solicitation approaches on ability to identify patient concerns , 2005, Journal of General Internal Medicine.

[3]  Glenn Muske,et al.  The World Wide Web: A Training Tool for Family Resource Management Educators. , 2001 .

[4]  Jeffery M. Saul,et al.  On the effectiveness of active-engagement microcomputer-based laboratories , 1997 .

[5]  The State of the American Veteran: The Chicagoland Veterans Study , 2016 .

[6]  Janet Morahan-Martin,et al.  How Internet Users Find, Evaluate, and Use Online Health Information: A Cross-Cultural Review , 2004, Cyberpsychology Behav. Soc. Netw..

[7]  Jiang He,et al.  Mortality prediction with a single general self-rated health question , 2006, Journal of General Internal Medicine.

[8]  Megan E. Piper,et al.  Implementing Clinical Research Using Factorial Designs: A Primer. , 2017, Behavior therapy.

[9]  D. Perkins,et al.  The Veterans Metrics Initiative study of US veterans’ experiences during their transition from military service , 2018, BMJ Open.

[10]  Christian Köhler,et al.  How do consumers search for and appraise health information on the world wide web? Qualitative study using focus groups, usability tests, and in-depth interviews , 2002, BMJ : British Medical Journal.

[11]  Michael J. Prince,et al.  Does Active Learning Work? A Review of the Research , 2004 .

[12]  B. Chorpita,et al.  Mapping evidence-based treatments for children and adolescents: application of the distillation and matching model to 615 treatments from 322 randomized trials. , 2009, Journal of consulting and clinical psychology.

[13]  Stephanie T. Lanza,et al.  Drawing Causal Inferences Using Propensity Scores: A Practical Guide for Community Psychologists , 2013, American journal of community psychology.

[14]  Kimberly R. Aspinwall,et al.  2008 Department of Defense Survey of Health Related Behaviors Among Active Duty Military Personnel A Component of the Defense Lifestyle Assessment Program (DLAP) , 2008 .

[15]  S. Lowry,et al.  Employment for Veterans: Trends and Programs , 2012 .

[16]  Catherine Cerulli,et al.  Intimate partner violence victimization among women veterans and associated heart health risks. , 2011, Women's health issues : official publication of the Jacobs Institute of Women's Health.

[17]  Rinad S. Beidas,et al.  Methods to Improve the Selection and Tailoring of Implementation Strategies , 2017, The Journal of Behavioral Health Services & Research.

[18]  Nicole R Morgan,et al.  Common components analysis: An adapted approach for evaluating programs. , 2018, Evaluation and program planning.

[19]  Brooke C. Feeney,et al.  A New Look at Social Support , 2014, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[20]  Benjamin M Craig,et al.  Comparison of US Panel Vendors for Online Surveys , 2013, Journal of medical Internet research.

[21]  R. Rosenheck,et al.  Substance use comorbidity among veterans with posttraumatic stress disorder and other psychiatric illness. , 2011, The American journal on addictions.

[22]  Jennifer Wyatt Kaminski,et al.  A Meta-analytic Review of Components Associated with Parent Training Program Effectiveness , 2008, Journal of abnormal child psychology.

[23]  J. Jacoby Information Load and Decision Quality: Some Contested Issues , 1977 .

[24]  David M. Adamson,et al.  Common Factors in Effective HIV Prevention Programs , 2009, AIDS and Behavior.

[25]  R. Kobau,et al.  Health-related quality of life surveillance--United States, 1993-2002. , 2005, Morbidity and mortality weekly report. Surveillance summaries.

[26]  Nancy M. Aguilar-Roca,et al.  Learn before Lecture: A Strategy That Improves Learning Outcomes in a Large Introductory Biology Class , 2010, CBE life sciences education.

[27]  C. Ashton,et al.  Measurement in Veterans Affairs Health Services Research: veterans as a special population. , 2005, Health services research.

[28]  J. Jacoby Perspectives on Information Overload , 1984 .

[29]  F. Conrad,et al.  The Effects of Providing Examples in Survey Questions , 2014 .

[30]  A. M. Harrell,et al.  THE EFFECT OF INFORMATION LOAD ON DECISION MAKERS' CUE UTILIZATION LEVELS AND DECISION QUALITY IN... , 1990 .