Consequences to Federal Programs When the Logic-Modeling Process Is Not Followed With Fidelity

The Office of Management and Budget has recommended the termination of numerous federal programs, citing a lack of program results as the primary reason for this decision. In response to this recommendation, several federal agencies have turned to logic modeling to demonstrate that programs are on the path to results accountability. However, approaches to logic modeling in some agencies have not followed the strategies that evaluators recommend as necessary to lead to a high quality logic model. Models of poor quality are unlikely to contribute to improved program accountability or better program results. In this article, the author assesses the quality of the logic-modeling approach taken by one agency to illustrate how a flawed approach to logic modeling may lead to incorrect conclusions about programs and about the benefits of logic models. As a result of this analysis, the author questions the conditions under which capacity building should be considered and whether the field of evaluation needs to be more judicious when mainstreaming methodologies.

[1]  Ulysses S. Grant,et al.  State of the Union Address , 2003 .

[2]  Nina Roberts Measuring Program Outcomes: A Practical Approach , 1998 .

[3]  D. Pathman,et al.  Interim Evaluation of the Rural Health Scholars Program , 2001, Teaching and learning in medicine.

[4]  S. Azer,et al.  Rural training and the state of rural health services: effect of rural background on the perception and attitude of first-year medical students at the university of melbourne. , 2001, The Australian journal of rural health.

[5]  Annie Millar,et al.  Logic models: a systems tool for performance management , 2001 .

[6]  John A. McLaughlin,et al.  Logic models: a tool for telling your programs performance story , 1999 .

[7]  J. Veloski,et al.  Debt and primary care physicians' career satisfaction. , 1998, Academic medicine : journal of the Association of American Medical Colleges.

[8]  Ralph Renger,et al.  Strategies for Values Inquiry: An Exploratory Case Study , 2004 .

[9]  M. Kreuter,et al.  Applications workbook to accompany health promotion planning : an educational and ecological approach , 1999 .

[10]  Deborah M. Fournier,et al.  "The Program Evaluation Standards": How to Assess Evaluations of Educational Programs, 2nd Edition [Book Review]. , 1994 .

[11]  William M. K. Trochim,et al.  An introduction to concept mapping for planning and evaluation. , 1989 .

[12]  John A. Gale Ms,et al.  Creating Progam Logic Models: A Toolkit for State Flex Programs , 2006 .

[13]  Jason R. Goertzen,et al.  CREATING LOGIC MODELS USING GROUNDED THEORY: A CASE EXAMPLE DEMONSTRATING A UNIQUE APPROACH TO LOGIC MODEL DEVELOPMENT , 2003 .

[14]  Ralph Renger,et al.  From theory to practice: Lessons learned in the application of the ATM approach to developing logic models , 2006 .

[15]  Gopal K. Kanji,et al.  Performance measurement system , 2002 .

[16]  Steven Orla Kimbrough,et al.  Logic Modeling , 1997, HICSS.

[17]  C. Weiss How Can Theory-Based Evaluation Make Greater Headway? , 1997 .

[18]  James R. Sanders,et al.  The program evaluation standards : how to assess evaluations of educational programs , 1994 .

[19]  Molly den Heyer,et al.  The Temporal Logic Model Concept , 2002, Canadian Journal of Program Evaluation.

[20]  Melvin M. Mark,et al.  Evaluation: An Integrated Framework for Understanding, Guiding, and Improving Policies and Programs , 2000 .

[21]  W. Clinton State of the Union Address , 2003 .

[22]  農林水産奨励会農林水産政策情報センター ロジックモデル策定ガイド = Logic model development guide , 2003 .

[23]  Ralph Renger,et al.  A Three-Step Approach to Teaching Logic Models , 2002 .

[24]  Huey-Tsyh Chen,et al.  The conceptual framework of the theory-driven perspective , 1989 .