Using Concept Mapping to Develop a Logic Model and Articulate a Program Theory: A Case Example

Using a case example of one of the mental health agencies in Florida, we demonstrate the utility of concept mapping for developing a program logic model and articulating a program theory for program assessment. The results of the concept mapping procedure enabled identification of 100 program services as described in statements by staff. Moreover, results revealed four major categories of those services and the main strategies used. This information was used to develop the first three components of a logic model. Concept maps were also used to reveal underlying assumptions built into the agency’s theoretical approach.

[1]  W. Trochim,et al.  Development of a model of the tobacco industry’s interference with tobacco control programmes , 2003, Tobacco control.

[2]  Marina A. Adler,et al.  The utility of modeling in evaluation planning: the case of the coordination of domestic violence services in Maryland , 2002 .

[3]  Yvonne A. Unrau.  Using client exit interviews to illuminate outcomes in program logic models: a case example , 2001 .

[4]  A. Pumariega.  Culturally competent outcome evaluation in systems of care for children's mental health , 1996 .

[5]  P. Meadowcroft,et al.  Multiagency outcome evaluation of children's services: A case study , 1998, The Journal of Behavioral Health Services & Research.

[6]  F. Leeuw,et al.  Reconstructing Program Theories: Methods Available and Problems to be Solved , 2003 .

[7]  Mark W. Lipsey,et al.  Evaluation: A Systematic Approach , 1979 .

[8]  Jeanne B. Stinchcomb.  Using Logic Modeling to Focus Evaluation Efforts , 2001 .

[9]  L. Bickman,et al.  EVALUATION PLANNING FOR AN INNOVATIVE CHILDREN'S MENTAL HEALTH SYSTEM , 1992 .

[10]  Mario Hernandez,et al.  The ecology of outcomes: System accountability in children's mental health , 1998, The Journal of Behavioral Health Services & Research.

[11]  Huey-tsyh Chen.  Theory-driven evaluations , 1990 .

[12]  Carolyn S. Breda,et al.  Common Patterns of Service Use in Children's Mental Health. , 1998 .

[13]  D. Northrup,et al.  Evaluating mental health services : how do programs for children "work" in the real world? , 1997 .

[14]  P. S. Vivekananthan,et al.  A multidimensional approach to the structure of personality impressions. , 1968, Journal of personality and social psychology.

[15]  Deborah Bybee,et al.  Fidelity Criteria: Development, Measurement, and Validation , 2003 .

[16]  David A. Julian,et al.  The utilization of the logic model as a system level planning and evaluation device , 1997 .

[17]  Ann Jones,et al.  Open systems evaluation and the logic model: Program planning and evaluation tools , 1995 .

[18]  William M. K. Trochim,et al.  An introduction to concept mapping for planning and evaluation. , 1989 .

[19]  K. Myers,et al.  Developing Outcome Strategies in Children's Mental Health. , 2003 .

[20]  W. Trochim.  Concept mapping: Soft science or hard art? , 1989 .

[21]  William M. K. Trochim,et al.  The use of concept mapping for assessing fidelity of model transfer: An example from psychiatric rehabilitation , 1995 .

[22]  S. P. Hodges,et al.  How organizational culture influences outcome information utilization. , 1999, Evaluation and program planning.

[23]  Mario Hernandez,et al.  Using Logic Models and Program Theory To Build Outcome Accountability. , 2000 .

[24]  Peter H. Rossi,et al.  Evaluating With Sense , 1983 .

[25]  Jeffrey A. Johnsen,et al.  Concept mapping in mental health: uses and adaptations , 2000 .

[26]  C. Weiss.  How Can Theory-Based Evaluation Make Greater Headway? , 1997 .

[27]  S. Savas,et al.  Program specification: A precursor to program monitoring and quality improvement. A case study from Boysville of Michigan , 1998, The Journal of Behavioral Health Services & Research.

[28]  John A. McLaughlin,et al.  Logic models: a tool for telling your programs performance story , 1999 .

[29]  J. H. Ward.  Hierarchical Grouping to Optimize an Objective Function , 1963 .

[30]  J. Chang,et al.  Analysis of individual differences in multidimensional scaling via an n-way generalization of “Eckart-Young” decomposition , 1970 .

[31]  Francis G. Hare.  Applications of Multidimensional Similarity Scaling (MDS) in evaluation research , 1999 .

[32]  Mark W. Lipsey,et al.  Driving toward theory in program evaluation: More models to choose from , 1989 .