A Dialogical, Story-Based Evaluation Tool: The Most Significant Change Technique

The Most Significant Change (MSC) technique is a dialogical, story-based technique. Its primary purpose is to facilitate program improvement by focusing the direction of work towards explicitly valued directions and away from less valued directions. MSC can also make a contribution to summative evaluation through both its process and its outputs. The technique involves a form of continuous values inquiry whereby designated groups of stakeholders search for significant program outcomes and then deliberate on the value of these outcomes in a systematic and transparent manner. To date, MSC has largely been used for the evaluation of international development programs, after having been initially developed for the evaluation of a social development program in Bangladesh (Davies, 1996). This article provides an introduction to MSC and discusses its potential to add to the basket of choices for evaluating programs in developed economies. We provide an Australian case study and outline some of the strengths and weaknesses of the technique. We conclude that MSC can make an important contribution to evaluation practice. Its unusual methodology and outcomes make it ideal for use in combination with other techniques and approaches.

[1]  Jessica Dart,et al.  Stories for change : a new model of evaluation for agricultural extension projects in Australia , 2000 .

[2]  David H. Gustafson,et al.  Group Techniques for Program Planning: A Guide to Nominal Group and Delphi Processes , 1976 .

[3]  A STORY APPROACH FOR MONITORING CHANGE IN AN AGRICULTURAL EXTENSION PROJECT A paper presented at the Conference of the Association for Qualitative Research Melbourne, July, 1999 , 2004 .

[4]  Cooper,et al.  Use of the critical incident technique to evaluate the impact of MEDLINE , 1989 .

[5]  Ernest R. House,et al.  Values in Evaluation and Social Research , 1999 .

[6]  Gary T. Henry,et al.  Choosing Criteria to Judge Program Success , 2002 .

[7]  M. Patton,et al.  Qualitative evaluation and research methods , 1992 .

[8]  Paul J. Viel,et al.  Up the Hierarchy , 1971 .

[9]  Barbara Andrews,et al.  Use of the critical incident technique in assessing student/tutor relationships at an open learning institution , 1989 .

[10]  Patricia J. Rogers,et al.  Teaching People to Fish? Building the Evaluation Capability of Public Sector Organizations , 2003 .

[11]  John Farrington,et al.  Development as Process: Concepts and Methods for Working With Complexity , 1998 .

[12]  Tom Carney.  Fourth Generation Evaluation , 1991 .

[13]  S. Winter,et al.  An Evolutionary Theory of Economic Change.by Richard R. Nelson; Sidney G. Winter , 1987 .

[14]  Rick Davies.  An evolutionary approach to facilitating organisational learning: an experiment by the Christian Commission for Development in Bangladesh , 1998 .

[15]  D. Boje.  The storytelling organization: A study of story performance in an office-supply firm. , 1991 .

[16]  Melvin M. Mark,et al.  Toward an Integrative Framework for Evaluation Practice , 1999 .

[17]  Lynn Westbrook,et al.  Utilization-focused evaluation , 1998 .

[18]  Reflections on the Use of Narrative in Evaluation , 2003 .