Evaluating immediate and long-term impacts of qualitative group model building workshops on participants' mental models

Group model building literature reports that participation causes mental model refinement and alignment, but no previous study appears to have examined whether these changes are enduring. This paper reports on a case study involving four groups using group model building tools that were evaluated immediately before, immediately after, and 12 months following a 3-hour workshop. Each workshop used qualitative group model building to plan strategy implementation initiatives in a government department. A change of circumstances (merger and restructure) meant that the workshop conclusions were not implemented, providing a research opportunity to measure the enduring effects of group model building workshops. Statistical comparison of written responses suggests that participants' views on the workshop topic changed and became more alike through the workshop process, and that these changes were enduring even in the relative absence of reinforcing activities.

[1]  D. Andersen,et al.  Using Visual Representations as Boundary Objects to Resolve Conflict in Collaborative Model-Building Approaches , 2012 .

[2]  Steven A. Cavaleri,et al.  Towards evaluation of systems‐thinking interventions: a case study , 1997 .

[3]  Jac A. M. Vennix,et al.  System dynamics and organizational interventions , 2006 .

[4]  T. T. Faw,et al.  The influence of stimulus exposure on rated preference: effects of age, pattern of exposure, and stimulus meaningfulness. , 1971, Journal of experimental child psychology.

[5]  George P. Richardson,et al.  Group model building: adding more science to the craft , 1997 .

[6]  Jac A. M. Vennix,et al.  Group model‐building to facilitate organizational change: an exploratory study , 1996 .

[7]  L. Alberto Franco,et al.  Forms of conversation and problem structuring methods: a conceptual development , 2006, J. Oper. Res. Soc..

[8]  Anne T. McCartt,et al.  Managerial Openness to Change and the Introduction of GDSS: Explaining Initial Success and Failure in Decision Conferencing , 1995 .

[9]  Marilyn E. Gist,et al.  EFFECTS OF SELF‐EFFICACY AND POST‐TRAINING INTERVENTION ON THE ACQUISITION AND MAINTENANCE OF COMPLEX INTERPERSONAL SKILLS , 2006 .

[10]  Colin Eden,et al.  On evaluating the performance of 'wide-band' GDSS's , 1995 .

[11]  George P. Richardson,et al.  Group Model-Building 'Scripts' as a Collaborative Planning Tool , 2012 .

[12]  James K. Doyle.  The cognitive psychology of systems thinking , 1997 .

[13]  M. Stephens.  EDF Statistics for Goodness of Fit and Some Comparisons , 1974 .

[14]  Andreas Größler,et al.  System dynamics modelling for strategy implementation—case study and issues , 2006 .

[15]  Aldo A. Zagonel,et al.  Using Group Model Building to Inform Public Policy Making and Implementation , 2008 .

[16]  Chris Rust.  The impact of educational development workshops on teachers’ practice , 1998 .

[17]  David N. Ford,et al.  Mental models concepts for system dynamics research , 1998 .

[18]  Jac A. M. Vennix,et al.  Modeling as persuasion: The impact of group model building on attitudes and behavior , 2010 .

[19]  Daniel Kahneman,et al.  Availability: A heuristic for judging frequency and probability , 1973 .

[20]  Debra L. O'Connor,et al.  Measuring Sharedness of Team-Related Knowledge: Design and Validation of a Shared Mental Model Instrument , 2007 .

[21]  L. Alberto Franco,et al.  Decision development in facilitated modelling workshops , 2011, Eur. J. Oper. Res..

[22]  George P. Richardson,et al.  Teamwork in group model building , 1995 .

[23]  Jac A. M. Vennix,et al.  Group model building effectiveness: a review of assessment studies † , 2002 .

[24]  G. Alliger,et al.  KIRKPATRICK'S LEVELS OF TRAINING CRITERIA: THIRTY YEARS LATER , 1989 .

[25]  K. Maani,et al.  Links between systems thinking and complex decision making , 2004 .

[26]  George P. Richardson,et al.  A framework for evaluating systems thinking interventions: an experimental approach to mental health system change , 1997 .

[27]  Jac A. M. Vennix,et al.  On Evaluating the Performance of Problem Structuring Methods: An Attempt at Formulating a Conceptual Model , 2009 .

[28]  Hyunjung Kim,et al.  In search of a mental model‐like concept for group‐level modeling , 2009 .