Relevance assumed: a case study of balanced scorecard development using system dynamics

The balanced scorecard (BSC) has become a popular concept for performance measurement. It focuses attention of management on only a few performance measures and bridges different functional areas as it includes both financial and non-financial measures. However, doubts frequently arise regarding the quality of the BSCs developed as well as the quality of the process in which this development takes place. This article describes a case study in which system dynamics (SD) modelling and simulation was used to overcome both kinds of problems. In a two-stage modelling process (qualitative causal loop diagramming followed by quantitative simulation), a BSC was developed for management of one organizational unit of a leading Dutch insurer. This research illustrates how, through their involvement in this development process, management came to understand that seemingly contradictory goals such as customer satisfaction, employee satisfaction and employee productivity were, in fact, better seen as mutually reinforcing. Also, analysis of the SD model showed how, contrary to ex ante management intuition, performance would first have to drop further before significant improvements could be realized. Finally, the quantitative modelling process also helped to evaluate several improvement initiatives that were under consideration at the time, proving some of them to have unclear benefits, others to be very promising indeed.

[1]  Michael Pidd,et al.  Tools for thinking , 1996 .

[2]  Vlatko Čerić,et al.  Rational Analysis for a Problematic World: Problem Structuring Methods for Complexity, Uncertainty and Conflict , 1991 .

[3]  Ann Taket,et al.  Creative Problem Solving: Total Systems Intervention. , 1991 .

[4]  P. Hepworth,et al.  Weighing it up ‐ a literature review for the balanced scorecard , 1998 .

[5]  Andy Neely,et al.  Performance measurement system design , 1995 .

[6]  de M Marco Haas,et al.  Strategic dialogue : in search of goal coherence , 2000 .

[7]  David P. Norton,et al.  Leading Change with the Balanced Scorecard , 2001 .

[8]  Robert M. Davison,et al.  The balanced scorecard: a foundation for the strategic management of information systems , 1999, Decis. Support Syst..

[9]  Hanne Nørreklit.  The Balance on the Balanced Scorecard: A Critical Analysis of Some of Its Assumptions , 2000 .

[10]  Henk Akkermans,et al.  Renga: A systems approach to facilitating inter-organizational network development , 2001 .

[11]  Fran Ackermann,et al.  The role of feedback dynamics in disruption and delay on the nature of disruption and delay (D&D) in major projects , 2000, J. Oper. Res. Soc..

[12]  Thomas H. Johnson,et al.  Relevance Lost: The Rise and Fall of Management Accounting , 1987 .

[13]  R. Kaplan,et al.  Strategy Maps: Converting Intangible Assets into Tangible Outcomes , 2003 .

[14]  Jack P. C. Kleijnen,et al.  Performance metrics in supply chain management , 2003, J. Oper. Res. Soc..

[15]  J. Mingers,et al.  Rational analysis for a problematic world revisited : problem structuring methods for complexity, uncertainty and conflict , 1989 .

[16]  Karel Cool,et al.  Asset stock accumulation and sustainability of competitive advantage , 1989 .

[17]  P. Senge.  The fifth discipline : the art and practice of the learning organization/ Peter M. Senge , 1991 .

[18]  Valerie Belton,et al.  Adding value to performance measurement by using system dynamics and multicriteria analysis , 2002 .

[19]  Robert S. Kaplan,et al.  Having Trouble with Your Strategy ? , 2005 .

[20]  Edward Lumsdaine,et al.  Creative problem solving , 1995 .

[21]  David C. Lane,et al.  Modelling as learning: A consultancy methodology for enhancing learning in management teams , 1992 .

[22]  Elaine Palmer,et al.  Management by objectives and the Balanced Scorecard: will Rome fall again? , 1998 .

[23]  Colin Eden,et al.  Cognitive mapping and problem structuring for system dynamics model building , 1994 .

[24]  Andi Smart,et al.  Theory and practice in SME performance measurement systems , 2001 .

[25]  T. Hill.  Manufacturing Strategy: The Strategic Management of the Manufacturing Function , 1985 .

[26]  Russell L. Ackoff,et al.  Creating the Corporate Future: Plan or be Planned For , 1981 .

[27]  R. Kaplan,et al.  Having trouble with your strategy? Then map it. , 2000, Harvard business review.

[28]  J. Sterman.  Business Dynamics , 2000 .

[29]  R. Dorf,et al.  The Balanced Scorecard: Translating Strategy Into Action , 1997, Proceedings of the IEEE.

[30]  B. Wernerfelt,et al.  A Resource-Based View of the Firm , 1984 .

[31]  Andy Neely,et al.  Designing, implementing and updating performance measurement systems , 2000 .

[32]  Northrop Frye,et al.  The Critical Path , 1983 .

[33]  Peter Checkland,et al.  Systems Thinking, Systems Practice , 1981 .

[34]  Colin Eden,et al.  Strategic options development and analysis - SODA , 1989 .

[35]  Kim Hua Tan,et al.  Building performance through in‐process measurement: Toward an “indicative” scorecard for business excellence , 2004 .

[36]  Graham Winch.  Consensus building in the planning process: Benefits from a “hard” modeling approach , 1993 .

[37]  Susan Howick,et al.  Using system dynamics to analyse disruption and delay in complex projects for litigation: can the modelling purposes be met? , 2003, J. Oper. Res. Soc..

[38]  Natasa Rupcic,et al.  The fifth discipline-the art and practice of the learning organisation , 2002 .

[39]  Kim Warren,et al.  Competitive Strategy Dynamics , 2002 .

[40]  Tony Hindle,et al.  Rational Analysis for a Problematic World , 1990 .

[41]  Teemu Malmi,et al.  BALANCED SCORECARDS IN FINNISH COMPANIES: A RESEARCH NOTE , 2001 .

[42]  S.D.P. Flapper,et al.  Towards consistent performance management systems , 1996 .

[43]  John D. Sterman,et al.  System Dynamics: Systems Thinking and Modeling for a Complex World , 2002 .

[44]  G. Kreweras.  Creating the corporate future: Russell L. ACKOFF Wiley, New York, 1981, xi + 297 pages, £10.85 , 1982 .

[45]  Jay W. Forrester,et al.  Policies, decisions and information sources for modeling☆ , 1992 .

[46]  P. Senge.  THE FIFTH DISCIPLINE , 1997 .

[47]  M. Broadbent.  Measuring business performance , 1999 .

[48]  Mik Wisniewski,et al.  Measuring performance in Dumfries and Galloway Constabulary with the Balanced Scorecard , 2001, J. Oper. Res. Soc..

[49]  Michael Pidd,et al.  Tools for Thinking—Modelling in Management Science , 1997 .

[50]  Didier P. Hostettler,et al.  The Balanced Scorecard: a Necessary Good or an Unnecessary Evil , 1999 .

[51]  R. Kaplan,et al.  The balanced scorecard--measures that drive performance. , 2015, Harvard business review.

[52]  Simon Peck,et al.  Group Model Building: Facilitating Team Learning Using System Dynamics , 1996, J. Oper. Res. Soc..