A multi-method approach to building causal performance maps from expert knowledge

Abstract This paper describes a multi-method approach to building the foundations of a causal performance measurement model. Such models have received considerable attention in the management accounting literature in recent years. Conventional models, such as the balanced scorecard commence with the strategic understanding of top management which is then translated into operational measures at lower levels. In contrast, this study proposes methods of performance mapping that draw on the knowledge of experts who control core-operating tasks. Causal knowledge is elicited from individuals who through their experience and training have encoded relational or causal knowledge about complex systems; that is, they understand how things fit and work together, although they might not have articulated that knowledge. Because no single method for eliciting causal performance maps dominates the literature, the study triangulates three methods of deriving a map of causally linked key success factors (KSFs)—a computerized analysis, an ethnographic analysis and an interactive mapping by expert participants. The study's primary contribution is the development and illustration of an approach to building performance models in management control settings where expert knowledge workers perform complex processes, the outcomes of which are difficult to quantify. The study's secondary contribution is the triangulation of multiple qualitative methods to enhance the validity of performance model development. This approach demonstrates (1) the use of cognitive mapping to extract tacit knowledge from employees in knowledge-intensive organizations; (2) the extensive array of performance-relevant variables that arises from such mapping, and (3) the potential to use the resulting causal performance map as a comprehensive, articulated basis for developing a performance measurement system. The approach used in this study for developing a causal performance map is adaptable to management control of other knowledge-intensive organizations.

[1]  W. D. Wattenmaker,et al.  Relational properties and memory-based category construction. , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[2]  Mary A. Malina,et al.  Communicating and Controlling Strategy: An Empirical Study of the Effectiveness of the Balanced Scorecard , 2001 .

[3]  D. Boje The storytelling organization: A study of story performance in an office-supply firm. , 1991 .

[4]  G. Johnson,et al.  Task and Institutional Influences on Managers' Mental Models of Competition , 2002 .

[5]  David Otley,et al.  Reliance on accounting performance measures: dead end or new beginning? , 2000 .

[6]  L. Ross,et al.  Human Inference: Strategies and Shortcomings of Social Judgment. , 1981 .

[7]  V. Ambrosini,et al.  Tacit Knowledge: Some Suggestions for Operationalization , 2001 .

[8]  M. Bougon Cognition in Organizations: An Analysis of the Utrecht Jazz Orchestra. , 1977 .

[9]  Stewart Lj,et al.  Improving competitiveness through performance-measurement systems. , 2001 .

[10]  Thomas Hemmer,et al.  Performance measurement systems, incentives, and the optimal allocation of responsibilities , 1998 .

[11]  E. Ziegel,et al.  The Balanced Scorecard , 1998 .

[12]  Gerald A. Feltham,et al.  Performance Measure Congruity and Diversity in Multi-Task Principal/Agent Relations , 2007 .

[13]  Ron Sanchez,et al.  Knowledge Management and Organizational Competence , 2001 .

[14]  G. A. Miller,et al.  Book Review Nisbett, R. , & Ross, L.Human inference: Strategies and shortcomings of social judgment.Englewood Cliffs, N.J.: Prentice-Hall, 1980. , 1982 .

[15]  C. Eden ON THE NATURE OF COGNITIVE MAPS , 1992 .

[16]  Anne Sigismund Huff,et al.  Using a Knowledge-Based System to Study Strategic Options , 2002 .

[17]  Peter H. Reingen,et al.  Microcultural Analysis of Variation in Sharing of Causal Reasoning about Behavior , 1996 .

[18]  A. Handler,et al.  A conceptual framework to measure performance of the public health system. , 2001, American journal of public health.

[19]  G. Johnson,et al.  Validating A Method for Mapping Managers' Mental Models of Competitive Industry Structures , 1995 .

[20]  William Mackaness,et al.  Management 'intuition': An interpretative account of structure and content of decision schemas using cognitive maps , 2001 .

[21]  W. Mackaness,et al.  The spatial knowledge of retail decision makers: capturing and interpreting group insight using a composite cognitive map , 2000 .

[22]  I. Nonaka A Dynamic Theory of Organizational Knowledge Creation , 1994 .

[23]  L J Stewart,et al.  Improving competitiveness through performance-measurement systems. , 2001, Healthcare financial management : journal of the Healthcare Financial Management Association.

[24]  Andrew Basden,et al.  A methodology for constructing expert systems , 1985 .

[25]  Kenneth A. Merchant,et al.  Modern Management Control Systems: Text and Cases , 1997 .

[26]  Sally K. Widener,et al.  An empirical investigation of the relation between the use of strategic human capital and the design of the management control system , 2004 .

[27]  Chee W. Chow,et al.  On the need and opportunities for improving costing and cost management in healthcare organizations , 1998 .

[28]  Jay W. Forrester,et al.  Policies, decisions and information sources for modeling☆ , 1992 .

[29]  S. Friese Self-concept and identity in a consumer society : aspects of symbolic product meaning , 2000 .

[30]  D. Larcker,et al.  Assessing empirical research in managerial accounting: a value-based management perspective , 2001 .

[31]  A. Huff Mapping Strategic Knowledge , 2002 .

[32]  Antonio Davila,et al.  Performance Measurement and Control Systems for Implementing Strategy: Text and Cases , 1999 .

[33]  Peter M. Senge,et al.  Modeling For Learning Organizations , 1994 .

[34]  Anne M. Lillis,et al.  Interdependencies in Organization Design: A Test in Hospitals , 2001 .

[35]  Joseph F. Porac,et al.  Entrepreneurial Narratives and the Dominant Logics of High-Growth Firms , 2002 .

[36]  W. Ouchi The Relationship Between Organizational Structure and Organizational Control. , 1977 .

[37]  James Shanteau,et al.  Why study expert decision making? Some historical perspectives and comments. , 1992 .

[38]  F. Selto,et al.  Causality in Performance Measurement Model , 2004 .

[39]  Véronique Ambrosini,et al.  Mapping Successful Organizational Routines , 2002 .

[40]  T. Kasurinen,et al.  Exploring management accounting change: the case of balanced scorecard implementation , 2002 .

[41]  R. Yin Case Study Research: Design and Methods , 1984 .

[42]  David J. Weiss,et al.  Performance-based assessment of expertise: How to decide if someone is an expert or not , 2002, Eur. J. Oper. Res..

[43]  David A. Bell,et al.  Modification of belief in evidential causal networks , 1999, Inf. Softw. Technol..

[44]  Thomas F. Homer-Dixon,et al.  Strategies for Studying Causation in Complex Ecological-Political Systems , 1996 .

[45]  Greg Laugero,et al.  Managing Knowledge , 1998 .

[46]  David Otley,et al.  Performance Management: A Framework for Management Control Systems Research , 1999 .

[47]  K. Langfield-Smith EXPLORING THE NEED FOR A SHARED COGNITIVE MAP , 1992 .

[48]  Ron Sanchez,et al.  Systems Perspectives on Resources, Capabilities, and Management Processes , 2002 .

[49]  E. Ziegel,et al.  Balanced Scorecard , 2019, Encyclopedia of Public Administration and Public Policy, Third Edition.