Strategy Evaluation When Using a Strategic Performance Measurement System: An Examination of Motivational and Cognitive Biases

Abstract The multiple performance measures in strategic performance measurement systems should be selected to represent a set of causally linked strategic drivers and outcomes. The pattern of results thus can provide information concerning the proper execution of the strategy (i.e., the performance evaluation role) and the strength of the cause-and-effect linkages assumed by the strategy (i.e., the strategy evaluation role). Unfortunately, managers’ tendency to re-evaluate the strategy when performance falls short of target is low in practice. Possible explanations include motivational and cognitive biases. We experimentally examine two decision aids, an attribution aid, and a decomposition aid, designed to help managers ease these challenges. Study 1 shows the decision aids, individually and in combination, increase managers’ tendency to re-examine a problematic strategy. Study 2 demonstrates the effectiveness of the two decision aids, when used together, under a different pattern of results and among a sample of more experienced managers.

[1]  Srikant M. Datar,et al.  Testing Strategy with Multiple Performance Measures: Evidence from a Balanced Scorecard at Store24 , 2015 .

[2]  W. B. Tayler.  The Balanced Scorecard as a Strategy-Evaluation Tool: The Effects of Implementation Involvement and a Causal-Chain Focus , 2009 .

[3]  Bernard Wong-On-Wing,et al.  Beyond cultural values : an implicit theory approach to cross-cultural research in accounting ethics , 2013 .

[4]  R. Banker,et al.  The Balanced Scorecard: Judgmental Effects of Performance Measures Linked to Strategy , 2004 .

[5]  Patrick R. Wheeler,et al.  The Effects of Decision Aid Design on the Information Search Strategies and Confirmation Bias of Tax Professionals , 2008 .

[6]  Robert J. Harvey,et al.  A comparison of holistic versus decomposed rating of Position Analysis Questionnaire work dimensions. , 1988 .

[7]  W. K. Campbell,et al.  Self-Threat Magnifies the Self-Serving Bias: A Meta-Analytic Integration , 1999 .

[8]  Robert A. Baron,et al.  Opportunity Recognition as the Detection of Meaningful Patterns: Evidence from Comparisons of Novice and Experienced Entrepreneurs , 2006, Manag. Sci..

[9]  Kerry A. Humphreys,et al.  The Differential Improvement Effects of the Strategy Map and Scorecard Perspectives on Managers' Strategic Judgments , 2012 .

[10]  H. Cooper,et al.  A statistical review of the literature concerning the self-serving attribution bias in interpersonal influence situations , 1980 .

[11]  J. Greenberg,et al.  Toward an integration of cognitive and motivational perspectives on social inference: A biased hypothesis-testing model , 1987 .

[12]  D. Larcker,et al.  Coming up short on nonfinancial performance measurement. , 2003, Harvard business review.

[13]  M. Buehner,et al.  Accountants' Usage of Causal Business Models in the Presence of Benchmark Data: A Note* , 2007 .

[14]  B Kleinmuntz,et al.  Why we still use our heads instead of formulas: toward an integrative approach. , 1990, Psychological bulletin.

[15]  R. Brislin.  Back-Translation for Cross-Cultural Research , 1970 .

[16]  Stacey M. Whitecotton.  The effects of experience and a decision aid on the slope, scatter, and bias of earnings forecasts , 1996 .

[17]  R. Kaplan,et al.  Having trouble with your strategy? Then map it. , 2000, Harvard business review.

[18]  B. Fischhoff,et al.  Judgment under uncertainty: Debiasing , 1982 .

[19]  Lan Guo,et al.  Reducing conflict in balanced scorecard evaluations , 2007 .

[20]  R. Kaplan,et al.  Mastering the management system. , 2008, Harvard business review.

[21]  Jacqueline S. Hammersley.  Pattern Identification and Industry‐Specialist Auditors , 2006 .

[22]  M. Zuckerman,et al.  Attribution of success and failure revisited, or: The motivational bias is alive and well in attribution theory , 1979 .

[23]  Kenneth A. Merchant,et al.  On Testing Business Models , 2011 .

[24]  Kevin R. Murphy,et al.  Distributional ratings, judgment decomposition, and their impact on interrater agreement and rating accuracy. , 1990 .

[25]  W. D. Schulte.  The Strategy-Focused Organization: How Balanced Scorecard Companies Thrive in the New Business Environment. , 2005 .

[26]  E. O'Donnell,et al.  Assessing Risk with Analytical Procedures: Do Systems-Thinking Tools Help Auditors Focus on Diagnostic Patterns? , 2011 .

[27]  Tom Pyszczynski,et al.  The self-serving attributional bias: Beyond self-presentation , 1982 .

[28]  Willie Choi,et al.  Strategy Selection, Surrogation, and Strategic Performance Measurement Systems , 2012 .

[29]  Bernard Wong-On-Wing,et al.  Culture, implicit theories and the attribution of morality , 2007 .

[30]  Robert Libby,et al.  Determinants of judgment performance in accounting settings: Ability, knowledge, motivation , 1993 .

[31]  Stephen A. Butler.  Application Of A Decision Aid In The Judgmental Evaluation Of Substantive Test Of Details Samples , 1985 .

[32]  R. Chenhall.  Integrative strategic performance measurement systems, strategic alignment of manufacturing, learning and strategic outcomes: an exploratory study , 2005 .

[33]  William B. Tayler,et al.  Strategy Selection, Surrogation, and Strategic Performance Measurement Systems: strategy selection and surrogation , 2013 .

[34]  Steven E. Salterio,et al.  The Balanced Scorecard: The Effects of Assurance and Process Accountability on Managerial Judgment , 2004 .

[35]  R. Dalal,et al.  Culture and judgment of causal relevance. , 2003, Journal of personality and social psychology.

[36]  Anna M. Rose,et al.  Measurement of knowledge structures acquired through instruction, experience, and decision aid use , 2007, Int. J. Account. Inf. Syst..

[37]  Patrick Wheeler,et al.  Experimental methods in decision aid research , 2011, Int. J. Account. Inf. Syst..

[38]  L. Abramson,et al.  Is there a universal positivity bias in attributions? A meta-analytic review of individual, developmental, and cultural differences in the self-serving attributional bias. , 2004, Psychological bulletin.

[39]  Vicky Arnold,et al.  An Investigation of Knowledge‐Based Systems' Use to Promote Judgment Consistency in Multicultural Firm Environments , 2005 .

[40]  M. Strube,et al.  The Multiply Motivated Self , 1995 .

[41]  C. Anderson,et al.  Explanations: Processes and consequences. , 1996 .

[42]  R. Hogarth,et al.  Judging probable cause. , 1986 .

[43]  Donelson R. Forsyth,et al.  Improving the Performance of Failing Students by Overcoming Their Self-Serving Attributional Biases , 1987 .

[44]  R. Kaplan,et al.  The strategy-focused organization , 2000 .

[45]  H. M. Jenkins,et al.  JUDGMENT OF CONTINGENCY BETWEEN RESPONSES AND OUTCOMES. , 1965, Psychological monographs.

[46]  R. Nisbett,et al.  Culture and systems of thought: holistic versus analytic cognition. , 2001, Psychological review.

[47]  Edwin T. Cornelius,et al.  A comparison of holistic and decomposed judgment strategies in a performance rating simulation , 1982 .

[48]  M. Kaplan,et al.  6 – INFORMATION INTEGRATION IN SOCIAL JUDGMENT: INTERACTION OF JUDGE AND INFORMATIONAL COMPONENTS , 1975 .

[49]  D. Larcker,et al.  Moving from Strategic Measurement to Strategic Data Analysis , 2022 .

[50]  Paul L. Walker,et al.  The effects of instruction and experience on the acquisition of auditing knowledge , 1994 .

[51]  R. Kaplan,et al.  Using the balanced scorecard as a strategic management system , 1996 .

[52]  F. Heider.  The psychology of interpersonal relations , 1958 .

[53]  Steven E. Salterio,et al.  The Balanced Scorecard: Judgmental Effects of Common and Unique Performance Measures , 2000 .

[54]  Shane S. Dikolli,et al.  Improvements in the Information Content of Nonfinancial Forward‐Looking Performance Measures: A Taxonomy and Empirical Application , 2007 .