The Balanced Scorecard: The Effects of Assurance and Process Accountability on Managerial Judgment

The balanced scorecard has been hailed as one of the major developments in management accounting in the past decade. Lipe and Salterio (2000) show that one of the key scorecard features, the inclusion of measures that are unique to the strategic objectives of a business unit, tend to be ignored by managers when making performance evaluation judgments. This study employs an adapted version of Kennedy’s (1993, 1995) debiasing framework to motivate two approaches to reducing this “common measures bias.” We examine whether increasing effort via invoking process accountability (i.e., requiring managers to justify to their superior their performance evaluations) and/or improving the perceived quality of the balanced scorecard measures (i.e., via assurance over the reliability and relevance of the performance measures) leads to managers’ increased usage of unique performance measures in their evaluations. Results suggest that either the requirement to justify an evaluation to a superior or the provision of an assurance report over all measures increases the use of unique measures in managerial performance evaluation judgments. Interestingly, the combination of the two approaches is not as powerful as the individual debiasers by themselves. Furthermore, we provide evidence that the common measures bias is not an easily correctable cognitive illusion that disappears when the potential for judgment inconsistency is pointed out to participants. Implications for theory and practice are discussed.

[1]  Itamar Simonson,et al.  The effect of accountability on susceptibility to decision errors , 1992 .

[2]  M. L. Blum,et al.  Industrial Psychology: Its Theoretical and Social Foundations , 1968 .

[3]  R. Kaplan,et al.  Linking the Balanced Scorecard to Strategy , 1996 .

[4]  Ronald A. Dye,et al.  Relative Performance Evaluation And Project Selection , 1992 .

[5]  David W. Blackwell,et al.  The value of auditor assurance: Evidence from loan pricing , 1998 .

[6]  Sarah E. Bonner,et al.  The Effects of Domain Experience and Task Presentation Format on Accountants' Information Relevance Assurance , 2001 .

[7]  R. Arvey,et al.  Performance evaluation in work settings. , 1998, Annual review of psychology.

[8]  Sarah E. Bonner,et al.  Expertise In Corporate-Tax Planning - The Issue Identification Stage , 1992 .

[9]  D. Medin,et al.  Similarity and Alignment in Choice , 1995 .

[10]  Steven E. Salterio,et al.  The Balanced Scorecard: Judgmental Effects of Common and Unique Performance Measures , 2000 .

[11]  H. Arkes Costs and benefits of judgment errors: Implications for debiasing. , 1991 .

[12]  Dirk Yandell,et al.  Audit Information and Incentives for Efficiency , 1988 .

[13]  Paul Slovic,et al.  Dimensional Commensurability and Cue Utilization in Comparative Judgment. , 1974 .

[14]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: part 1.: an account of basic findings , 1988 .

[15]  Christopher D. Ittner,et al.  Subjectivity and the Weighting of Performance Measures: Evidence from a Balanced Scorecard , 2003 .

[16]  Jane Kennedy,et al.  Debiasing Audit Judgment With Accountability - A Framework And Experimental Results , 1993 .

[17]  Hun-Tong Tan,et al.  Accountability Effects on Auditors' Performance: Influence of Knowledge, Problem-Solving Ability, and Task Complexity , 1999 .

[18]  Bengt Holmstrom,et al.  Moral Hazard and Observability , 1979 .

[19]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[20]  M. W. Nelson,et al.  Experimental Research in Financial Accounting , 2001 .

[21]  R. Kaplan,et al.  PUTTING THE BALANCED SCORECARD TO WORK , 1993 .

[22]  Margaret J. Robertson,et al.  Design and Analysis of Experiments , 2006, Handbook of statistics.

[23]  J. S. Adams,et al.  Inequity In Social Exchange , 1965 .

[24]  Robert Libby,et al.  Bankers And Auditors Perceptions Of The Message Communicated By The Audit Report , 1979 .

[25]  R. Kaplan,et al.  The balanced scorecard--measures that drive performance. , 2015, Harvard business review.

[26]  P. Tetlock,et al.  Accountability: a social magnifier of the dilution effect. , 1989, Journal of personality and social psychology.

[27]  J. Frank Yates,et al.  Effects of procedural and outcome accountability on judgment quality , 1996 .

[28]  Jonathan Grainger,et al.  A dual read-out model of word context effects in letter perception: Further investigations of the word superiority effect. , 1994 .

[29]  Mary A. Malina,et al.  Communicating and Controlling Strategy: An Empirical Study of the Effectiveness of the Balanced Scorecard , 2001 .

[30]  Robert Libby,et al.  Incentives, Effort, And The Cognitive-Processes Involved In Accounting-Related Judgments , 1992 .

[31]  R. Dorf,et al.  The Balanced Scorecard: Translating Strategy Into Action , 1997, Proceedings of the IEEE.

[32]  Kevin J. Murphy,et al.  Compensation and Incentives: Practice vs. Theory , 1988 .

[33]  R. Banker,et al.  The Balanced Scorecard: Judgmental Effects of Performance Measures Linked to Strategy , 2004 .

[34]  Douglas J. Skinner,et al.  Recommendations on Disclosure of Nonfinancial Performance Measures , 2002 .

[35]  James E. Hunton,et al.  Analysts' Reactions to Earnings Preannouncement Strategies , 2002 .

[36]  Christopher K. Hsee,et al.  The Evaluability Hypothesis: An Explanation for Preference Reversals between Joint and Separate Evaluations of Alternatives , 1996 .

[37]  C. Coulton,et al.  Interaction Effects in Multiple Regression , 1993 .

[38]  Robert L. Heneman The relationship between supervisory ratings and results-oriented measures of performance: A meta-analysis. , 1986 .

[39]  R. K. Mautz,et al.  The philosophy of auditing , 1961 .

[40]  Arthur B. Markman,et al.  Overcoming the Early Entrant Advantage: The Role of Alignable and Nonalignable Differences , 1998 .

[41]  Itamar Simonson,et al.  Deescalation Strategies: A Comparison of Techniques for Reducing Commitment to Losing Courses of Action , 1992 .

[42]  Jane Kennedy,et al.  Debiasing the curse of knowledge in audit judgment , 1995 .

[43]  R. Dawes Judgment under uncertainty: The robust beauty of improper linear models in decision making , 1979 .

[44]  R. Fisch,et al.  Effect of High and Low Motivation on Two Aspects of Attention , 1964, Perceptual and motor skills.

[45]  S. J. Motowidlo,et al.  Effects of Rater Accountability on the Accuracy and the Favorability of Performance Ratings , 2004 .

[46]  V. Barnett,et al.  Applied Linear Statistical Models , 1975 .

[47]  P. Tetlock Accountability: The neglected social context of judgment and choice. , 1985 .

[48]  C. Cloyd,et al.  Performance in Tax Research Tasks: The Joint Effects of Knowledge and Accountability , 1998 .

[49]  Dedre Gentner,et al.  Learning by Analogical Bootstrapping , 2001 .

[50]  Paul L. Walker,et al.  The effects of instruction and experience on the acquisition of auditing knowledge , 1994 .

[51]  Paul R. Milgrom,et al.  Multitask Principal–Agent Analyses: Incentive Contracts, Asset Ownership, and Job Design , 1991 .

[52]  Barry L. Lewis,et al.  Determinants of Auditor Expertise , 1990 .

[53]  Michael D. Shields,et al.  Cost Knowledge and Cost‐Based Judgment Performance , 2001 .

[54]  J. Kagan,et al.  Rational choice in an uncertain world , 1988 .

[55]  Daniel G Bobrow,et al.  On data-limited and resource-limited processes , 1975, Cognitive Psychology.

[56]  Geoffrey B. Sprinkle The Effect of Incentive Contracts on Learning and Performance , 2000 .

[57]  Srikant M. Datar,et al.  Balancing Performance Measures , 2001 .

[58]  Robert K. Elliott Assurance Service Opportunities : Implications for Academia , 1997 .

[59]  Robert Libby,et al.  Earnings Management, Audit Differences, and Analysts' Forecasts , 1999 .

[60]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[61]  D Kahneman,et al.  On the reality of cognitive illusions. , 1996, Psychological review.

[62]  Robert H. Ashton,et al.  Pressure And Performance In Accounting Decision Settings - Paradoxical Effects Of Incentives, Feedback, And Justification , 1990 .

[63]  Shi Zhang,et al.  Processing Product Unique Features: Alignability and Involvement in Preference Construction , 2001 .

[64]  Bengt Holmstrom,et al.  Moral Hazard in Teams , 1982 .

[65]  P. Tetlock,et al.  Accounting for the effects of accountability. , 1999, Psychological bulletin.

[66]  Abbie J. Smith,et al.  An Empirical-Investigation Of The Relative Performance Evaluation Of Corporate-Executives , 1986 .

[67]  Robert Folger,et al.  Organizational Justice and Human Resource Management , 1998 .

[68]  Rajiv D. Banker,et al.  Sensitivity, Precision, and Linear Aggregation of Signals for Performance Evaluation , 1989 .