Measuring Organizational Performance as a Dependent Variable: Towards Methodological Best Practice

Organizational performance is one of the most important constructs in management research. We review the contexts that frame organizational performance as a dependent variable with specific emphasis on how it is operationalized and measured. The research contexts of past studies are firmly anchored around a multidimensional conceptualization of organizational performance related predominately to stakeholders, heterogeneous market circumstances, and time. The review of the operationalization and measurement of performance highlights the limited effectiveness of commonly accepted measurement practices in tapping this multidimensionality. By synthesizing the literature, the foundations are laid for the improved measurement of performance in management research. We conclude with a call for research that examines the effectiveness of triangulation utilizing multiple measures, applies longitudinal data and brings to bear alternative methodological formulations as means of appropriately aligning research contexts with the measurement of organizational performance. Validating these measurement approaches is an important agenda for further research. Previous Title: Measuring Organizational Performance in Management Research: A Synthesis of Measurement Challenges and Approaches

[1]  Bronwyn H Hall,et al.  Market value and patent citations , 2005 .

[2]  S. G. Cohen,et al.  Measuring the Relationship Between Managerial Competencies and Performance , 2006 .

[3]  J. Tobin.  A General Equilibrium Approach to Monetary Theory , 1969 .

[4]  Steven Milunovich,et al.  EVA® IN THE COMPUTER INDUSTRY , 1996 .

[5]  G. George.  Slack Resources and the Performance of Privately Held Firms , 2005 .

[6]  Ronald Dore,et al.  Stock Market Capitalism: Welfare Capitalism: Japan and Germany Versus the Anglo-Saxons , 2000 .

[7]  Tudor Rickards,et al.  Built to last: successful habits of visionary companies , 1997 .

[8]  S. Winter.  Mistaken Perceptions: Cases and Consequences , 2003 .

[9]  A. Rappaport,et al.  Creating shareholder value : the new standard for business performance , 1986 .

[10]  Anne Nagel,et al.  The Balanced Scorecard Translating Strategy Into Action , 2002 .

[11]  J. Barney.  Firm Resources and Sustained Competitive Advantage , 1991 .

[12]  J. Farley,et al.  Determinants of Financial Performance: A Meta-Analysis , 1990 .

[13]  William Boulding,et al.  Commentary on Unobservable Effects and Business Performance: Do Fixed Effects Matter? , 1990 .

[14]  G. Waring,et al.  Industry Differences in the Persistence of Firm-Specific Returns , 1996 .

[15]  Wade D. Cook,et al.  Performance measurement and classification data in DEA: Input-oriented model , 2007 .

[16]  W. K. Campbell,et al.  Self-Threat Magnifies the Self-Serving Bias: A Meta-Analytic Integration , 1999 .

[17]  Mark J. Roberts,et al.  Patterns of Firm Entry and Exit in U.S. Manufacturing Industries , 1988 .

[18]  Maurice Gosselin,et al.  PERFORMANCE MEASUREMENT AND ORGANIZATIONAL EFFECTIVENESS : BRIDGING THE GAP , 2002 .

[19]  James L. Dodd,et al.  Economic Value Added (EVA Super TM): An Empirical Examination of a New Corporate Performance Measure , 1997 .

[20]  V. Narayanan,et al.  Strategic schemas, strategic flexibility, and firm performance: the moderating role of industry clockspeed , 2007 .

[21]  Timothy L. Pett,et al.  Measuring organizational efficiency and effectiveness , 2002 .

[22]  Ronald K. Mitchell,et al.  Toward a Theory of Stakeholder Identification and Salience: Defining the Principle of who and What Really Counts , 1997 .

[23]  Tiziana Casciaro,et al.  Power Imbalance, Mutual Dependence, and Constraint Absorption: A Closer Look at Resource Dependence Theory , 2005 .

[24]  Ben S. Branch,et al.  Perceptions of Firm Quality: A Cause or Result of Firm Performance , 1990 .

[25]  Stanley Paulo.  Operating Income, Residual Income and EVA: Which Metric Is More Value Relevant-A Comment , 2002 .

[26]  Paul J. Verdin,et al.  IS PERFORMANCE DRIVEN BY INDUSTRY- OR FIRM-SPECIFIC FACTORS? A NEW LOOK AT THE EVIDENCE , 2009 .

[27]  R E Miles,et al.  Organizational strategy, structure, and process. , 1978, Academy of management review. Academy of Management.

[28]  Annette B. Poulsen,et al.  Shark repellents and stock prices: The effects of antitakeover amendments since 1980 , 1987 .

[29]  B. Chakravarthy.  Measuring strategic performance , 1986 .

[30]  Ronald Dore,et al.  Stock Market Capitalism: Welfare Capitalism , 2000 .

[31]  R. Rumelt.  How much does industry matter , 1991 .

[32]  M. Clarkson.  A Stakeholder Framework for Analyzing and Evaluating Corporate Social Performance , 1995 .

[33]  T. Wall,et al.  On the validity of subjective measures of company performance , 2004 .

[34]  Gary C. Biddle,et al.  Does Eva Beat Earnings? Evidence on Associations with Stock Returns and Firm Values , 1997 .

[35]  George P. Baker,et al.  Survivorship and the Economic Grim Reaper , 2002 .

[36]  D. Larcker,et al.  Innovations in Performance Measurement: Trends and Research Implications , 1998 .

[37]  N. Venkatraman,et al.  Measurement of Business Economic Performance: An Examination of Method Convergence , 1987 .

[38]  Steve Brown,et al.  Implementing a Strategic Planning Model for Small Manufacturing Firms: An Adaptation of the Balanced Scorecard , 2004 .

[39]  Stefan Reichelstein,et al.  Stock Price, Earnings and Book Value in Managerial Performance Measures , 2005 .

[40]  V. Pucik,et al.  Relationship between innovativeness, quality, growth, profitability, and market value , 2005 .

[41]  M. C. Jensen,et al.  Harvard Business School; SSRN; National Bureau of Economic Research (NBER); European Corporate Governance Institute (ECGI); Harvard University - Accounting & Control Unit , 1976 .

[42]  J. Ruzita,et al.  Ruzita, J. and Parnell, J. A. (2008). Competitive strategy and performance measurement in the Malaysian context: An exploratory study , 2008 .

[43]  Arjen van Witteloostuijn,et al.  Corporate Social and Financial Performance: An Extended Stakeholder Theory, and Empirical Test with Accounting Measures , 2008 .

[44]  A. Neely,et al.  WHY MEASUREMENT INITIATIVES FAIL , 2000 .

[45]  Josef Lakonishok,et al.  Momentum Strategies , 1995 .

[46]  J. Geanakoplos,et al.  Multimarket Oligopoly: Strategic Substitutes and Complements , 1985, Journal of Political Economy.

[47]  D. Kahneman,et al.  Aspects of Investor Psychology , 1998 .

[48]  A. U.S.,et al.  Measuring the efficiency of decision making units , 2003 .

[49]  K. Lehn,et al.  Eva, Accounting Profits, and CEO Turnover: An Empirical Examination, 1985–1994 , 1997 .

[50]  Soo-Yong Kim,et al.  Performance measurement of construction firms in developing countries , 2008 .

[51]  Joel M. Stern,et al.  THE EVA® FINANCIAL MANAGEMENT SYSTEM , 1995 .

[52]  Tony Francolini,et al.  In Search of Meaning: Does the Fortune Reputation Survey Alter Performance Expectations? , 2009 .

[53]  J. Dutton,et al.  Advances in strategic management , 1994 .

[54]  C. Fombrun,et al.  What's in a Name? Reputation Building and Corporate Strategy , 1990 .

[55]  J. Guthrie.  High-Involvement Work Practices, Turnover, and Productivity: Evidence from New Zealand , 2001 .

[56]  S. Widener,et al.  Managing Value Creation within the Firm: An Examination of Multiple Performance Measures , 2004 .

[57]  R. Dorf,et al.  The Balanced Scorecard: Translating Strategy Into Action , 1997, Proceedings of the IEEE.

[58]  David E. Booth,et al.  An Empirical Critique of In Search of Excellence: How Excellent are the Excellent Companies? , 1986 .

[59]  Sabine Langner.  Tracking Stocks , 2004 .

[60]  Vasudevan Ramanujam,et al.  THE CORPORATE PERFORMANCE CONUNDRUM: A SYNTHESIS OF CONTEMPORARY VIEWS AND AN EXTENSION , 1990 .

[61]  Yiannis E. Spanos,et al.  Strategy and industry effects on profitability: evidence from Greece , 2004 .

[62]  M. Hitt,et al.  Construct measurement in strategic management research: illusion or reality? , 2005 .

[63]  Mike W. Peng.  Outside directors and firm performance during institutional transitions , 2004 .

[64]  Julia Kirby,et al.  Toward a theory of high performance. , 2005, Harvard business review.

[65]  Timothy M. Devinney,et al.  Agency Contracting and Inside Debt , 1990 .

[66]  Anita M. McGahan,et al.  How Industries Evolve: Principles for Achieving and Sustaining Superior Performance , 2004 .

[67]  J. Baum,et al.  STRATEGIC DECISION SPEED AND FIRM PERFORMANCE , 2003 .

[68]  R. Freeman.  Strategic Management: A Stakeholder Approach , 2010 .

[69]  David A. Whetten,et al.  1 – Organizational Effectiveness: One Model or Several? , 1983 .

[70]  K. Langfield-Smith,et al.  Multiple Perspectives of Performance Measures , 2007 .

[71]  Sumit K. Kundu,et al.  A three-stage theory of international expansion: the link between multinationality and performance in the service sector , 2003 .

[72]  B. Malkiel.  The Efficient Market Hypothesis and Its Critics , 2003 .

[73]  James E. Storbeck,et al.  Pluralistic views of performance , 2003 .

[74]  Edward Levitas,et al.  CEO Tenure And Company Invention Under Differing Levels of Technological Dynamism , 2005 .

[75]  John M. Mezias,et al.  Studying the Accuracy of Managers' Perceptions: A Research Odyssey , 2003 .

[76]  Shelley E. Taylor,et al.  Illusion and well-being: a social psychological perspective on mental health. , 1988, Psychological bulletin.

[77]  A. Hillman,et al.  Shareholder value, stakeholder management, and social issues: what's the bottom line? , 2001 .

[78]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[79]  Robert Jacobson,et al.  The Validity of ROI as a Measure of Business Performance , 1987 .

[80]  R. H. Waterman,et al.  In Search of Excellence: Lessons from America's Best-run Companies , 1995 .

[81]  W. Glenn Rowe,et al.  A Note on the Dimensionality of the Firm Financial Performance Construct Using Accounting, Market, and Subjective Measures , 2009 .

[82]  James L. Dodd,et al.  Operating Income, Residual Income and EVA[TM]: Which Metric Is More Value Relevant? [*] , 2001 .

[83]  Jason G. Cummins,et al.  The Stock Market and Investment in the New Economy: Some Tangible Facts and Intangible Fictions , 2000 .

[84]  F. Selto,et al.  Choice and Change of Measures in Performance Measurement Models , 2004 .

[85]  Douglas J. Miller.  Firms' technological resources and the performance effects of diversification: A longitudinal study , 2004 .

[86]  Paul Chaney,et al.  Shredded Reputation: The Cost of Audit Failure , 2002 .

[87]  Vicky Arnold,et al.  The effect of experience and complexity on order and recency bias in decision making by professional accountants , 2000 .

[88]  F. Schmidt,et al.  Corporate Social and Financial Performance: A Meta-Analysis , 2003 .

[89]  J. Poterba,et al.  What moves stock prices? , 1988 .

[90]  D. Teece,et al.  DYNAMIC CAPABILITIES AND STRATEGIC MANAGEMENT , 1997 .

[91]  M. Porter,et al.  HOW MUCH DOES INDUSTRY MATTER , REALLY ? , 1997 .

[92]  Paul W. Beamish,et al.  Geographic scope and multinational enterprise performance , 2003 .

[93]  Gerry Johnson,et al.  Using Frontier Analysis to Evaluate Company Performance , 2010 .

[94]  J. Graham.  Herding Among Investment Newsletters: Theory and Evidence , 1998 .

[95]  Richard M. Steers.  Problems in the Measurement of Organizational Effectiveness , 1975 .

[96]  D. Kahneman,et al.  Heuristics and Biases: The Psychology of Intuitive Judgment , 2002 .

[97]  Melenie J. Lankau,et al.  Improving Construct Measurement In Management Research: Comments and a Quantitative Approach for Assessing the Theoretical Content Adequacy of Paper-and-Pencil Survey-Type Instruments , 1993 .

[98]  Robert Jacobsen,et al.  The persistence of abnormal returns , 1988 .

[99]  Mark P. Sharfman.  The construct validity of the Kinder, Lydenberg & Domini social performance ratings data , 1996 .

[100]  Ruzita Jusoh,et al.  Competitive strategy and performance measurement in the Malaysian context , 2008 .

[101]  A. Tversky,et al.  Choices, Values, and Frames , 2000 .

[102]  B. Lev.  Intangibles: Management, Measurement, and Reporting , 2001 .

[103]  John J. McGowan,et al.  On the Misuse of Accounting Rates of Return to Infer Monopoly Profits , 1983 .

[104]  D. Archard,et al.  From Pluralist to Patriotic Politics, Putting Practice First , 2004 .

[105]  Phil Rosenzweig,et al.  Misunderstanding the Nature of Company Performance: The Halo Effect and other Business Delusions , 2007 .

[106]  S. Titman,et al.  Momentum Investment Strategies, Portfolio Performance, and Herding: A Study of Mutual Fund Behavior , 1994 .