A decision framework for the consolidation of performance measurement systems

Numerous performance measurement systems have been expanding over the years. Therefore, they often contain more information than needed as well as irrelevant information. The consequences are high complexity in cognitively processing the enclosed measures and unnecessary costs for operating and maintaining the supporting infrastructure. Against this backdrop, we propose a decision framework that supports the consolidation of existing performance measurement systems such that information processing complexity and costs are balanced with the extent to which decision makers' information requirements are met and alignment with corporate objectives is achieved. We also report on the results of an evaluation based on feature comparison, prototype construction, and a real-world application. Highlights? We tackle the problem of information overload and costs for information provision. ? We propose a decision framework for consolidating performance measurement systems. ? We address informational and economic challenges of information provision.

[1]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[2]  Keng Siau,et al.  Evaluation of information modeling methods-a review , 1998, Proceedings of the Thirty-First Hawaii International Conference on System Sciences.

[3]  Gregory G. Dess,et al.  Measuring organizational performance in the absence of objective measures: The case of the privately-held firm and conglomerate business unit , 1984 .

[4]  W. H. Inmon,et al.  Building the data warehouse , 1992 .

[5]  Maximilian Röglinger,et al.  Value Orientation in Process Management , 2011, Bus. Inf. Syst. Eng..

[6]  Michael D. Myers,et al.  The qualitative interview in IS research: Examining the craft , 2007, Inf. Organ..

[7]  Ulrich Frank,et al.  Towards a pluralistic conception of research methods in information systems research , 2006 .

[8]  David Bawden,et al.  The dark side of information: overload, anxiety and other paradoxes and pathologies , 2009, J. Inf. Sci..

[9]  Marc Wouters,et al.  The role of existing measures in developing and implementing performance measurement systems , 2005 .

[10]  Mike Bourne,et al.  An examination of the literature relating to issues affecting how companies manage through measures , 2005 .

[11]  H. Theil Introduction to econometrics , 1978 .

[13]  F. B. Vernadat,et al.  Decisions with Multiple Objectives: Preferences and Value Tradeoffs , 1994 .

[14]  김정년,et al.  Managerial Economics 『관리경제학』 , 1976 .

[15]  Clyde W. Holsapple,et al.  Handbook on Decision Support Systems 1: Basic Themes , 2008 .

[16]  Omar F. El-Gayar,et al.  A web-based multi-perspective decision support system for information security planning , 2010, Decis. Support Syst..

[17]  D. Arnott,et al.  Evaluating the intangible benefits of Business Intelligence: review and research agenda , 2004 .

[18]  John Duncan,et al.  The demonstration of capacity limitation , 1980, Cognitive Psychology.

[19]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[20]  Shirley Gregor,et al.  The Anatomy of a Design Theory , 2007, J. Assoc. Inf. Syst..

[21]  Ali F. Farhoomand,et al.  Managerial information overload , 2002, CACM.

[22]  Mary A. Malina,et al.  Relations among Measures, Climate of Control, and Performance Measurement Models* , 2007 .

[23]  R. Dorf,et al.  The Balanced Scorecard: Translating Strategy Into Action , 1997, Proceedings of the IEEE.

[24]  Xianggui Qu,et al.  Multivariate Data Analysis , 2007, Technometrics.

[25]  D. Larcker,et al.  Performance Implications of Strategic Performance Measurement in Financial Services Firms , 2003 .

[26]  H. M. Schroder,et al.  Human Information Processing: Individuals and Groups Functioning in Complex Situations , 1970 .

[27]  Matthias Ehrgott,et al.  Multiple criteria decision analysis: state of the art surveys , 2005 .

[28]  Peter Rausch,et al.  Performance Management , 2011, Informatik-Spektrum.

[29]  Theodor J. Stewart,et al.  Multiple criteria decision analysis - an integrated approach , 2001 .

[30]  Mark W. Watson Introduction to econometrics. , 1968 .

[31]  Ip-Shing Fan,et al.  A framework to review performance measurement systems , 2005, Bus. Process. Manag. J..

[32]  Peter Mertens,et al.  Fads and Trends in Business and Information Systems Engineering and Information Systems Research – A Comparative Literature Analysis , 2009, Bus. Inf. Syst. Eng..

[33]  Olaf A.M. Fisscher,et al.  Ethical Dilemmas in Performance Measurement , 2003 .

[34]  Richard T. Watson,et al.  Analyzing the Past to Prepare for the Future: Writing a Literature Review , 2002, MIS Q..

[35]  Andy Neely,et al.  Designing, implementing and updating performance measurement systems , 2000 .

[36]  Maximilian Röglinger,et al.  How to select measures for decision support systems - An optimization approach integrating informational and economic objectives , 2009, ECIS.

[37]  Hanne Nørreklit The Balance on the Balanced Scorecard: A Critical Analysis of Some of Its Assumptions , 2000 .

[38]  Russell L. Ackoff,et al.  Management misinformation systems , 1967 .

[39]  Steven E. Salterio,et al.  A note on the judgmental effects of the balanced scorecard's information organization , 2002 .

[40]  Thilini Ariyachandra,et al.  Business Performance Management: One Truth , 2005, Inf. Syst. Manag..

[41]  David Otley,et al.  Performance Management: A Framework for Management Control Systems Research , 1999 .

[42]  Michel Lebas,et al.  A conceptual and operational delineation of performance , 2002 .

[43]  Luiz Cesar Ribeiro Carpinetti,et al.  Conceptual design of performance measurement and management systems using a structured engineering approach , 2005 .

[44]  Umit Bititci,et al.  Integrated performance measurement systems: a development guide , 1997 .

[45]  Louis Raymond,et al.  Researching performance measurement systems , 2008 .

[46]  Pablo Bernabé González Un Arreglo para un Arreglo. Historia Íntima, No Comercial, del Acordeón y el Chamamé , 2005 .

[47]  Mike Kennerley,et al.  Managing through measures: a study of impact on performance , 2005 .

[48]  B. Roy Paradigms and Challenges , 2005 .

[49]  Andy Neely,et al.  Performance measurement system design: developing and testing a process‐based approach , 2000 .

[50]  David A. J. Axson Best Practices in Planning and Performance Management: From Data to Decisions , 2007 .

[51]  R. Balachandra,et al.  Managing New Product Development Processes the Right Way , 1999, Inf. Knowl. Syst. Manag..

[52]  Vijay K. Vaishnavi,et al.  Design Science Research Methods and Patterns: Innovating Information and Communication Technology , 2007 .

[53]  Brian H. Maskell,et al.  Performance Measurement for World Class Manufacturing: A Model for American Companies , 1991 .

[54]  Derek Steeple,et al.  A FRAMEWORK FOR AUDITING AND ENHANCING PERFORMANCE MEASUREMENT SYSTEMS , 2000 .

[55]  Alan R. Hevner,et al.  Design Science in Information Systems Research , 2004, MIS Q..

[56]  Andy Neely,et al.  Performance measurement system design , 1995 .

[57]  Thomas Reichmann,et al.  Controlling mit Kennzahlen , 2011 .

[58]  BawdenDavid,et al.  The dark side of information , 2009 .

[59]  A. Neely The evolution of performance measurement research: Developments in the last decade and a research agenda for the next , 2005 .

[60]  Robert Johnston,et al.  ‘Good enough’ performance measurement: a trade-off between activity and action , 2002, J. Oper. Res. Soc..

[61]  Salvatore T. March,et al.  Design and natural science research on information technology , 1995, Decis. Support Syst..

[62]  J. Theron Dying for information? An investigationinto the effects of information overloadin the UK and worldwide , 2014 .

[63]  Christian Hofmann,et al.  Controlling: Konzeption, Aufgaben, Instrumente , 2013 .

[64]  Stefan Strecker,et al.  MetricM: a modeling method in support of the reflective design and use of performance measurement systems , 2012, Inf. Syst. E Bus. Manag..

[65]  Jared L. Cohon,et al.  Multiobjective programming and planning , 2004 .

[66]  Errol R. Iselin,et al.  Multi-perspective performance reporting and organisational performance: The impact of information, data and redundant cue load , 2010 .

[67]  Shlomo Globerson,et al.  Issues in developing a performance criteria system for an organization , 1985 .

[68]  David Arnott,et al.  Decision Support Systems Failure , 2008 .

[69]  J. Sweller Evolution of human cognitive architecture , 2003 .

[70]  W. Greene,et al.  计量经济分析 = Econometric analysis , 2009 .

[71]  Steve Mason,et al.  Towards a definition of a business performance measurement system , 2007 .

[72]  Andy Neely,et al.  A framework of the factors affecting the evolution of performance measurement systems , 2002 .

[73]  Robert Libby,et al.  Accounting and human information processing : theory and applications , 1981 .

[74]  Peter A. O'Donnell,et al.  Executive information systems development in an emerging economy , 2007, Decis. Support Syst..

[75]  Taylor Randall,et al.  Performance Implications of Strategic Performance Measurement in Financial Services Firms , 2003 .

[76]  Sai S. Nudurupati,et al.  State of the art literature review on performance measurement , 2011, Comput. Ind. Eng..

[77]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[78]  Michael L. Tushman,et al.  Information Processing as an Integrating Concept in Organizational Design. , 1978 .

[79]  R. Eccles The performance measurement manifesto. , 1991, Harvard business review.

[80]  Chris Caplice,et al.  A Review and Evaluation of Logistics Performance Measurement Systems , 1995 .

[81]  Samir Chatterjee,et al.  A Design Science Research Methodology for Information Systems Research , 2008 .

[82]  Andrew P. Sage,et al.  A Systems Management Approach for Improvement of Organizational Performance Measurement Systems , 2000, Inf. Knowl. Syst. Manag..

[83]  Maximilian Röglinger,et al.  Research Gap and Contribution to Economically Well-Founded Decisions in Process Management , 2011 .

[84]  D. Kleinbaum,et al.  Applied Regression Analysis and Other Multivariate Methods , 1978 .

[85]  Peter C. Fishburn,et al.  Utility theory for decision making , 1970 .

[86]  Herman Aguinis Performance Management , 2005 .