Knowledge management performance evaluation: a decade review from 1995 to 2004

In this paper, the development of knowledge management (KM) was surveyed, using a literature review and classification of articles from 1995 to 2004. With a keyword index and article abstract, we explored how KM performance evaluation has developed during this period. Based on a scope of 108 articles from 80 academic KM journals (retrieved from six online databases), we surveyed and classified methods of KM measurement, using the following eight categories: qualitative analysis, quantitative analysis, financial indicator analysis, non-financial indicator analysis, internal performance analysis, external performance analysis, project-orientated analysis and organizationorientated analysis, together with their measurement matrices for different research and problem domains. Future development directions for KM performance evaluation are presented in our discussion. They include: (1) KM performance measurements have tended towards expertise orientation, while evaluation development is a problemorientated domain; (2) different information technology methodologies, such as expert systems, knowledge-based systems and case-based reasoning may be able to evaluate KM as simply another methodology; (3) the ability to continually change and obtain new understanding is the driving power behind KM methodologies, and should be the basis of KM performance evaluations in the future.

[1]  Brian DosSantos,et al.  Justifying Investments in New Information Technologies , 1991, J. Manag. Inf. Syst..

[2]  G. Walsham.  Knowledge Management:: The Benefits and Limitations of Computer Systems , 2001 .

[3]  Anthony K.P. Wensley,et al.  Chapter 5 – Tools for Knowledge Management , 2000 .

[4]  R. Kordupleski,et al.  Building and deploying profitable growth strategies based on the waterfall of customer value added , 1997 .

[5]  Michael Quinn Patton,et al.  Evaluation, Knowledge Management, Best Practices, and High Quality Lessons Learned , 2001 .

[6]  B. Nardi.  Context and consciousness: activity theory and human-computer interaction , 1995 .

[7]  S. Newell,et al.  Social practices and the management of knowledge in project environments , 2003 .

[8]  T. Kuhn,et al.  The Structure of Scientific Revolutions. , 1964 .

[9]  Robert DeFillippi,et al.  Introduction: Project-Based Learning, Reflective Practices and Learning , 2001 .

[10]  John M. Silvester,et al.  The Social Life of Information: Brown, J.S., & Duguid, P. (2000). Cambridge, MA: Harvard Business School Publishing. ISBN 0-87584-762-5. 320 pages , 2000, Internet High. Educ..

[11]  Silvia Massa,et al.  Innovation or imitation , 2004 .

[12]  Clyde W. Holsapple,et al.  Transferring auditors?? internal control evaluation knowledge to management , 2001, Expert Syst. Appl..

[13]  R. Calantone,et al.  Learning orientation, firm innovation capability, and firm performance , 2002 .

[14]  Alfred Taudes,et al.  Software Growth Options , 1998, J. Manag. Inf. Syst..

[15]  Karl-Heinz Leitner,et al.  Managing and reporting knowledge-based resources and processes in research organisations: specifics, lessons learned and perspectives , 2004 .

[16]  Sue Newell,et al.  The paradox of social capital: structural, cognitive and relational dimensions , 2005 .

[17]  R. Kaplan,et al.  The balanced scorecard--measures that drive performance. , 2015, Harvard business review.

[18]  D. Larcker,et al.  Are nonfinancial measures leading indicators of financial performance? An analysis of customer satisfaction , 1998 .

[19]  D. Longbottom,et al.  Excellence in knowledge management: an empirical study to identify critical factors and performance measures , 2003 .

[20]  J. Brown,et al.  Bridging epistemologies: The generative dance between organizational knowledge and organizational knowing , 1999, STUDI ORGANIZZATIVI.

[21]  Roger J. Calantone,et al.  Tacit knowledge transfer and firm innovation capability , 2003 .

[22]  Robert J. Kauffman,et al.  Justifying Electronic Banking Network Expansion Using Real Options Analysis , 2000, MIS Q..

[23]  ChenMu-Yen,et al.  Knowledge management performance evaluation , 2006 .

[24]  I. Nonaka,et al.  The Knowledge Creating Company , 2008 .

[25]  M. Sinclair,et al.  Project-based learning. , 1998, NT learning curve.

[26]  Dorothy E. Leidner,et al.  Studying Knowledge Management in Information Systems Resarch: Discourses and Theoretical Assumptions , 2002, MIS Q..

[27]  Pervaiz K. Ahmed,et al.  Measurement practice for knowledge management , 1999 .

[28]  Mark E. Van Buren.  A yardstick for knowledge management , 1999 .

[29]  Robert Nelson,et al.  Knowledge management: issues, challenges and opportunities for governments in the new economy , 2002, Proceedings of the 35th Annual Hawaii International Conference on System Sciences.

[30]  Jinette de Gooijer,et al.  Designing a knowledge management performance framework , 2000, J. Knowl. Manag..

[31]  Belén Villalonga.  Intangible resources, Tobin's q, and sustainability of performance differences , 2004 .

[32]  William Margrabe.  The Value of an Option to Exchange One Asset for Another , 1978 .

[33]  Eric Stein,et al.  A knowledge-based system to improve the quality and efficiency of titanium melting , 2003, Expert Syst. Appl..

[34]  Eric W. Stein,et al.  A knowledge-based system to assist university administrators in meeting disability act requirements , 2001, Expert Syst. Appl..

[35]  Jay Liebowitz,et al.  A set of frameworks to aid the project manager in conceptualizing and implementing knowledge management initiatives , 2003 .

[36]  B. Lev.  Intangibles: Management, Measurement, and Reporting , 2001 .

[37]  Jan Mouritsen,et al.  Multiple integrated performance management systems: IC and BSC in a software company , 2002 .

[38]  S. Ross,et al.  Option pricing: A simplified approach☆ , 1979 .

[39]  K. Wiig.  Knowledge management: Where did it come from and where will it go? , 1997 .

[40]  L. Edvinsson.  Developing intellectual capital at Skandia , 1997 .

[41]  Yao Min,et al.  Methodology on knowledge management , 2004 .

[42]  H. Tsoukas.  The firm as a distributed knowledge system : A constructionist approach , 1996 .

[43]  R. Grant.  Chapter 8 – Prospering in Dynamically-Competitive Environments: Organizational Capability as Knowledge Integration , 1999 .

[44]  Bernard Marr,et al.  Measuring and benchmarking intellectual capital , 2004 .

[45]  B. Rubenstein-Montano,et al.  A systems thinking framework for knowledge management , 2001, Decis. Support Syst..

[46]  W. T. Bush,et al.  The Intangibles of Management , 1980 .

[47]  Tony Holden,et al.  From knowledge theory to management practice: towards an integrated approach , 2001, Inf. Process. Manag..

[48]  Rudy L. Ruggles,et al.  Knowledge Management Tools , 1996 .

[49]  Helen Hasan,et al.  Support for the sense-making activity of managers , 2001, Decis. Support Syst..

[50]  Robert M. Davison,et al.  The balanced scorecard: a foundation for the strategic management of information systems , 1999, Decis. Support Syst..

[51]  Wim Van Grembergen,et al.  An audit of IT outsourcing: a case study , 1997 .

[52]  B. V. D. Hooff,et al.  Foundations and Applications of a Knowledge Management Scan , 2003 .

[53]  H. Raghav Rao,et al.  A knowledge management perspective to evaluation of enterprise information portals , 2002 .

[54]  C. Anumba,et al.  A CLEVER approach to selecting a knowledge management strategy , 2002 .

[55]  Salleh Yahya,et al.  Managing human resources toward achieving knowledge management , 2002, J. Knowl. Manag..

[56]  Robert J. Kauffman,et al.  A Case for Using Real Options Pricing Analysis to Evaluate Information Technology Project Investments , 1999, Inf. Syst. Res..

[57]  Wim Van Grembergen,et al.  Audit Guidelines for IT Outsourcing , 2000 .

[58]  Bonnie A. Nardi,et al.  Information Ecologies: Using Technology with Heart , 1999 .

[59]  Alea M. Fairchild.  Knowledge management metrics via a balanced scorecard methodology , 2002, Proceedings of the 35th Annual Hawaii International Conference on System Sciences.

[60]  John Seely Brown,et al.  Book Reviews : The Social Life of Information By John Seely Brown and Paul Duguid. Boston: Harvard Business School Press, 2000. 320 pages , 2000 .

[61]  R. Kaplan,et al.  Using the balanced scorecard as a strategic management system , 1996 .

[62]  Dorothy E. Leidner,et al.  Review: Knowledge Management and Knowledge Management Systems: Conceptual Foundations and Research Issues , 2001, MIS Q..

[63]  Jae-Hyeon Ahn,et al.  Assessing the contribution of knowledge to business performance: the KP3 methodology , 2004, Decis. Support Syst..

[64]  Wing Bun Lee,et al.  Benchmarking the role‐modification process for successful knowledge transfer , 2004 .

[65]  I. Nonaka.  A Dynamic Theory of Organizational Knowledge Creation , 1994 .

[66]  H. D. Thomas,et al.  SUCCESSFUL KNOWLEDGE MANAGEMENT PROJECTS , 1998 .

[67]  Matti Vartiainen,et al.  Managing knowledge and knowledge competences in projects and project organisations , 2003 .

[68]  Mike Gregory,et al.  Bridging islands of knowledge: a framework of knowledge sharing mechanisms , 2003, Int. J. Technol. Manag..

[69]  Michel Mitri,et al.  Applying tacit knowledge management techniques for performance assessment , 2003, Comput. Educ..

[70]  Ajit Kambil,et al.  Strategic management of information technology investments: an options perspective , 2015 .

[71]  Summer E. Bartczak,et al.  The development of an instrument to measure readiness for knowledge management , 2004, 37th Annual Hawaii International Conference on System Sciences, 2004. Proceedings of the.

[72]  R. Kaplan,et al.  PUTTING THE BALANCED SCORECARD TO WORK , 1993 .

[73]  Peter Tyndale.  A taxonomy of knowledge management software tools: origins and applications , 2002 .

[74]  Matti Vartiainen,et al.  Learning project model and transfer of experiences , 1999 .

[75]  R. Ruggles,et al.  Tools for Knowledge Management: An Introduction , 1996 .

[76]  Hiok Chai Quek,et al.  GenSo-EWS: a novel neural-fuzzy based early warning system for predicting bank failures , 2004, Neural Networks.

[77]  Erik Brynjolfsson,et al.  The Matrix of Change , 1997 .

[78]  Morten Hertzum,et al.  The importance of trust in software engineers' assessment and choice of information sources , 2002, Inf. Organ..

[79]  Mu-Yen Chen,et al.  Integrating option model and knowledge management performance measures: an empirical study , 2005, J. Inf. Sci..

[80]  C. P. Goodman,et al.  The Tacit Dimension , 2003 .

[81]  J. Liebowitz.  Key ingredients to the success of an organization's knowledge management strategy , 1999 .

[82]  Shu-Hsien Liao,et al.  Knowledge management technologies and applications - literature review from 1995 to 2002 , 2003, Expert Syst. Appl..

[83]  Francisco Javier Carrillo,et al.  Capital cities: a taxonomy of capital accounts for knowledge cities , 2004, J. Knowl. Manag..

[84]  Chun Wei Choo,et al.  The knowing organization , 2005 .

[85]  Jonathan D. Pemberton,et al.  Benchmarking and the role of organizational learning in developing competitive advantage , 2001 .

[86]  C. Jackson.  Process to product: creating tools for knowledge management , 2001 .

[87]  K. Kuutti.  Activity theory as a potential framework for human-computer interaction research , 1995 .

[88]  Alfred Taudes,et al.  Options Analysis of Software Platform Decisions: A Case Study , 2000, MIS Q..

[89]  Manuel Trajtenberg,et al.  Market Value and Patent Citations: A First Look , 2000 .

[90]  Ulf Johanson,et al.  Measuring to understand intangible performance drivers , 2001 .

[91]  Martin Smits,et al.  Measuring knowledge management effectiveness in communities of practice , 2004, 37th Annual Hawaii International Conference on System Sciences, 2004. Proceedings of the.