Effort-Accuracy Trade-Off in Using Knowledge Management Systems

To solve complicated problems, people often seek input from others. Knowledge management systems (KMSs) provide help in this activity by offering a computer-mediated approach to information sharing. However, if the KMS contains content that is obsolete or incomplete, those using the system may expend greater amounts of effort to detect what content is worthwhile or they risk relying on poor inputs, which may lead to less accurate solutions to their problems. As a result, most KMSs include rating schemes as part of the user interface designed to help those using the system identify high-quality content. Rating schemes depend on current users rating the quality of the existing content, guiding subsequent users in future content searches. If specific ratings are low in validity, then they may not reflect the true content quality (unintentionally or intentionally). This chapter provides a robust summary of the KMS literature and draws on the effort-accuracy trade-off framework to offer the results of a research study. The research study examines how rating validity influences how KMS users employ their limited cognitive resources to search and evaluate KMS content, with the goal of finding and using the highest-quality content. Through an experimental design, the study described herein manipulates rating validity and content quality in a replicated KMS setting and examines how users trade off search and evaluation effort. The results of the study demonstrate that rating validity differentially influences how KMS search and evaluation effort relates to decision accuracy. The chapter concludes with a discussion of the study findings and ideas for future research. Chapter 7.20 Effort-Accuracy TradeOff in Using Knowledge Management Systems

[1]  Ritu Agarwal,et al.  Are Individual Differences Germane to the Acceptance of New Information Technologies , 1999 .

[2]  Jen-Her Wu,et al.  An organizational memory information systems success model: an extension of DeLone and McLean's I/S success model , 1998, Proceedings of the Thirty-First Hawaii International Conference on System Sciences.

[3]  Jacquelyn A. Burkell,et al.  Believe it or not: Factors influencing credibility on the Web , 2002, J. Assoc. Inf. Sci. Technol..

[4]  I. M. Jawahar,et al.  The Influence of Dispositional Factors and Situational Constraints on End User Performance: A Replication and Extension , 2002, J. Organ. End User Comput..

[5]  John W. Payne,et al.  The adaptive decision maker: Name index , 1993 .

[6]  John Riedl,et al.  Is seeing believing?: how recommender system interfaces affect users' opinions , 2003, CHI '03.

[7]  Steve Clarke,et al.  End-user Computing: Concepts, Methodologies, Tools and Applications , 2008 .

[8]  Arnold Kamis,et al.  Search Strategies in Shopping Engines: An Experimental Investigation , 2006, Int. J. Electron. Commer..

[9]  Sirkka L. Jarvenpaa,et al.  The effect of task demands and graphical format on information processing strategies , 1989 .

[10]  David L. Paul,et al.  Collaborative Activities in Virtual Settings: A Knowledge Management Perspective of Telemedicine , 2006, J. Manag. Inf. Syst..

[11]  Chrysanthos Dellarocas,et al.  The Digitization of Word-of-Mouth: Promise and Challenges of Online Feedback Mechanisms , 2003, Manag. Sci..

[12]  Christian D. Schunn,et al.  Peer-based computer-supported knowledge refinement: an empirical investigation , 2008, CACM.

[13]  Pi-Sheng Deng,et al.  Applying a Market-Based Approach to the Development of a Sharing-Enabled KM Model for Knowledge-Intensive Small Firms , 2008, Inf. Syst. Manag..

[14]  Xiaowen Fang.  A Hierarchical Search History for Web Searching , 2000, Int. J. Hum. Comput. Interact..

[15]  Eric J. Johnson,et al.  The adaptive decision maker , 1993 .

[16]  C. J. van Rijsbergen,et al.  Incorporating user search behavior into relevance feedback , 2003, J. Assoc. Inf. Sci. Technol..

[17]  P. Todd,et al.  Simple Heuristics That Make Us Smart , 1999 .

[18]  Viswanath Venkatesh,et al.  Why Don't Men Ever Stop to Ask for Directions? Gender, Social Influence, and Their Role in Technology Acceptance and Usage Behavior , 2000, MIS Q..

[19]  Izak Benbasat,et al.  Exploring Meta-Knowledge for Knowledge Management Systems: A Delphi Study , 2003, ICIS.

[20]  Sharon Swee-Lin Tan,et al.  Contribution Behaviors in Distributed Environments , 2008, MIS Q..

[21]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[22]  Ryen W. White,et al.  An implicit feedback approach for interactive information retrieval , 2006, Inf. Process. Manag..

[23]  Stefano Mizzaro,et al.  Strategic help in user interfaces for information retrieval , 2002, J. Assoc. Inf. Sci. Technol..

[24]  Marc L. Resnick,et al.  Perceptions of Customer Service, Information Privacy, and Product Quality From Semiotic Design Features in an Online Web Store , 2003, Int. J. Hum. Comput. Interact..

[25]  Judy E. Scott,et al.  Effective Knowledge Management Systems for a Clinical Nursing Setting , 2007, Inf. Syst. Manag..

[26]  Lori N. K. Leonard,et al.  Website Retailing: Electronic Supply Chain Replenishment , 2003, J. Organ. End User Comput..

[27]  Ali F. Farhoomand,et al.  Managerial information overload , 2002, CACM.

[28]  David Gefen,et al.  TAM or Just Plain Habit: A Look at Experienced Online Shoppers , 2003, J. Organ. End User Comput..

[29]  John W. Payne,et al.  Contingent decision behavior. , 1982 .

[30]  Michael Frese,et al.  The Impact of Mental Fatigue on Exploration in a Complex Computer Task: Rigidity and Loss of Systematic Strategies , 2003, Hum. Factors.

[31]  Andrew Dillon,et al.  HCI and MIS: shared concerns , 2003, Int. J. Hum. Comput. Stud..

[32]  Mark Easterby-Smith,et al.  Dynamic capabilities and the role of organizational knowledge: an exploration , 2006, Eur. J. Inf. Syst..

[33]  B. J. Fogg,et al.  The elements of computer credibility , 1999, CHI '99.

[34]  Alexandra Durcikova,et al.  The Role of Knowledge Repositories in Technical Support Environments: Speed Versus Learning in User Performance , 2005, J. Manag. Inf. Syst..

[35]  Milton D. Rosenau,et al.  Successful Project Management: A Step-by-Step Approach with Practical Examples , 1981 .

[36]  L. Festinger,et al.  A Theory of Cognitive Dissonance , 2017 .

[37]  Jinwoo Kim,et al.  Contextual Navigation Aids for Two World Wide Web Systems , 2000, Int. J. Hum. Comput. Interact..

[38]  Jonathan Lazar,et al.  Training Novice Users in Developing Strategies for Responding to Errors When Browsing the Web , 2003, Int. J. Hum. Comput. Interact..

[39]  Thomas P. Moran,et al.  Introduction to This Special issue on Context in Design , 1994, Hum. Comput. Interact..

[40]  Diane M. Strong,et al.  Beyond Accuracy: What Data Quality Means to Data Consumers , 1996, J. Manag. Inf. Syst..

[41]  George M. Wyner,et al.  Process Coordination Requirements: Implications for the Design of Knowledge Management Systems , 2006, J. Comput. Inf. Syst..

[42]  Amrit Tiwana,et al.  Knowledge integration in virtual teams: The potential role of KMS , 2002, J. Assoc. Inf. Sci. Technol..

[43]  Petter Gottschalk,et al.  Research Propositions for Knowledge Management Systems Supporting it Outsourcing Relationships , 2006, J. Comput. Inf. Syst..

[44]  Martine R. Haas,et al.  Knowledge Gathering, Team Capabilities, and Project Performance in Challenging Work Environments , 2006, Manag. Sci..

[45]  R. Hogarth,et al.  BEHAVIORAL DECISION THEORY: PROCESSES OF JUDGMENT AND CHOICE , 1981 .

[46]  Morten T. Hansen,et al.  Competing for Attention in Knowledge Markets: Electronic Document Dissemination in a Management Consulting Company , 2001 .

[47]  William J. Kettinger,et al.  An Evolutionary Information-Processing Theory of Knowledge Creation , 2006, J. Assoc. Inf. Syst..

[48]  Mark E. Nissen,et al.  Dynamic Knowledge Patterns to Inform Design: A Field Study of Knowledge Stocks and Flows in an Extreme Organization , 2005, J. Manag. Inf. Syst..

[49]  Paul Resnick,et al.  Reputation systems , 2000, CACM.

[50]  Robin S. Poston,et al.  Effective Use of Knowledge Management Systems: A Process Model of Content Ratings and Credibility Indicators , 2005, MIS Q..

[51]  Wayne D. Hoyer,et al.  Evaluation Strategies of American and Thai Consumers , 1994 .

[52]  S. Sacchi,et al.  Strategies in the Information Search Process: Interaction Among Task Structure, Knowledge, and Source , 2008, The Journal of general psychology.

[53]  Mary C. Jones,et al.  Organizational Knowledge Sharing in ERP Implementation: Lessons from Industry , 2004, J. Organ. End User Comput..

[54]  Soon-Young Huh,et al.  Intelligent Search for Experts Using Fuzzy Abstraction Hierarchy in Knowledge Management Systems , 2007, J. Database Manag..

[55]  V. Garkavenko,et al.  ICT and the Travel Industry: Opportunities and Challenges for New Zealand Travel Agents , 2007 .

[56]  Robert W. Zmud,et al.  Inducing Sensitivity to Deception in Order to Improve Decision Making Performance: A Field Study , 2002, MIS Q..

[57]  Vladimir Zwass,et al.  Actualizing Organizational Memory with Information Systems , 1995, Inf. Syst. Res..

[58]  Carolyn Watters,et al.  Dictionary of Information Science and Technology , 1992 .

[59]  Shelly Chaiken,et al.  A heuristic‐systematic processing analysis of the effectiveness of product warning labels , 1998 .

[60]  Arnold Kamis,et al.  Parametric search engines: What makes them effective when shopping online for differentiated products? , 2006, Inf. Manag..

[61]  James D. Campbell,et al.  Introducing Computer-Based Telemedicine in Three Rural Missouri Counties , 2001, J. Organ. End User Comput..

[62]  C. Cramton.  The Mutual Knowledge Problem and Its Consequences for Dispersed Collaboration , 2001 .

[63]  T. Davenport,et al.  The attention economy: understanding the new currency of business [Book Review] , 2001, IEEE Engineering Management Review.

[64]  Don N. Kleinmuntz,et al.  Information Displays and Decision Processes , 1993 .

[65]  Shouhong Wang.  Business Software Specifications for Consumers: Toward a Standard Format , 2005, J. Organ. End User Comput..

[66]  Emmanuel Udoh.  Database Integration in the Grid Infrastructure , 2009, Database Technologies: Concepts, Methodologies, Tools, and Applications.

[67]  Bella M. DePaulo,et al.  Can Deception by Salespersons and Customers Be Detected Through Nonverbal Behavioral Cues?1 , 1989 .

[68]  E. Harmon-Jones,et al.  Cognitive dissonance: Progress on a pivotal theory in social psychology. , 1999 .

[69]  Mu-Yen Chen,et al.  Comparing with your main competitor: the single most important task of knowledge management performance measurement , 2007, J. Inf. Sci..

[70]  G Gigerenzer,et al.  Reasoning the fast and frugal way: models of bounded rationality. , 1996, Psychological review.

[71]  Jae-Hyeon Ahn,et al.  Reward systems for intra-organizational knowledge sharing , 2007, Eur. J. Oper. Res..

[72]  Jeffrey L. Whitten,et al.  Systems Analysis and Design Methods , 1986 .

[73]  Pai-Cheng Chu,et al.  The Joint Effects of Effort and Quality on Decision Strategy Choice with Computerized Decision Aids , 2000, Decis. Sci..

[74]  Varun Grover,et al.  General Perspectives on Knowledge Management: Fostering a Research Agenda , 2001, J. Manag. Inf. Syst..

[75]  Brian S. Butler,et al.  Determinants of the Use of Relational and Nonrelational Information Sources , 2007, J. Manag. Inf. Syst..

[76]  Mahesh S. Raisinghani,et al.  Leveraging Objects for Mission-Critical Applications , 1999 .

[77]  Lee Sproull,et al.  What's Mine Is Ours, or Is It? A Study of Attitudes about Information Sharing , 1994, Inf. Syst. Res..

[78]  Paul Compton,et al.  Evolutionary document management and retrieval for specialized domains on the web , 2004, Int. J. Hum. Comput. Stud..

[79]  Ramaraj Palanisamy,et al.  Organizational Culture and Knowledge Management in ERP Implementation: An Empirical Study , 2008, J. Comput. Inf. Syst..

[80]  InduShobha N. Chengalur-Smith,et al.  The Impact of Experience and Time on the Use of Data Quality Information in Decision Making , 2003, Inf. Syst. Res..

[81]  Pratim Datta,et al.  An Agent-Mediated Knowledge-in-Motion Model , 2007, J. Assoc. Inf. Syst..

[82]  Izak Benbasat,et al.  The Use of Explanations in Knowledge-Based Systems: Cognitive Perspective and a Process-Tracing Analysis , 2000, J. Manag. Inf. Syst..

[83]  James Falconer.  Implementing a dynamic corpus management system within a global consulting enterprise , 1999 .

[84]  Thomas R. Kochtanek,et al.  Success Factors in the Implementation of a Collaborative Technology, and Resulting Productivity Improvements in a Small Business: An Exploratory Study , 2004, J. Organ. End User Comput..

[85]  Ben Shneiderman,et al.  Performance Benefits of Simultaneous Over Sequential Menus as Task Complexity Increases , 2000, Int. J. Hum. Comput. Interact..

[86]  Dorothy E. Leidner,et al.  Review: Knowledge Management and Knowledge Management Systems: Conceptual Foundations and Research Issues , 2001, MIS Q..

[87]  Gary Klein,et al.  IT support in manufacturing firms for a knowledge management dynamic capability link to performance , 2007 .

[88]  Donald R. Jones,et al.  The effects of incorporating compensatory choice strategies in Web-based consumer decision support systems , 2007, Decis. Support Syst..

[89]  Alan R. Dennis,et al.  Information foraging on the web: The effects of "acceptable" Internet delays on multi-page information search behavior , 2006, Decis. Support Syst..

[90]  Li-Ling Hsu,et al.  The Impact of Industrial Characteristics and Organizational Climate on KMS and Bip-Taiwan Bioscience Industry , 2006, J. Comput. Inf. Syst..

[91]  Terry Anthony Byrd,et al.  Technology Acceptance and Performance: An Investigation into Requisite Knowledge , 2000, Inf. Resour. Manag. J..

[92]  Yolande E. Chan,et al.  A Delphi study of knowledge management systems: Scope and requirements , 2007, Inf. Manag..

[93]  Mehdi Khosrow-Pour,et al.  Printed at: , 2011 .

[94]  Liam Fahey,et al.  The Eleven Deadliest Sins of Knowledge Management , 1998 .

[95]  Stephen S. Standifird.  Reputation and e-commerce: eBay auctions and the asymmetrical impact of positive and negative ratings , 2001 .

[96]  F. Bookstein,et al.  Two Structural Equation Models: LISREL and PLS Applied to Consumer Exit-Voice Theory: , 1982 .

[97]  Frank Parry,et al.  Success and Pitfalls of Information Technology Management , 2000 .

[98]  M. N. Ravishankar,et al.  Rewarding End-Users for Participating in Organizational KM: A Case Study , 2008 .

[99]  A R Jadad,et al.  Rating health information on the Internet: navigating to knowledge or to Babel? , 1998, JAMA.

[100]  Detmar W. Straub,et al.  Gender Differences in the Perception and Use of E-Mail: An Extension to the Technology Acceptance Model , 1997, MIS Q..

[101]  Wynne W. Chin.  Issues and Opinion on Structural Equation Modeling by , 2009 .

[102]  D. Sandy Staples,et al.  Testing the Technology-to-Performance Chain Model , 2004, J. Organ. End User Comput..

[103]  James A. Thurber,et al.  ACCURACY OF JUDGMENTS OF DECEPTION WHEN AN INTERVIEW IS WATCHED, HEARD, AND READ , 1968 .

[104]  Kyung-Sun Kim,et al.  Implications of User Characteristics in Information Seeking on the World Wide Web , 2001, Int. J. Hum. Comput. Interact..

[105]  W. Orlikowski.  Using Technology and Constituting Structures: A Practice Lens for Studying Technology in Organizations , 2000 .

[106]  Gary J. Cook,et al.  An Empirical Investigation of Information Search Strategies with Implications for Decision Support System Design , 1993 .

[107]  Nancy White.  Click Connect and Coalesce for NGOs: Exploring the Intersection Between Online Networks, CoPs, and Events , 2008 .

[108]  James D. Herbsleb,et al.  Team Knowledge and Coordination in Geographically Distributed Software Development , 2007, J. Manag. Inf. Syst..

[109]  Uday R. Kulkarni,et al.  A Knowledge Management Success Model: Theoretical Development and Empirical Validation , 2006, J. Manag. Inf. Syst..

[110]  Tero Päivärinta,et al.  Implementing enterprise content management: from evolution through strategy to contradictions out-of-the-box , 2006, Eur. J. Inf. Syst..

[111]  Mark A. Musen,et al.  The low availability of metadata elements for evaluating the quality of medical information on the World Wide Web , 1999, AMIA.

[112]  O. Svenson.  Process descriptions of decision making. , 1979 .