Internet-based knowledge acquisition: Task complexity and performance

Internet tools used as knowledge retrieval mechanisms can be beneficial for knowledge acquisition (KA). This study applies the concepts of decisional guidance and restrictiveness to three commonly used tools to predict perceived information overload, task quality, and task speed for tasks that differ in complexity. In an experimental setting we find that less restrictive pull systems (i.e., web directories and Google search) increased quality in high-complexity tasks over more restrictive push systems (i.e., listservs) and lowered perceived information overload in both low- and high-complexity tasks. In low-complexity tasks, subjects using predefined guidance (i.e., listservs and web directories) performed better and faster than those using participative guidance (i.e., Google search). In high-complexity tasks, participative guidance provided lower perceived information overload and higher task quality. Implications for research and practice are discussed. Highlights? In high-complexity tasks, less restrictive pull systems (i.e., web directories and Google search) increased quality and lowered perceived information overload over more restrictive push systems (i.e., listservs). ? In low-complexity tasks less restrictive pull systems lowered perceived information overload. ? In low-complexity tasks, predefined guidance (i.e., listservs and web directories) performed better and faster than those using participative guidance (i.e., Google search). ? In high-complexity tasks, participative guidance provided lower perceived information overload and higher task quality than predefined guidance.

[1]  Stephanie W. Haas Improving the search environment: Informed decision making in the search for statistical information , 2003, J. Assoc. Inf. Sci. Technol..

[2]  Thomas D. Clark,et al.  The Dynamic Structure of Management Support Systems: Theory Development, Research Focus, and Direction , 2007, MIS Q..

[3]  T. D. Wilson,et al.  On conceptual models for information seeking and retrieval research , 2003, Inf. Res..

[4]  Eric J. Johnson,et al.  The adaptive decision maker , 1993 .

[5]  R. Brent Gallupe,et al.  Information Overload: Addressing the Productivity Paradox in Face-to-Face Electronic Meetings , 1999, J. Manag. Inf. Syst..

[6]  Byung-Kwan Lee,et al.  The effect of information overload on consumer choice quality in an on-line environment , 2004 .

[7]  Jshyamanta Hazarika,et al.  Semantic Search of Unstructured Knowledge using Qualitative Analysis , 2008, Int. J. Knowl. Manag..

[8]  Jeffrey K. Liker,et al.  Electronic Meeting Systems: Evidence from a Low Structure Environment , 1992, Inf. Syst. Res..

[9]  Jens Förster,et al.  Speed/accuracy decisions in task performance: Built-in trade-off or separate strategic concerns? , 2003 .

[10]  K. D. Joshi,et al.  A formal knowledge management ontology: Conduct, activities, resources, and influences: Research Articles , 2004 .

[11]  William R. King,et al.  Deriving managerial benefit from knowledge search: A paradigm shift? , 2006, Inf. Manag..

[12]  Mark Conner,et al.  The theory of planned behaviour: Assessment of predictive validity and 'perceived control , 1999 .

[13]  Gregory K. W. K. Chung,et al.  Children's Internet Searching on Complex Problems: Performance and Process Analyses , 1998, J. Am. Soc. Inf. Sci..

[14]  David G. Schwartz,et al.  Codifying collaborative knowledge: using Wikipedia as a basis for automated ontology learning , 2009 .

[15]  Guisseppi A. Forgionne,et al.  Decision Making Support Systems: Achievements and Challenges for the New Decade , 2002 .

[16]  Eric L. Lesser,et al.  Communities of practice and organizational performance , 2001, IBM Syst. J..

[17]  Ilze Zigurs,et al.  Decisional guidance and end-user display choices , 1999 .

[18]  Joseph S. Valacich,et al.  The Influence of Task Interruption on Individual Decision Making: An Information Overload Perspective , 1999 .

[19]  Lee Sproull,et al.  Connections: New Ways of Working in the Networked Organization , 1991 .

[20]  Roy J. Byrd,et al.  Knowledge portals and the emerging digital knowledge workplace , 2001, IBM Syst. J..

[21]  R. Howard Individual differences in expertise development over decades in a complex intellectual domain , 2009, Memory & cognition.

[22]  Nicholas H. Lurie Decision Making in Information-Rich Environments: The Role of Information Structure , 2004 .

[23]  I. A. Newman,et al.  Virtual hierarchies and virtual networks: some lessons from hypermedia usability research applied to the World Wide Web , 1997, Int. J. Hum. Comput. Stud..

[24]  Víctor Pàmies,et al.  Open Directory Project , 2003 .

[25]  K. D. Joshi,et al.  A formal knowledge management ontology: Conduct, activities, resources, andinfluences , 2004, J. Assoc. Inf. Sci. Technol..

[26]  Sanjib Chowdhury,et al.  Ambiguity tolerance and accurate assessment of self-efficacy in a complex decision task , 2009 .

[27]  R. Wood Task complexity: Definition of the construct , 1986 .

[28]  C. Davy,et al.  Recipients: the key to information transfer , 2006 .

[29]  Michael F. Mohageg The Influence of Hypertext Linking Structures on the Efficiency of Information Retrieval , 1992 .

[30]  Xiang Fang,et al.  An empirical study of web site navigation structures' impacts on web site usability , 2007, Decis. Support Syst..

[31]  Betty Vandenbosch,et al.  Information Overload in a Groupware Environment: Now You See It, Now You Don't , 1998, J. Organ. Comput. Electron. Commer..

[32]  Claudio U. Ciborra,et al.  Sharing knowledge across boundaries , 2001, J. Inf. Technol..

[33]  Ali A. Ghorbani,et al.  Toward An Adaptive Web: The State of the Art and Science , 2003 .

[34]  Izak Benbasat,et al.  Interactive Decision Aids for Consumer Decision Making in E-Commerce: The Influence of Perceived Strategy Restrictiveness , 2009, MIS Q..

[35]  Dorothy E. Leidner,et al.  Review: Knowledge Management and Knowledge Management Systems: Conceptual Foundations and Research Issues , 2001, MIS Q..

[36]  L. Kren,et al.  EFFECTS OF UNCERTAINTY, PARTICIPATION, AND CONTROL SYSTEM MONITORING ON THE PROPENSITY TO CREATE BUDGET SLACK AND ACTUAL BUDGET SLACK CREATED , 2003 .

[37]  Myongho Yi Information organization and retrieval using a topic maps-based ontology: Results of a task-based evaluation , 2008 .

[38]  Radhika Santhanam,et al.  The use of a knowledge-based system in conceptual data modeling , 2005, Decis. Support Syst..

[39]  Huaping Chen,et al.  Choice of Knowledge Source in Situations of Equivocality: Impact of Cultural Traits , 2009, PACIS.

[40]  Carol Collier Kuhlthau Inside the Search Process: Information Seeking from the User's Perspective. , 1991 .

[41]  Peter Bruza,et al.  Web searching: A process-oriented experimental study of three interactive search paradigms , 2002, J. Assoc. Inf. Sci. Technol..

[42]  Yogesh Malhotra,et al.  Integrating knowledge management technologies in organizational business processes: getting real time enterprises to deliver real business performance , 2005, J. Knowl. Manag..

[43]  David C. Blair,et al.  Knowledge management: Hype, hope, or help? , 2002, J. Assoc. Inf. Sci. Technol..

[44]  Reijo Savolainen Everyday life information seeking: Approaching information seeking in the context of “way of life” , 1995 .

[45]  Feng Wang,et al.  On the effectiveness of decisional guidance , 1996, Decis. Support Syst..

[46]  D. Campbell Task Complexity: A Review and Analysis , 1988 .

[47]  Zoonky Lee,et al.  Push -Pull: The Information Tug of War A Framework for Information Deliveryand Acquisition Systems Design , 1997 .

[48]  Mark S. Silver,et al.  Decision Support Systems: Directed and Nondirected Change , 1990, Inf. Syst. Res..

[49]  T. D. Wilson,et al.  On user studies and information needs , 2006, J. Documentation.

[50]  Dale L. Goodhue,et al.  Development and Measurement Validity of a Task-Technology Fit Instrument for User Evaluations of Inf , 1998 .

[51]  P. Jason Morrison,et al.  Tagging and searching: Search retrieval effectiveness of folksonomies on the World Wide Web , 2008, Inf. Process. Manag..

[52]  Bijan Fazlollahi,et al.  The Effectiveness of Decisional Guidance: An Empirical Evaluation , 2001, Decis. Sci..

[53]  Izak Benbasat,et al.  Recommendation Agents for Electronic Commerce: Effects of Explanation Facilities on Trusting Beliefs , 2007, J. Manag. Inf. Syst..

[54]  Paul E. Spector,et al.  The Relation of Job Control with Job Strains: A Comparison of Multiple Data Sources , 2005 .

[55]  Mani R. Subramani,et al.  A framework of knowledge management systems: issues and challenges for theory and practice , 2000, ICIS.

[56]  Mark S. Silver On the Design Features of Decision Support Systems: The Role of System Restrictiveness and Decisional Guidance , 2008 .

[57]  Ramesh Sharda,et al.  Development of a fisheye-based information search processing aid (FISPA) for managing information overload in the web environment , 2004, Decis. Support Syst..

[58]  Guisseppi A. Forgionne An architecture for the integration of decision making support functionalities , 2002 .

[59]  Gloria J. Leckie,et al.  Modeling the Information Seeking of Professionals: A General Model Derived from Research on Engineers, Health Care Professionals, and Lawyers , 1996, The Library Quarterly.

[60]  K. D. Joshi,et al.  Knowledge manipulation activities: results of a Delphi study , 2002, Inf. Manag..

[61]  Xiang Fang,et al.  Impacts of navigation structure, task complexity, and users’ domain knowledge on Web site usability—an empirical study , 2011, Inf. Syst. Frontiers.

[62]  Herbert A. Simon,et al.  The new science of management decision , 1960 .

[63]  Donald J. Campbell,et al.  The interactive effects of task complexity and participation on task performance: A field experiment , 1986 .

[64]  Nancy G. Dodd,et al.  The interactive effects of variety, autonomy, and feedback on attitudes and performance , 1996 .

[65]  Mark S. Silver,et al.  Decisional Guidance for Computer-Based Decision Support , 1991, MIS Q..

[66]  Kalervo Järvelin,et al.  Task complexity affects information seeking and use , 1995 .

[67]  Carlin Dowling,et al.  Appropriate Audit Support System Use: The Influence of Auditor, Audit Team and Firm Factors , 2008 .

[68]  Tom Wilson,et al.  Models in Information Behavior Research , 1999 .

[69]  Fred D. Davis,et al.  Computer-Assisted Decision Making: Performance, Beliefs, and the Illusion of Control , 1994 .

[70]  T. D. Wilson,et al.  Models in information behaviour research , 1999, J. Documentation.

[71]  Mark S. Silver,et al.  User Perceptions of Decision Support System Restrictiveness: An Experiment , 1988, J. Manag. Inf. Syst..

[72]  Albert H. Segars,et al.  Knowledge Management: An Organizational Capabilities Perspective , 2001, J. Manag. Inf. Syst..