Juggling with Information Sources, Task Type, and Information Quality

This paper examines how individuals judge the accuracy, adequacy, relevance, and trustworthiness of different types of impersonal and interpersonal information sources and how task type influences their evaluation process. 53 participants from diverse backgrounds recruited via Amazon»s Mechanical Turk performed four simulated information seeking tasks. This study analyzed the data collected from participants» self-reported information seeking experiences in online logbooks and follow-up semi-structured interviews with 23 participants by applying both qualitative and quantitative methods. The findings suggest that task type and information source type affect individuals» information quality judgment, and they perceive websites are more accurate than interpersonal sources, though the latter can be trustworthy. Moreover, their understanding of the type of information also affects their quality judgment. For example, they prefer factual information to opinions in some situations.

[1]  Hong Xie,et al.  Patterns between interactive intentions and information-seeking strategies , 2002, Inf. Process. Manag..

[2]  Daniel Burton Shank,et al.  Using Crowdsourcing Websites for Sociological Research: The Case of Amazon Mechanical Turk , 2016 .

[3]  Kyung-Sun Kim,et al.  Selecting quality sources: Bridging the gap between the perception and use of information sources , 2011, J. Inf. Sci..

[4]  Katriina Byström,et al.  Information and information sources in tasks of varying complexity , 2002, J. Assoc. Inf. Sci. Technol..

[5]  Chirag Shah,et al.  Exploring collaborative work among graduate students through the C5 model of collaboration: A diary study , 2016, J. Inf. Sci..

[6]  S. Ashford,et al.  Feedback-Seeking in Individual Adaptation: A Resource Perspective , 1986 .

[7]  E. Morrison,et al.  Newcomer information seeking: Exploring types, modes, sources, and outcomes. , 1993 .

[8]  Harry Bruce Emerging frameworks and methods : CoLIS4 : proceedings of the Fourth International Conference on Conceptions of Library and Information Science, Seattle, WA, USA, July 21-25, 2002 , 2002 .

[9]  Patricia A Iannuzzi Information Literacy Competency Standards for Higher Education , 2000 .

[10]  Soo Young Rieh Judgment of information quality and cognitive authority in the Web , 2002, J. Assoc. Inf. Sci. Technol..

[11]  Ingrid Hsieh-Yee Research on Web Search Behavior. , 2001 .

[12]  Nicholas J. Belkin,et al.  The cognitive viewpoint in information science , 1990, J. Inf. Sci..

[13]  Nicholas J. Belkin,et al.  An Overview of Results from Rutgers' Investigations of Interactive Information Retrieval , 1998 .

[14]  Thomas D. Wilson,et al.  Human Information Behavior , 2000, Informing Sci. Int. J. an Emerg. Transdiscipl..

[15]  T. Allen,et al.  Criteria used by research and development engineers in the selection of an information source. , 1968, The Journal of applied psychology.

[16]  Chirag Shah,et al.  Investigating relations of information seeking outcomes to the selection and use of information sources , 2017, ASIST.

[17]  Andrew P. Hardy The selection of channels when seeking information: Cost/benefit vs least-effort , 1982, Inf. Process. Manag..

[18]  Luanne Freund,et al.  Assigning search tasks designed to elicit exploratory search behaviors , 2012, HCIR '12.

[19]  Charles A. O'Reilly,et al.  Variations in Decision Makers' Use of Information Sources: The Impact of Quality and Accessibility of Information. , 1980 .

[20]  Chirag Shah,et al.  Investigating failures in information seeking episodes , 2017, Aslib J. Inf. Manag..

[21]  Mary J. Culnan,et al.  The dimensions of perceived accessibility to information: Implications for the delivery of information systems and services , 1985, J. Am. Soc. Inf. Sci..

[22]  N. Roberts,et al.  Value-added processes in information systems , 1986 .

[23]  Marc H. Anderson,et al.  Sources of Managers' Knowledge of Organizational Capabilities , 2000 .

[24]  Reijo Savolainen,et al.  Information seeking and searching strategies as plans and patterns of action: A conceptual analysis , 2016, J. Documentation.

[25]  Tobias Höllerer,et al.  Believe it or not? Analyzing information credibility in microblogs , 2015, 2015 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[26]  Soo Young Rieh,et al.  Interaction on the Web: Scholars' Judgment of Information Quality and Cognitive Authority , 2000 .

[27]  Emine Yilmaz,et al.  Crowdsourcing interactions: using crowdsourcing for evaluating interactive information retrieval systems , 2012, Information Retrieval.

[28]  David Ellis,et al.  A Behavioural Approach to Information Retrieval System Design , 1989, J. Documentation.

[29]  Brian S. Butler,et al.  Determinants of the Use of Relational and Nonrelational Information Sources , 2007, J. Manag. Inf. Syst..

[30]  Naresh Kumar Agarwal,et al.  A context-based investigation into source use by information seekers , 2011, J. Assoc. Inf. Sci. Technol..

[31]  Siddharth Suri,et al.  Conducting behavioral research on Amazon’s Mechanical Turk , 2010, Behavior research methods.

[32]  Yang Lin,et al.  The relationship between perceived value and information source use during KM strategic decision-making: A study of 17 Chinese business managers , 2014, Inf. Process. Manag..

[33]  Raya Fidel,et al.  The many faces of accessibility: engineers' perception of information sources , 2004, Inf. Process. Manag..

[34]  David J. Hauser,et al.  Attentive Turkers: MTurk participants perform better on online attention checks than do subject pool participants , 2015, Behavior Research Methods.

[35]  Li Yang,et al.  Who will you ask? An empirical study of interpersonal task information seeking , 2006 .

[36]  N. Belkin,et al.  A classification of interactions with information , 2002 .

[37]  Nicholas J. Belkin,et al.  Braque: Design of an Interface to Support User Interaction in Information Retrieval , 1993, Inf. Process. Manag..

[38]  Ralph Katz,et al.  Managing Professionals in Innovative Organizations: A Collection of Readings. , 1990 .

[39]  Reijo Savolainen,et al.  Source preferences in the context of seeking problem-specific information , 2008, Inf. Process. Manag..

[40]  Soo Young Rieh Credibility and Cognitive Authority of Information , 2010 .

[41]  Yan Zhang,et al.  The influence of individual differences on consumer's selection of online sources for health information , 2017, Comput. Hum. Behav..

[42]  Soo Young Rieh Judgement of information quality and cognitive authority in the Web , 2002 .

[43]  Nicholas J. Belkin,et al.  A faceted approach to conceptualizing tasks in information seeking , 2008, Inf. Process. Manag..

[44]  Thomas E. Pinelli,et al.  An investigation of factors affecting how engineers and scientists seek information , 2001 .