Re-examining and re-conceptualising enterprise search and discovery capability : towards a model for the factors and generative mechanisms for search task outcomes

Many organizations are trying to re-create the ˜Google experience, to find and exploit their own corporate information. However, there is evidence that finding information in the workplace using search engine technology has remained difficult, with socio-technical elements largely neglected in the literature. Explication of the factors and generative mechanisms (ultimate causes) to effective search task outcomes (user satisfaction, search task performance and serendipitous encountering) may provide a first step in making improvements. A transdisciplinary (holistic) lens was applied to Enterprise Search and Discovery capability, combining critical realism and activity theory with complexity theories to one of the worlds largest corporations. Data collection included an in-situ exploratory search experiment with 26 participants, focus groups with 53 participants and interviews with 87 business professionals. Thousands of user feedback comments and search transactions were analysed. Transferability of findings was assessed through interviews with eight industry informants and ten organizations from a range of industries. A wide range of informational needs were identified for search filters, including a need to be intrigued. Search term word co-occurrence algorithms facilitated serendipity to a greater extent than existing methods deployed in the organization surveyed. No association was found between user satisfaction (or self assessed search expertise) with search task performance and overall performance was poor, although most participants had been satisfied with their performance. Eighteen factors were identified that influence search task outcomes ranging from user and task factors, informational and technological artefacts, through to a wide range of organizational norms. Modality Theory (Cybersearch culture, Simplicity and Loss Aversion bias) was developed to explain the study observations. This proposes that at all organizational levels there are tendencies for reductionist (unimodal) mind-sets towards search capability leading to ˜fixes that fail. The factors and mechanisms were identified in other industry organizations suggesting some theory generalizability. This is the first socio-technical analysis of Enterprise Search and Discovery capability. The findings challenge existing orthodoxy, such as the criticality of search literacy (agency) which has been neglected in the practitioner literature in favour of structure. The resulting multifactorial causal model and strategic framework for improvement present opportunities to update existing academic models in the IR, LIS and IS literature, such as the DeLone and McLean model for information system success. There are encouraging signs that Modality Theory may enable a reconfiguration of organizational mind-sets that could transform search task outcomes and ultimately business performance.

[1]  Jing Jiang,et al.  Information Extraction from Text , 2012, Mining Text Data.

[2]  M. Garbarini,et al.  Improvements in the Management of Structured and Unstructured Data , 2008 .

[3]  C. Oliver,et al.  Critical Realist Grounded Theory: A New Approach for Social Work Research , 2012 .

[4]  David M. McCord,et al.  Taking Personality Seriously , 2013 .

[5]  Steinar Carlsen,et al.  Organizational metaphors as lenses for analyzing workflow technology , 1997, GROUP.

[6]  Stephen Jackson,et al.  Organizational culture and information systems adoption: A three-perspective approach , 2011, Inf. Organ..

[7]  Focus Groups as Qualitative Research PLANNING AND RESEARCH DESIGN FOR FOCUS GROUPS , 2013 .

[8]  Dick Stenmark Identifying clusters of user behavior in intranet search engine log files , 2008, J. Assoc. Inf. Sci. Technol..

[9]  Soohyung Joo,et al.  Effects of topic familiarity and search skills on query reformulation behavior , 2013, ASIST.

[10]  John G Eastwood,et al.  Realist explanatory theory building method for social epidemiology: a protocol for a mixed method multilevel study of neighbourhood context and postnatal depression , 2014, SpringerPlus.

[11]  Diane Kelly,et al.  The effects of topic familiarity on information search behavior , 2002, JCDL '02.

[12]  Philipp Mayr,et al.  Improving Retrieval Results with Discipline-Specific Query Expansion , 2012, TPDL.

[13]  Christopher J. L. Cunningham,et al.  Understanding Business Research , 2012 .

[14]  Tero Päivärinta,et al.  Implementing enterprise content management: from evolution through strategy to contradictions out-of-the-box , 2006, Eur. J. Inf. Syst..

[15]  J. Flavell Metacognition and Cognitive Monitoring: A New Area of Cognitive-Developmental Inquiry. , 1979 .

[16]  D. Tabatabai,et al.  How experts and novices search the Web , 2005 .

[17]  Raymond Caldwell,et al.  Systems Thinking, Organizational Change and Agency: A Practice Theory Critique of Senge's Learning Organization , 2012 .

[18]  Mark W. McElroy,et al.  Integrating complexity theory, knowledge management and organizational learning , 2000, J. Knowl. Manag..

[19]  Sanda Erdelez,et al.  Potential for inclusion of information encountering within information literacy models , 2011, Inf. Res..

[20]  Vivek Kshirsagar,et al.  Topical Clustering of Search Results using Suffix Tree Clustering , 2016 .

[21]  April Ann Lewis Enterprise Users and Web Search Behavior , 2010 .

[22]  T. Garavan,et al.  Team Learning and Metacognition: A Neglected Area of HRD Research and Practice , 2008 .

[23]  M. HamidR.Jamali,et al.  Google and the scholar: the role of Google in scientists' information-seeking behaviour , 2010, Online Inf. Rev..

[24]  A. Onwuegbuzie,et al.  Mixed Methods Research: A Research Paradigm Whose Time Has Come , 2004 .

[25]  Tony Russell-Rose,et al.  A Taxonomy of Enterprise Search , 2011, EuroHCIR.

[26]  Daniele Quercia,et al.  Auralist: introducing serendipity into music recommendation , 2012, WSDM '12.

[27]  Ralf Krestel,et al.  Visual interfaces for stimulating exploratory search , 2011, JCDL '11.

[28]  N. Gage,et al.  The Paradigm Wars and Their Aftermath A “Historical” Sketch of Research on Teaching Since 1989 , 1989 .

[29]  Maria Paz Salmador Sánchez,et al.  Knowledge‐based manufacturing enterprises: evidence from a case study , 2008 .

[30]  Leanne Bowler,et al.  The self-regulation of curiosity and interest during the information search process of adolescent students , 2010 .

[31]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[32]  Ben Shneiderman,et al.  Users can change their web search tactics: Design guidelines for categorized overviews , 2008, Inf. Process. Manag..

[33]  David Meza,et al.  JSC Search System Usability Case Study , 2014 .

[34]  Salvador Garcia,et al.  Organisational Values as 'Attractors of Chaos': An Emerging Cultural Change to Manage Organisational Complexity , 2000 .

[35]  Mark Sanderson,et al.  The effect of user characteristics on search effectiveness in information retrieval , 2011, Inf. Process. Manag..

[36]  Nick Bontis,et al.  A cluster analysis of the KM field , 2009 .

[37]  Min Wang,et al.  Entity centric query expansion for enterprise search , 2012, CIKM '12.

[38]  Louis B. Rosenfeld,et al.  Information architecture for the world wide web - designing large-scale web sites , 1998 .

[39]  Guy Lebanon,et al.  Visualizing Incomplete and Partially Ranked Data , 2008, IEEE Transactions on Visualization and Computer Graphics.

[40]  Lorraine Illingworth,et al.  Knowledge auditing and mapping: a pragmatic approach. , 2004 .

[41]  Adams Js Towards an understanding of inequity , 1963 .

[42]  Richard P. Smiraglia,et al.  Idea Collider: From a theory of knowledge organization to a theory of knowledge interaction , 2011 .

[43]  Adrienne Curry,et al.  Assessing information culture - an exploratory model , 2003, Int. J. Inf. Manag..

[44]  Diane Kelly,et al.  Using information scent and need for cognition to understand online search behavior , 2014, SIGIR.

[45]  Ali Khalili,et al.  conTEXT - Lightweight Text Analytics Using Linked Data , 2014, ESWC.

[46]  James Mahoney,et al.  Review Essay: Beyond Correlational Analysis: Recent Innovations in Theory and Method , 2001 .

[47]  Andrew H. Van de Ven,et al.  Breakdowns in Implementing Models of Organization Change , 2011 .

[48]  Yazdan Mansourian,et al.  Search persistence and failure on the web: a "bounded rationality" and "satisficing" analysis , 2007, J. Documentation.

[49]  Tara Fenwick,et al.  Re‐thinking the “thing”: Sociomaterial approaches to understanding and researching learning in work , 2010 .

[50]  Jon B. Woodroof,et al.  Satisfaction/dissatisfaction: are users predisposed? , 2003, Inf. Manag..

[51]  Paul Hugh Cleverley,et al.  Exploratory information searching in the enterprise: A study of user satisfaction and task performance , 2017, J. Assoc. Inf. Sci. Technol..

[52]  Mark E. Nissen,et al.  Organizational Metacognition: The Importance of Knowing the Knowledge Network , 2007, 2007 40th Annual Hawaii International Conference on System Sciences (HICSS'07).

[53]  Ronald E. Robertson,et al.  The search engine manipulation effect (SEME) and its possible impact on the outcomes of elections , 2015, Proceedings of the National Academy of Sciences.

[54]  Stephen E. Robertson,et al.  Query Expansion with Long-Span Collocates , 2003, Information Retrieval.

[55]  Martin J. Eppler Information quality and information overload: The promises and perils of the information age , 2015 .

[56]  David Ellis,et al.  Modelling the information seeking patterns of engineers and research scientists in an industrial environment , 1997, J. Documentation.

[57]  G. Easton Critical realism in case study research , 2010 .

[58]  Ian Reinhart Enterprise Search Tactics for Expertise Location , 2013 .

[59]  Michael Mackert,et al.  Sharing Health Information and Influencing Behavioral Intentions: The Role of Health Literacy, Information Overload, and the Internet in the Diffusion of Healthy Heart Information , 2016, Health communication.

[60]  Thomas W. Lee,et al.  Qualitative Research in Management: A Decade of Progress , 2011 .

[61]  Phyllis Illari,et al.  Causality: Philosophical Theory meets Scientific Practice , 2014 .

[62]  Shamkant B. Navathe,et al.  Generalized formal models for faceted user interfaces , 2009, JCDL '09.

[63]  Bill V. Liddell,et al.  Virtual File Room - Storage and Retrieval of Electronic Documents , 2003 .

[64]  Melanie Mitchell,et al.  Complexity - A Guided Tour , 2009 .

[65]  Victoria J. Marsick The Dimensions of a Learning Organization Questionnaire (DLOQ) , 2013 .

[66]  Anselm L. Strauss,et al.  Basics of qualitative research : techniques and procedures for developing grounded theory , 1998 .

[67]  Merve Bayramusta,et al.  A fad or future of IT?: A comprehensive literature review on the cloud computing research , 2016, Int. J. Inf. Manag..

[68]  Kalle Pajunen,et al.  The Nature of Organizational Mechanisms , 2008 .

[69]  Patrick Pantel,et al.  From Frequency to Meaning: Vector Space Models of Semantics , 2010, J. Artif. Intell. Res..

[70]  Stan Karanasios,et al.  HOW SHOULD TECHNOLOGY-MEDIATED ORGANIZATIONAL CHANGE BE EXPLAINED ? A COMPARISON OF THE CONTRIBUTIONS OF CRITICAL REALISM AND ACTIVITY THEORY 1 , 2013 .

[71]  Jia Tina Du,et al.  The information journey of marketing professionals: Incorporating work task‐driven information seeking, information judgments, information use, and information sharing , 2014, J. Assoc. Inf. Sci. Technol..

[72]  Paul Solomon,et al.  Looking for Information—A Survey of Research on Information Seeking, Needs, and Behavior , 2003, Information Retrieval.

[73]  Ying Chen,et al.  IBM Watson: How Cognitive Computing Can Be Applied to Big Data Challenges in Life Sciences Research. , 2016, Clinical therapeutics.

[74]  J. Woodward,et al.  Scientific Explanation and the Causal Structure of the World , 1988 .

[75]  A. Maloney Expecting the Unexpected : Serendipity , Discovery , and the Scholarly Research Process , 2016 .

[76]  Brian Detlor,et al.  Working with information: information management and culture in a professional services organization , 2006, J. Inf. Sci..

[77]  Mark Sanderson,et al.  A review of factors influencing user satisfaction in information retrieval , 2010 .

[78]  J. McLeod,et al.  Accelerating positive change in electronic records management: headline findings from a major research project. , 2011 .

[79]  Viktor Larsson,et al.  Why should Organisations Govern Enterprise Search? , 2015, AMCIS.

[80]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[81]  Paul Hugh Cleverley,et al.  Retrieving haystacks: a data driven information needs model for faceted search , 2015, J. Inf. Sci..

[82]  T. D. Wilson,et al.  On user studies and information needs , 2006, J. Documentation.

[83]  Thorsten Joachims,et al.  In Google We Trust: Users' Decisions on Rank, Position, and Relevance , 2007, J. Comput. Mediat. Commun..

[84]  Susan T. Dumais,et al.  Discovery is never by chance: designing for (un)serendipity , 2009, C&C '09.

[85]  Brian L. Connelly,et al.  Managers and Their Not-So Rational Decisions , 2008 .

[86]  Gobinda G. Chowdhury,et al.  Thesaurus-assisted search term selection and query expansion: a review of user-centred studies , 2002 .

[87]  M. de Rijke,et al.  Exploring entity associations over time , 2013, SIGIR 2013.

[88]  Klaus-Dieter Thoben,et al.  Product Lifecycle Management in the Era of Internet of Things , 2015, IFIP Advances in Information and Communication Technology.

[89]  Neil Postman,et al.  Technopoly: The Surrender of Culture to Technology , 1993 .

[90]  T. D. Wilson,et al.  Models in information behaviour research , 1999, J. Documentation.

[91]  Abigail McBirnie,et al.  Seeking serendipity: the paradox of control , 2008, Aslib Proc..

[92]  Nicholas J. Belkin,et al.  An exploration of the relationships between work task and interactive information search behavior , 2010, J. Assoc. Inf. Sci. Technol..

[93]  Frank Martela Fallible Inquiry with Ethical Ends-in-View: A Pragmatist Philosophy of Science for Organizational Research , 2015 .

[94]  Shengnan Han,et al.  Governance of an Enterprise Social Intranet Implementation: The Statkraft Case , 2015, ECIS.

[95]  K. Howe Against the Quantitative-Qualitative Incompatibility Thesis or Dogmas Die Hard , 1988 .

[96]  Lura E. Joseph Information-Seeking and Communication Behavior of Petroleum Geologists , 2001 .

[97]  Gary J. Cook,et al.  An Empirical Investigation of Information Search Strategies with Implications for Decision Support System Design , 1993 .

[98]  William S. Cooper,et al.  A definition of relevance for information retrieval , 1971, Inf. Storage Retr..

[99]  Victor Kaptelinin,et al.  Making HCI theory work: an analysis of the use of activity theory in HCI research , 2016, Behav. Inf. Technol..

[100]  Betsy Palkowsky A New Approach to Information Discovery—Geography Really Does Matter , 2005 .

[101]  John W. Creswell,et al.  Designing and Conducting Mixed Methods Research , 2006 .

[102]  Surajit Chaudhuri Information at your Fingertips: Only a dream for enterprises? , 2015, 2015 IEEE 31st International Conference on Data Engineering.

[103]  Anabel Quan-Haase,et al.  Exploratory search in digital libraries: A preliminary examination of the use and role of interface features , 2015, ASIST.

[104]  R. Armstrong The Long Tail: Why the Future of Business Is Selling Less of More , 2008 .

[105]  William J. Kettinger,et al.  Information Orientation: The Link to Business Performance , 2001 .

[106]  J. D. R. de Raadt,et al.  Ashby's law of requisite variety: an empirical study , 1987 .

[107]  Lydia B. Chilton,et al.  Addressing people's information needs directly in a web search result page , 2011, WWW.

[108]  Rom Harré,et al.  Critical Realism: An Introduction to Roy Bhaskar’s Philosophy , 1997 .

[109]  David Ellis,et al.  A Behavioural Approach to Information Retrieval System Design , 1989, J. Documentation.

[110]  Bohn Stafleu van Loghum,et al.  Online … , 2002, LOG IN.

[111]  Brenda Dervin,et al.  From the mind’s eye of the user: The sense-making qualitative-quantitative methodology. , 1992 .

[112]  Elaine Toms,et al.  How is a search system used in work task completion? , 2013, J. Inf. Sci..

[113]  Ned Kock,et al.  Information Overload: A Decision Making Perspective , 2001 .

[114]  Yujie Liu,et al.  Evaluating exploratory visualization systems: A user study on how clustering-based visualization systems support information seeking from large document collections , 2013, Inf. Vis..

[115]  Aleksi Aaltonen,et al.  Everything counts in large amounts: a critical realist case study on data-based production , 2014, J. Inf. Technol..

[116]  Judit Bar-Ilan,et al.  Folder versus tag preference in personal information management , 2013, J. Assoc. Inf. Sci. Technol..

[117]  Tony Russell-Rose,et al.  Designing the search experience - the information architecture of discovery , 2012 .

[118]  A. Kellerman,et al.  The Constitution of Society : Outline of the Theory of Structuration , 2015 .

[119]  Robert G. Capra,et al.  Creating Exploratory Tasks for a Faceted Search Interface , 2008 .

[120]  Daniel E. Rose,et al.  Understanding user goals in web search , 2004, WWW '04.

[121]  Anne E. James,et al.  Towards the Development of an Integrated Framework for Enhancing Enterprise Search Using Latent Semantic Indexing , 2011, ICCS.

[122]  Ricardo Baeza-Yates,et al.  Modern Information Retrieval - the concepts and technology behind search, Second edition , 2011 .

[123]  Margo I. Seltzer,et al.  Hierarchical File Systems Are Dead , 2009, HotOS.

[124]  Jeffrey Heer,et al.  Refinery: Visual Exploration of Large, Heterogeneous Networks through Associative Browsing , 2015, Comput. Graph. Forum.

[125]  Emilie M. Roth,et al.  Predicting Vulnerabilities in Computer-Supported Inferential Analysis under Data Overload , 2001, Cognition, Technology & Work.

[126]  Charles Howard Candler,et al.  How Do You Solve a Problem Like , 2016 .

[127]  K. Vohs,et al.  Case Western Reserve University , 1990 .

[128]  Herbert A. Simon,et al.  Models of Man: Social and Rational. , 1957 .

[129]  N. Entwistle,et al.  Approaches to Learning and Levels of , 1979 .

[130]  P. Hedström,et al.  Social Mechanisms: An Analytical Approach to Social Theory. , 1999 .

[131]  N. Kano,et al.  Attractive Quality and Must-Be Quality , 1984 .

[132]  Susan P. Williams,et al.  Managing enterprise information: meeting performance and conformance objectives in a changing information environment , 2022, International Journal of Information Systems and Project Management.

[133]  Gloria J. Leckie,et al.  Modeling the Information Seeking of Professionals: A General Model Derived from Research on Engineers, Health Care Professionals, and Lawyers , 1996, The Library Quarterly.

[134]  M. Fisher,et al.  Expectation as a Mediator of User Satisfaction , 2022 .

[135]  Soo Young Rieh,et al.  Cuisine: Classification using stylistic feature sets and-or name-based feature sets , 2010 .

[136]  Matthew Banta,et al.  What do exploratory searchers look at in a faceted search interface? , 2009, JCDL '09.

[137]  Antti Oulasvirta,et al.  When more is less: the paradox of choice in search engine use , 2009, SIGIR.

[138]  Peter Brophy,et al.  Student Searching Behavior and the Web: Use of Academic Resources and Google , 2005, Libr. Trends.

[139]  T. Lombrozo,et al.  Simplicity and probability in causal explanation , 2007, Cognitive Psychology.

[140]  David Bawden,et al.  The dark side of information: overload, anxiety and other paradoxes and pathologies , 2009, J. Inf. Sci..

[141]  Stuart K. Card,et al.  Information foraging in information access environments , 1995, CHI '95.

[142]  Mohand Boughanem,et al.  Evaluation of contextual information retrieval effectiveness: overview of issues and research , 2010, Knowledge and Information Systems.

[143]  Peter Goldschmidt,et al.  Search behaviour in electronic document and records management systems: an exploratory investigation and model , 2013, Inf. Res..

[144]  Yelena Yesha,et al.  Information and knowledge management : expanding the definition of "database" : First International Conference, CIKM '92, Baltimore, Maryland, USA, November 8-11, 1992 : select papers , 1993, CIKM 1993.

[145]  Christina Fang,et al.  The Economics of Strategic Opportunity , 2003 .

[146]  Chun Wei Choo Environmental scanning as information seeking and organizational learning , 2001, Inf. Res..

[147]  Isto Huvila,et al.  Towards information leadership , 2014, Aslib J. Inf. Manag..

[148]  E. Nevis,et al.  Understanding Organizations as Learning Systems , 1995 .

[149]  Michael D. Cooper,et al.  Using clustering techniques to detect usage patterns in a Web-based information system , 2001, J. Assoc. Inf. Sci. Technol..

[150]  Ray Pawson,et al.  The Science of Evaluation: A Realist Manifesto , 2013 .

[151]  W. DeSarbo,et al.  Response Determinants in Satisfaction Judgments , 1988 .

[152]  Simon A. Levin,et al.  The tragedy of cognition: psychological biases and environmental inaction , 2009 .

[153]  Elaine Toms,et al.  Examining the generalizability of the User Engagement Scale (UES) in exploratory search , 2013, Inf. Process. Manag..

[154]  M. Sheelagh T. Carpendale,et al.  The information flaneur: a fresh look at information seeking , 2011, CHI.

[155]  Freddy Winston Castro Explaining Society, Critical Realism in the Social Sciences , 2002 .

[156]  Gediminas Adomavicius,et al.  Context-aware recommender systems , 2008, RecSys '08.

[157]  K. Weick FROM SENSEMAKING IN ORGANIZATIONS , 2021, The New Economic Sociology.

[158]  Annabel Ness Evans,et al.  Methods in Psychological Research , 2007 .

[159]  Olga Vechtomova,et al.  Exploring knowledge graphs for exploratory search , 2014, IIiX.

[160]  Michael M Roy,et al.  Effect of task length on remembered and predicted duration , 2008, Psychonomic bulletin & review.

[161]  Birger Hjørland,et al.  Theory Development in the Information Sciences. Diane H. Sonnenwald. Austin, TX: University of Texas Press, 2016. 343 pp. $90.00 (Hardcover) (ISBN 978-1-4773-0824-0) , 2017, J. Assoc. Inf. Sci. Technol..

[162]  Vijayan Sugumaran,et al.  Natural Language and Information Systems, 13th International Conference on Applications of Natural Language to Information Systems, NLDB 2008, London, UK, June 24-27, 2008, Proceedings , 2008, NLDB.

[163]  Alistair G. Sutcliffe,et al.  Towards a cognitive theory of information retrieval , 1998, Interact. Comput..

[164]  Schubert Foo,et al.  Environmental scanning: An application of information literacy skills at the workplace , 2010, J. Inf. Sci..

[165]  Martin H. Levinson Not by Genes Alone: How Culture Transformed Human Evolution , 2006 .

[166]  Elaine Toms,et al.  Chance Encounters in the Digital Library , 2009, ECDL.

[167]  Gary Marchionini,et al.  Information-Seeking Support Systems [Guest Editors' Introduction] , 2009, Computer.

[168]  Gobinda G. Chowdhury,et al.  Incorporating the results of co-word analyses to increase search variety for information retrieval , 2000, J. Inf. Sci..

[169]  hazel gott Beyond the Beginning: The Global Digital Library , 1997 .

[170]  Karin Laumann,et al.  Safety Management Systems as communication in an oil and gas producing company , 2015 .

[171]  Glenn J. Browne,et al.  Cognitive Stopping Rules for Terminating Information Search in Online Tasks , 2007, MIS Q..

[172]  William R. Shadish,et al.  Critical multiplism: A research strategy and its attendant tactics , 1993 .

[173]  Jody Condit Fagan Usability studies of faceted browsing: A literature review , 2010 .

[174]  Ted Friedman Data Quality Makes the Big Time: How We Got Here, and Why We'll Never Be Done. , 2011 .

[175]  AnnBritt Enochsson A gender perspective on Internet use: consequences for information seeking , 2005, Inf. Res..

[176]  G. Rolfe A critical realist rationale for using a combination of quantitative and qualitative methods , 2006 .

[177]  Reynol Junco,et al.  Comparing actual and self-reported measures of Facebook use , 2013, Comput. Hum. Behav..

[178]  Janet Mancini Billson,et al.  Focus Groups: A Practical Guide for Applied Research , 1989 .

[179]  Kelly Quinn Google and the Culture of Search , 2014 .

[180]  B. Haig An abductive theory of scientific method. , 2005, Psychological methods.

[181]  Alf Inge Wang,et al.  Improving the effectiveness of root cause analysis in post mortem analysis: A controlled experiment , 2009, Inf. Softw. Technol..

[182]  Kathy Butler,et al.  Research Consultation Assessment: Perceptions of Students and Librarians , 2016 .

[183]  J. Eyles,et al.  Developing and Implementing a Triangulation Protocol for Qualitative Health Research , 2006, Qualitative health research.

[184]  Geoffrey S. Hubona,et al.  A Scientific Basis for Rigor in Information Systems Research , 2009, MIS Q..

[185]  J. B. Strother,et al.  Information Overload: An International Challenge for Professional Engineers and Technical Communicators , 2012 .

[186]  J. Ellul The search for ethics in a technicist society , 2004 .

[187]  Gunilla Widén,et al.  Conceptual modelling of workplace information practices: a literature review , 2014, Inf. Res..

[188]  Antoine Saillenfest,et al.  Some Probability Judgments may Rely on Complexity Assessments , 2015, CogSci.

[189]  Sanna Hildén,et al.  Reflective Practice as a Fuel for Organizational Learning , 2013 .

[190]  Charles R. McClure,et al.  Unobtrusive reference testing: the 55 percent rule , 1986 .

[191]  Mimi Swartz,et al.  Power failure : the rise and fall of Enron , 2003 .

[192]  H. Rittel,et al.  Dilemmas in a general theory of planning , 1973 .

[193]  J. Gwizdka,et al.  The role of subjective factors in the information search process , 2009 .

[194]  John Davies,et al.  Information Retrieval: Searching in the 21st Century , 2009, Information Retrieval.

[195]  Dave Elder-Vass Disassembling Actor-network Theory , 2015 .

[196]  Douglas J. Hacker,et al.  Metacognition in educational theory and practice. , 1998 .

[197]  Ephraim R. McLean,et al.  The DeLone and McLean Model of Information Systems Success: A Ten-Year Update , 2003, J. Manag. Inf. Syst..

[198]  Elaine Toms,et al.  Enterprise search behaviour of software engineers , 2006, SIGIR.

[199]  Monica M. C. Schraefel,et al.  Backward highlighting: enhancing faceted search , 2008, UIST '08.

[200]  Anne S. Henly,et al.  Speakers' overestimation of their effectiveness. , 2002, Psychological science.

[201]  Kent J. Crippen,et al.  Promoting Self-Regulation in Science Education: Metacognition as Part of a Broader Perspective on Learning , 2006 .

[202]  T. D. Wilson,et al.  A re-examination of information seeking behaviour in the context of activity theory , 2006, Inf. Res..

[203]  Alexander Serenko,et al.  Factors affecting the adoption of online library resources by business students , 2011, J. Assoc. Inf. Sci. Technol..

[204]  Andrew K. Shenton,et al.  Information behaviour meta‐models , 2012 .

[205]  Chun Wei Choo,et al.  Information culture and information use: An exploratory study of three organizations , 2008, J. Assoc. Inf. Sci. Technol..

[206]  B. Schwartz,et al.  Maximizing Versus Satisficing : Happiness Is a Matter of Choice , 2002 .

[207]  R. B. Woodruff,et al.  Expectations and norms in models of consumer satisfaction. , 1987 .

[208]  Ellen M. Voorhees,et al.  The seventh text REtrieval conference (TREC-7) , 1999 .

[209]  Jannica Heinström,et al.  The impact of personality and approaches to learning on information behaviour , 2000, Inf. Res..

[210]  Heinz Roland Weistroffer,et al.  Journal of Enterprise Information Management Emerald Article : Enterprise content management research : a comprehensive review , 2022 .

[211]  William S. Cooper,et al.  On selecting a measure of retrieval effectiveness , 1973, J. Am. Soc. Inf. Sci..

[212]  Sharon Q. Yang,et al.  Evaluating and comparing discovery tools: how close are we towards next generation catalog? , 2010, Libr. Hi Tech.

[213]  Paul Sparrow,et al.  Strategy and cognition: understanding the role of management knowledge structures, organizational memory and information overload , 1999 .

[214]  M. HamidR.Jamali,et al.  Employing log metrics to evaluate search behaviour and success: case study BBC search engine , 2007, J. Inf. Sci..

[215]  Mathieu Roche,et al.  Information Retrieval in Biomedicine - Natural Language Processing for Knowledge Integration , 2009, Information Retrieval in Biomedicine.

[216]  Kenneth Ward Church,et al.  Word Association Norms, Mutual Information, and Lexicography , 1989, ACL.

[217]  Joi L. Moore,et al.  The search experience variable in information behavior research , 2007 .

[218]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[219]  Carl Rhodes,et al.  After Reflexivity: Ethics, Freedom and the Writing of Organization Studies , 2009 .

[220]  T. Saracevic Relevance: A Review of the Literature and a Framework for Thinking on the Notion in Information Science. Part II , 2006 .

[221]  Dagobert Soergel,et al.  Relevance: An improved framework for explicating the notion , 2013, J. Assoc. Inf. Sci. Technol..

[222]  Terry Ballard,et al.  User search‐limiting behavior in online catalogs , 2011 .

[223]  Sanda Erdelez,et al.  Investigation of information encountering in the controlled research environment , 2004, Inf. Process. Manag..

[224]  Paul Hugh Cleverley,et al.  Creating Sparks: Comparing Search Results Using Discriminatory Search Term Word Co-Occurrence to Facilitate Serendipity in the Enterprise , 2015, J. Inf. Knowl. Manag..

[225]  Reijo Savolainen,et al.  Cognitive barriers to information seeking: A conceptual analysis , 2015, J. Inf. Sci..

[226]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[227]  Daniel G. Tracy,et al.  Using transaction log analysis to assess student search behavior in the library instruction classroom , 2014 .

[228]  Elaine Toms,et al.  Development and assessment of the content validity of a scale to measure how well a digital environment facilitates serendipity , 2014, Inf. Res..

[229]  Alexander Richter,et al.  Exploring barriers of enterprise search implementation: a qualitative user study , 2015, Aslib J. Inf. Manag..

[230]  A. Colman,et al.  Comparing Rating Scales of Different Lengths: Equivalence of Scores from 5-Point and 7-Point Scales , 1997 .

[231]  J. Borges The Library of Babel , 1941 .

[232]  Mohamed Sidahmed,et al.  Augmenting Operations Monitoring by Mining Unstructured Drilling Reports , 2015 .

[233]  Catherine C. Marshall,et al.  Designing Qualitative Research , 1996 .

[234]  Eric Goldman,et al.  Search Engine Bias and the Demise of Search Engine Utopianism , 2006 .

[235]  Manfred Kochen,et al.  PROGRESS IN DOCUMENTATION: WISE: A WORLD INFORMATION SYNTHESIS AND ENCYCLOPAEDIA , 1972 .

[236]  Winston R. Sieck,et al.  Metacognitive Strategies for Making Sense of Cross-Cultural Encounters , 2013 .

[237]  Michael Cullen,et al.  Understanding and Communicating Social Informatics: A Framework for Studying and Teaching the Human Contexts of Information and Communication Technologies , 2009 .

[238]  Robert G. Capra,et al.  Time pressure, user satisfaction and task difficulty , 2013, ASIST.

[239]  Pia Borlund,et al.  A study of the use of simulated work task situations in interactive information retrieval evaluations: A meta-evaluation , 2016, J. Documentation.

[240]  Injazz J. Chen,et al.  Understanding customer relationship management (CRM): People, process and technology , 2003, Bus. Process. Manag. J..

[241]  Tefko Saracevic,et al.  RELEVANCE: A review of and a framework for the thinking on the notion in information science , 1997, J. Am. Soc. Inf. Sci..

[242]  David Bawden,et al.  Users, user studies and human information behaviour: A three-decade perspective on Tom Wilson's "On user studies and information needs" , 2006, J. Documentation.

[243]  Michael K. Buckland,et al.  Information as thing , 1991, J. Am. Soc. Inf. Sci..

[244]  Allen Foster,et al.  Validating coding for a theoretical model of information behaviour , 2008 .

[245]  F. Muge,et al.  Research and Advanced Technology for Digital Libraries , 2000, Lecture Notes in Computer Science.

[246]  Gary Marchionini,et al.  Exploratory search , 2006, Commun. ACM.

[247]  Günther Fliedl,et al.  Optimizing enterprise search by automatically relating user context to textual document content , 2011, i-KNOW '11.

[248]  Reijo Savolainen Everyday life information seeking: Approaching information seeking in the context of “way of life” , 1995 .

[249]  Mu Qiao,et al.  A Case Based Approach to Serve Information Needs in Knowledge Intensive Processes , 2013, ICSOC.