Enterprise search and discovery capability: The factors and generative mechanisms for user satisfaction

Many organisations are re-creating the ‘Google-like’ experience behind their firewall to exploit their information. However, surveys show dissatisfaction with enterprise search is commonplace. No prior study has investigated unsolicited user feedback from an enterprise search user interface to understand the underlying reasons for dissatisfaction. A mixed-methods longitudinal study was undertaken analysing feedback from over 1000 users and interviewing search service staff in a multinational corporation. Results show that 62% of dissatisfaction events were due to human (information and search literacy) rather than technology factors. Cognitive biases and the ‘Google Habitus’ influence expectations and information behaviour and are postulated as deep underlying generative mechanisms. The current literature focuses on ‘structure’ (technology and information quality) as the reason for enterprise search satisfaction, agency (search literacy) appears downplayed. Organisations which emphasise ‘systems thinking’ and bimodal approaches towards search strategy and information behaviour may improve capabilities.

[1]  W. DeSarbo,et al.  Response Determinants in Satisfaction Judgments , 1988 .

[2]  M. Sheelagh T. Carpendale,et al.  The information flaneur: a fresh look at information seeking , 2011, CHI.

[3]  Freddy Winston Castro.  Explaining Society, Critical Realism in the Social Sciences , 2002 .

[4]  R. Oliver.  A Cognitive Model of the Antecedents and Consequences of Satisfaction Decisions , 1980 .

[5]  Reijo Savolainen,et al.  Cognitive barriers to information seeking: A conceptual analysis , 2015, J. Inf. Sci..

[6]  Mike Doane.  Cost-benefit analysis: Integrating an enterprise taxonomy into a SharePoint environment , 2010 .

[7]  M. Fisher,et al.  Expectation as a Mediator of User Satisfaction , 2022 .

[8]  Susan T. Dumais,et al.  Stuff I've Seen: A System for Personal Information Retrieval and Re-Use , 2003, SIGF.

[9]  T. Lombrozo,et al.  Simplicity and probability in causal explanation , 2007, Cognitive Psychology.

[10]  Philipp Mayr,et al.  Improving Retrieval Results with Discipline-Specific Query Expansion , 2012, TPDL.

[11]  R. Oliver.  Satisfaction: A Behavioral Perspective On The Consumer , 1996 .

[12]  Paul B. Kantor,et al.  A study of information seeking and retrieving. II. Users, questions, and effectiveness , 1988, J. Am. Soc. Inf. Sci..

[13]  Misha W. Vaughan,et al.  Best practices and future visions for search user interfaces , 2006, CHI 2006.

[14]  Marti A. Hearst.  Clustering versus faceted categories for information exploration Communications of the , 2006 .

[15]  Adams Js.  Towards an understanding of inequity , 1963 .

[16]  Alexander Richter,et al.  Exploring barriers of enterprise search implementation: a qualitative user study , 2015, Aslib J. Inf. Manag..

[17]  Elin Stangeland,et al.  Contemporary issues of enterprise content management: the case of statoil. , 2003 .

[18]  James M. Stearns,et al.  Sources of Consumer Satisfaction with Retail Outlets: Issues and Evidence , 2015 .

[19]  Surajit Chaudhuri.  Information at your Fingertips: Only a dream for enterprises? , 2015, 2015 IEEE 31st International Conference on Data Engineering.

[20]  Louis B. Rosenfeld,et al.  Information architecture for the world wide web - designing large-scale web sites , 1998 .

[21]  V. Duncan,et al.  Utilizing grounded theory to explore the information-seeking behavior of senior nursing students. , 2012, Journal of the Medical Library Association : JMLA.

[22]  Paul Hugh Cleverley,et al.  Exploratory information searching in the enterprise: A study of user satisfaction and task performance , 2017, J. Assoc. Inf. Sci. Technol..

[23]  Gianluca Demartini,et al.  Leveraging semantic technologies for enterprise search , 2007, PIKM '07.

[24]  Ryen W. White,et al.  Slow Search: Information Retrieval without Time Constraints , 2013, HCIR '13.

[25]  J. Schneider,et al.  The Janus Faced Scholar: A Festschrift in Honour of Peter Ingwersen , 2010 .

[26]  F. Heider.  The psychology of interpersonal relations , 1958 .

[27]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[28]  Paul Hugh Cleverley,et al.  Retrieving haystacks: a data driven information needs model for faceted search , 2015, J. Inf. Sci..

[29]  M. Antoniak,et al.  Natural Language Processing Techniques on Oil and Gas Drilling Data , 2016 .

[30]  Lois M. L. Delcambre,et al.  How doctors search: A study of query behaviour and the impact on search results , 2012, Inf. Process. Manag..

[31]  Dick Stenmark.  Information Seeking in Organisations: A Comparative Survey of Intranet Usage , 2010, AMCIS.

[32]  Udo Kruschwitz,et al.  Searching the Enterprise , 2017, Found. Trends Inf. Retr..

[33]  James Mahoney,et al.  Review Essay: Beyond Correlational Analysis: Recent Innovations in Theory and Method , 2001 .

[34]  Gregory Grefenstette,et al.  Search-Based Applications: At the Confluence of Search and Database Technologies , 2010, Search-Based Applications: At the Confluence of Search and Database Technologies.

[35]  Jon B. Woodroof,et al.  Satisfaction/dissatisfaction: are users predisposed? , 2003, Inf. Manag..

[36]  Susan T. Dumais,et al.  The vocabulary problem in human-system communication , 1987, CACM.

[37]  Eric M. Meyers,et al.  Perspectives on information literacy: a framework for conceptual understanding , 2013, Inf. Res..

[38]  Phyllis Illari,et al.  Causality: Philosophical Theory meets Scientific Practice , 2014 .

[39]  C. Fornell,et al.  Expectations, perceived performance, and customer satisfaction for a complex service: The case of bank loans , 1996 .

[40]  Steven L. Alter.  Work System Theory: Overview of Core Concepts, Extensions, and Challenges for the Future , 2013, J. Assoc. Inf. Syst..

[41]  Cassidy R. Sugimoto,et al.  A systematic review of interactive information retrieval evaluation studies, 1967-2006 , 2013, J. Assoc. Inf. Sci. Technol..

[42]  Peter Molnar,et al.  Is Google Making Us Stupid , 2014 .

[43]  Brian Detlor,et al.  Working with information: information management and culture in a professional services organization , 2006, J. Inf. Sci..

[44]  Brian L. Connelly,et al.  Managers and Their Not-So Rational Decisions , 2008 .

[45]  Gobinda G. Chowdhury,et al.  Thesaurus-assisted search term selection and query expansion: a review of user-centred studies , 2002 .

[46]  David M. Szymanski,et al.  Customer satisfaction: A meta-analysis of the empirical evidence , 2001 .

[47]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[48]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[49]  Betsy Palkowsky.  A New Approach to Information Discovery—Geography Really Does Matter , 2005 .

[50]  David A. Wagner,et al.  Do Android users write about electric sheep? Examining consumer reviews in Google Play , 2013, 2013 IEEE 10th Consumer Communications and Networking Conference (CCNC).

[51]  Brenda Dervin,et al.  From the mind’s eye of the user: The sense-making qualitative-quantitative methodology. , 1992 .

[52]  Maria Paz Salmador Sánchez,et al.  Knowledge‐based manufacturing enterprises: evidence from a case study , 2008 .

[53]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[54]  Donald A. Schön.  Deutero-learning in organizations: Learning for , 1975 .

[55]  Robin Yeates.  Making Search Work: Implementing Web, Intranet and Enterprise Search , 2007, Program.

[56]  David Meza,et al.  JSC Search System Usability Case Study , 2014 .

[57]  J. McLeod,et al.  Accelerating positive change in electronic records management: headline findings from a major research project. , 2011 .

[58]  M. Garbarini,et al.  Improvements in the Management of Structured and Unstructured Data , 2008 .

[59]  Robert St. Louis,et al.  Word Ambiguity and Search: Implications for Enterprise Performance Management , 2016, AMCIS.

[60]  April Ann Lewis.  Enterprise Users and Web Search Behavior , 2010 .

[61]  Charles L. A. Clarke,et al.  Information Retrieval - Implementing and Evaluating Search Engines , 2010 .

[62]  Viktor Larsson,et al.  Why should Organisations Govern Enterprise Search? , 2015, AMCIS.

[63]  Mariam Ginmen.  Information Culture and Business Performance , 2012 .

[64]  Karen Corral,et al.  The Benefits and Costs of Using Metadata to Improve Enterprise Document Search , 2015, Decis. Sci..

[65]  David Hawking,et al.  Challenges in Enterprise Search , 2004, ADC.

[66]  Elaine Toms,et al.  Measuring the dimensions of serendipity in digital environments , 2011, Inf. Res..

[67]  Ross Wilkinson,et al.  Cost and benefit analysis of mediated enterprise search , 2009, JCDL '09.

[68]  Luciano Floridi,et al.  The Fourth Revolution: How the infosphere is reshaping human reality , 2014 .

[69]  Charles R. Hildreth,et al.  Accounting for users' inflated assessments of on-line catalogue search performance and usefulness: an experimental study , 2001, Inf. Res..

[70]  David Hawking.  MAPping the probability of start-up success , 2017, SIGIR.

[71]  Patrick Afflerbach,et al.  The Business Value of IT in Light of Prospect Theory , 2015, Business & Information Systems Engineering.

[72]  Barbara H Wixom,et al.  A Theoretical Integration of User Satisfaction and Technology Acceptance , 2005, Inf. Syst. Res..

[73]  M. Patton.  Qualitative research & evaluation methods , 2002 .

[74]  Matthew B. Miles,et al.  Qualitative Data Analysis: An Expanded Sourcebook , 1994 .

[75]  Tony Russell-Rose,et al.  Designing the search experience - the information architecture of discovery , 2012 .

[76]  Gilbert A. Churchill,et al.  An Investigation into the Determinants of Customer Satisfaction , 1982 .

[77]  Bernard J. Jansen,et al.  The seventeen theoretical constructs of information searching and information retrieval , 2010, J. Assoc. Inf. Sci. Technol..

[78]  Frances C. Johnson,et al.  Users' Information Search Behavior in a Professional Search Environment: - A Methodological Approach , 2014, Professional Search in the Modern World.

[79]  Robert A. Greenes,et al.  Positive attitudes and failed queries: an exploration of the conundrums of consumer health information retrieval , 2004, Int. J. Medical Informatics.

[80]  Louise T. Su.  Evaluation Measures for Interactive Information Retrieval , 1992, Inf. Process. Manag..

[81]  Mathieu Roche,et al.  Information Retrieval in Biomedicine - Natural Language Processing for Knowledge Integration , 2009, Information Retrieval in Biomedicine.

[82]  Frances C. Johnson,et al.  User satisfaction as a measure of system performance , 2007, J. Libr. Inf. Sci..

[83]  Mu Qiao,et al.  A Case Based Approach to Serve Information Needs in Knowledge Intensive Processes , 2013, ICSOC.

[84]  N. Kano,et al.  Attractive Quality and Must-Be Quality , 1984 .

[85]  M. White.  Enterprise Search , 2012 .

[86]  Allen Foster,et al.  Validating coding for a theoretical model of information behaviour , 2008 .

[87]  Dennis Halcoussis,et al.  An empirical analysis of Web catalog user experiences , 2002 .

[88]  David J. Pauleen,et al.  In Bed with Technology? Peril, Promise, and Prudence , 2015, Commun. Assoc. Inf. Syst..

[89]  Victor R. Prybutok,et al.  Information Technology Capability and Firm Performance: Contradictory Findings and Their Possible Causes , 2014, MIS Q..

[90]  John G Eastwood,et al.  Realist explanatory theory building method for social epidemiology: a protocol for a mixed method multilevel study of neighbourhood context and postnatal depression , 2014, SpringerPlus.

[91]  เถลิงศก โสมทิพย์.  THE FIFTH DISCIPLINE The Art & Practice of the Learning Organization , 2012 .

[92]  B. Weiner.  An attributional theory of achievement motivation and emotion. , 1985, Psychological review.

[93]  Claudio Carpineto,et al.  A Survey of Automatic Query Expansion in Information Retrieval , 2012, CSUR.

[94]  Ricardo Baeza-Yates,et al.  Modern Information Retrieval - the concepts and technology behind search, Second edition , 2011 .

[95]  Martin White.  Critical success factors for enterprise search , 2015 .

[96]  Marti A. Hearst.  Clustering versus faceted categories for information exploration , 2006, Commun. ACM.