User satisfaction as a measure of system performance

It is evident from previous research that user satisfaction is a multidimensional, subjective variable which can be affected by many factors other than performance of the system or searcher. This article draws on information retrieval and information systems literature in an attempt to understand what user satisfaction is, how it is measured, what factors affect it, and why findings on user satisfaction have been so varied and contradictory. It concludes with recommendations for future investigation of the use of user satisfaction as a measure of system performance.

[1]  Peter A. Todd,et al.  Perceived Usefulness, Ease of Use, and Usage of Information Technology: A Replication , 1992, MIS Q..

[2]  Frances Wood,et al.  Information skills, searching behaviour and cognitive styles for student-centred learning: a computer-assisted learning approach , 1996, J. Inf. Sci..

[3]  Starr Roxanne Hiltz,et al.  User satisfaction with computer-mediated communication systems , 1990 .

[4]  Micheline Beaulieu.  Interaction in information searching and retrieval , 2000, J. Documentation.

[5]  Frances C. Johnson,et al.  Task dimensions of user evaluations of information retrieval systems , 2003, Inf. Res..

[6]  Louise T. Su.  Value of Search Results as a Whole as the Best Single Measure of Information Retrieval Performance , 1998, Inf. Process. Manag..

[7]  Daniel Robey,et al.  User Attitudes and Management Information System Use , 1979 .

[8]  Sammy W. Pearson,et al.  Development of a Tool for Measuring and Analyzing Computer User Satisfaction , 1983 .

[9]  Louise T. Su.  A comprehensive and systematic model of user evaluation of Web search engines: I. Theory and background , 2003, J. Assoc. Inf. Sci. Technol..

[10]  N. Melone.  A theoretical assessment of the user-satisfaction construct in information systems research , 1990 .

[11]  Susan Davis Herring.  Using the World Wide Web for research: are faculty satisfied? , 2001 .

[12]  Richard W. Scamell,et al.  The Effects of Information System User Expectations on Their Performance and Perceptions , 1993, MIS Q..

[13]  Henri Barki,et al.  Measuring User Participation, User Involvement, and User Attitude , 1994, MIS Q..

[14]  Rachel Applegate,et al.  Models of User Satisfaction: Understanding False Positives , 1993 .

[15]  James A. Buczynski.  Satisficing Digital Library Users , 2005 .

[16]  Jon B. Woodroof,et al.  Satisfaction/dissatisfaction: are users predisposed? , 2003, Inf. Manag..

[17]  Jane Reid,et al.  A Task-Oriented Non-Interactive Evaluation Methodology for Information Retrieval Systems , 2000, Information Retrieval.

[18]  Harry Bruce,et al.  User Satisfaction with Information Seeking on the Internet , 1998, J. Am. Soc. Inf. Sci..

[19]  H. Simon,et al.  Models Of Man : Social And Rational , 1957 .

[20]  Michael Byron,et al.  Satisficing and Maximizing: Moral Theorists on Practical Reason , 2004 .

[21]  William J. Doll,et al.  The Measurement of End-User Computing Satisfaction , 1988, MIS Q..

[22]  Judith A. Tessier.  New Measures of User Satisfaction With Computer Based Literature Searches. , 1977 .

[23]  Daniela Petrelli,et al.  Observing users, designing clarity: A case study on the user-centered design of a cross-language information retrieval system , 2004, J. Assoc. Inf. Sci. Technol..

[24]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[25]  Tor Guimaraes,et al.  The Relationship Between User Participation and User Satisfaction: An Investigation of Four Contingency Factors , 1994, MIS Q..

[26]  Lynn Silipigni Connaway,et al.  What is enough? Satisficing information needs , 2007, J. Documentation.

[27]  Blake Ives,et al.  The measurement of user information satisfaction , 1983, CACM.

[28]  Gitte Lindgaard,et al.  What is this evasive beast we call user satisfaction? , 2003, Interact. Comput..

[29]  Myke Gluck,et al.  Exploring the Relationship between User Satisfaction and Relevance in Information Systems , 1996, Inf. Process. Manag..

[30]  William S. Cooper,et al.  On selecting a measure of retrieval effectiveness part II. Implementation of the philosophy , 1973, J. Am. Soc. Inf. Sci..

[31]  A. Barrett.  The information-seeking habits of graduate student researchers in the Humanities , 2005 .

[32]  William S. Cooper,et al.  On selecting a measure of retrieval effectiveness , 1973, J. Am. Soc. Inf. Sci..

[33]  Mark D. Dunlop,et al.  Exploring the layers of information retrieval evaluation , 1998, Interact. Comput..

[34]  Stephen P. Harter,et al.  Evaluation of information retrieval systems : Approaches, issues, and methods , 1997 .

[35]  Melvon L. Ankeny.  Evaluating End-User Services: Success or Satisfaction? , 1991 .

[36]  Lisl Zach,et al.  When is enough enough? Modeling the information-seeking and stopping behavior of senior arts administrators , 2005, J. Assoc. Inf. Sci. Technol..

[37]  Fred D. Davis,et al.  User Acceptance of Computer Technology: A Comparison of Two Theoretical Models , 1989 .

[38]  Jennifer M. Berryman,et al.  What defines 'enough' information? How policy workers make judgements and decisions during information seeking: preliminary results from an exploratory study , 2006, Inf. Res..

[39]  Lokman I. Meho,et al.  Modeling the information-seeking behavior of social scientists: Ellis's study revisited , 2003, J. Assoc. Inf. Sci. Technol..

[40]  Jane Reid,et al.  A New Task Oriented Paradigm for Information Retrieval: Implications for Evaluation of Information Retrieval Systems , 1999, CoLIS.

[41]  D. Y. Solandt,et al.  Propagation of the measurement uncertainty for the numerical reconstruction of holograms in Fresnel approximation , 2018, Speckle: International Conference on Speckle Metrology.

[42]  Ali R. Montazemi,et al.  Factors Affecting Information Satisfaction in the Context of the Small Business Environment , 1988, MIS Q..

[43]  Louise T. Su.  Evaluation Measures for Interactive Information Retrieval , 1992, Inf. Process. Manag..

[44]  Charles R. Hildreth,et al.  Accounting for users' inflated assessments of on-line catalogue search performance and usefulness: an experimental study , 2001, Inf. Res..

[45]  Magid Igbaria,et al.  Personal Computing Acceptance Factors in Small Firms: A Structural Equation Model , 1997, MIS Q..

[46]  Graham C. Low,et al.  Exploring Individual User Satisfaction Within User-Led Development , 1993, MIS Q..

[47]  Ravinder Nath.  Are frequent computer users more satisfied? , 1989, Inf. Process. Manag..

[48]  Peter Brophy,et al.  Student Searching Behavior and the Web: Use of Academic Resources and Google , 2005, Libr. Trends.

[49]  Mark D. Dunlop.  Reflections on Mira: Interactive evaluation in information retrieval , 2000, J. Am. Soc. Inf. Sci..

[50]  Beth Sandore.  Online Searching: What Measure Satisfaction?. , 1990 .

[51]  A ToddPeter,et al.  Perceived usefulness, ease of use, and usage of information technology , 1992 .

[52]  P. Ein-Dor,et al.  Organizational Context and the Success of Management Information Systems , 1978 .

[53]  Amy W. Gatian.  Is user satisfaction a valid measure of system effectiveness? , 1994, Inf. Manag..