Is user satisfaction a valid measure of system effectiveness?

User satisfaction (US) is often used as a surrogate measure of information system effectiveness. If an effective system is defined as one that adds value to the firm, then an effective system must have some positive influence on user behavior (i.e., improve productivity, decision making, etc.). Advocates of US argue that there is theoretical support for linking attitudes (i.e., satisfaction) and behavior in the psychology literature. At the same time, there is evidence of increasing employment of US questionnaires in firms as a measure of system effectiveness. Yet there is surprisingly little information systems research linking user satisfaction with user behavior. In this study, measures of user satisfaction and system affected behavior are taken for an indirect and a direct user group of the same information system in 39 organizations. Results indicate that a relationship does exist between satisfaction and behavior for both user groups.

[1]  Merle P. Martin.  Prototypes for user training , 1987 .

[2]  V. Vroom.  Work and motivation , 1964 .

[3]  Ik-Whan G. Kwon,et al.  Measuring technology: A case study of office automation , 1987 .

[4]  Robert N. Lehrer,et al.  White collar productivity , 1985 .

[5]  J. Miller,et al.  Measuring the Effectiveness of Computer-Based Information Systems in the Financial Services Sector , 1987, MIS Q..

[6]  Michelle T. Iaffaldano,et al.  Job satisfaction and job performance: A meta-analysis. , 1985 .

[7]  Gary Klein,et al.  A Decision Aid for Selecting Among Information System Alternatives , 1987, MIS Q..

[8]  David W. Conrath,et al.  What is being done to measure user satisfaction with EDP/MIS , 1990, Inf. Manag..

[9]  William R. King,et al.  Evaluating Management Informatoin Systems , 1978, MIS Q..

[10]  Ananth Srinivasan,et al.  Alternative Measures of Systems Effectiveness: Associations and Implications , 1985, MIS Q..

[11]  William J. Doll,et al.  The Measurement of End-User Computing Satisfaction , 1988, MIS Q..

[12]  Jr. Henry C. Lucas,et al.  Performance and the Use of an Information System , 1975 .

[13]  J. March,et al.  A Behavioral Theory of the Firm , 1964 .

[14]  Don A. Dillman,et al.  INCREASING MAIL QUESTIONNAIRE RESPONSE IN LARGE SAMPLES OF THE GENERAL PUBLIC , 1972 .

[15]  Marion G. Sobol,et al.  The relationship between computerization and performance: A strategy for maximizing the economic benefits of computerization , 1983, Inf. Manag..

[16]  R. F. Powers,et al.  MisProject Management: Myths, Opinions, and Reality , 1973 .

[17]  Don A. Dillman,et al.  Contribution of personalization to mail questionnaire response as an element of a previously tested method. , 1974 .

[18]  Daniel Robey,et al.  User Attitudes and Management Information System Use , 1979 .

[19]  R. Parsons,et al.  THE EFFECT OF ADVANCE NOTICE IN MAIL SURVEYS OF HOMOGENEOUS GROUPS , 1972 .

[20]  Mo Adam Mahmood,et al.  Effect of Organizational Maturity on End-Users' Satisfaction with Information Systems , 1986, J. Manag. Inf. Syst..

[21]  C. Osgood.  Studies on the generality of affective meaning systems. , 1962 .

[22]  Avner M. Porat,et al.  Information effects on decision-making , 1969 .

[23]  Blake Ives,et al.  An empirical study of the impact of user involvement on system usage and information satisfaction , 1986, CACM.

[24]  M. Treacy,et al.  Utilization as a dependent variable in MIS research , 2015, DATB.

[25]  Charles A. O'Reilly,et al.  Variations in Decision Makers' Use of Information Sources: The Impact of Quality and Accessibility of Information , 1982 .

[26]  R. Bagozzi.  An Examination Of The Validity Of Two Models Of Attitude. , 1981, Multivariate behavioral research.

[27]  Dale Goodhue,et al.  Is Attitudes: toward Theoretical and Definition Clarity , 1986, ICIS.

[28]  Gary D. Scudder,et al.  White Collar Productivity Measurement , 1986 .

[29]  E. Burton Swanson,et al.  INFORMATION CHANNEL DISPOSITION AND USE , 1987 .

[30]  Carol H. Fuller,et al.  Effect of anonymity on return rate and response bias in a mail survey. , 1974 .

[31]  Scott Hamilton,et al.  Evaluating Information Systems Effectiveness - Part II: Comparing Evaluator Viewpoints , 1981, MIS Q..

[32]  Scott Hamilton,et al.  Evaluating Information Systems Effectiveness - Part I: Comparing Evaluation Approaches , 1981, MIS Q..

[33]  Eric K. Clemons,et al.  Information Systems, Telecommunications, and their effects on Industrial Organization , 1986, ICIS.

[34]  Blake Ives,et al.  User Involvement and MIS Success: A Review of Research , 1984 .

[35]  Kenneth D. Mackenzie,et al.  An Experimental Study of Performance Information Systems , 1982 .

[36]  R. Zmud.  INDIVIDUAL DIFFERENCES AND MIS SUCCESS: A REVIEW OF THE EMPIRICAL LITERATURE* , 1979 .

[37]  Peter F. Drucker,et al.  Managing for Results , 1964 .

[38]  Henry Huntington Seward.  Measuring user satisfaction to evaluate information systems , 1973 .

[39]  Wanda J. Orlikowski,et al.  A Short Form Measure of User Information Satisfaction: A Psychometric Evaluation and Notes on Use , 1987, J. Manag. Inf. Syst..

[40]  Michael E. Treacy,et al.  An Empirical Examination of a Causal Model of User Information Satisfaction , 1985, ICIS.

[41]  Charles A. Gallagher.  Perceptions of the Value of a Management Information System , 1974 .

[42]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[43]  Kyung Kyu Kim,et al.  User Information Satisfaction: Toward Conceptual Clarity , 1990, ICIS.

[44]  A. H. Brayfield,et al.  Employee attitudes and employee performance. , 1955, Psychological bulletin.

[45]  Louis Raymond,et al.  Organizational Characteristics and MIS Success in the Context of Small Business , 1985, MIS Q..

[46]  D. Larcker,et al.  PERCEIVED USEFULNESS OF INFORMATION: A PSYCHOMETRIC EXAMINATION* , 1980 .

[47]  Henri Barki,et al.  Change, attitude to change, and decision support system success , 1985, Inf. Manag..

[48]  Blake Ives,et al.  The measurement of user information satisfaction , 1983, CACM.

[49]  S. Streufert,et al.  Effects of information relevance on decision making in complex environments , 1973, Memory & cognition.

[50]  I. Ajzen,et al.  Belief, Attitude, Intention, and Behavior: An Introduction to Theory and Research , 1977 .

[51]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[52]  Sammy W. Pearson,et al.  Development of a Tool for Measuring and Analyzing Computer User Satisfaction , 1983 .

[53]  N. Melone.  A theoretical assessment of the user-satisfaction construct in information systems research , 1990 .

[54]  Dennis F. Galletta,et al.  Some Cautions on the Measurement of User Information Satisfaction , 1989 .

[55]  Alexander M. Maish.  A User's Behavior Toward His MIS , 1979, MIS Q..

[56]  G. Huber.  Managerial decision making , 1980 .

[57]  Kailash Joshi,et al.  An Investigation of Equity as a Determinant of User Information Satisfaction , 1990 .

[58]  Paul H. Cheney,et al.  A tool for measuring and analyzing end user computing abilities , 1988, Inf. Process. Manag..

[59]  Ronald N. Taylor.  Age and Experience as Determinants of Managerial Information Processing and Decision Making Performance , 1975 .

[60]  C. Schewe.  The Management Information System User: An Exploratory Behavioral Analysis , 1976 .

[61]  Louis A. Le Blanc,et al.  An Empirical Investigation of the Relationship Between DSS Usage and System Performance: A Case Study of a Navigation Support System , 1990, MIS Q..

[62]  E. B. Swanson,et al.  Management Information Systems: Appreciation and Involvement , 1974 .

[63]  E. B. Swanson,et al.  Measuring user attitudes in MIS research: a review , 1982 .

[64]  D. S. Sink,et al.  Productivity measurement and evaluation: What is available? , 1984 .

[65]  J. Hair.  Multivariate data analysis , 1972 .

[66]  G Larry Sanders,et al.  MIS/DSS success measure , 1984 .