Research Report - A Confirmatory Factor Analysis of the User Information Satisfaction Instrument

The structure and dimensionality of the user information satisfaction UIS construct is an important theoretical issue that has received considerable attention. Building upon the work of Bailey and Pearson Bailey, J. E., S. W. Pearson. 1983. Development of a tool for measuring and analyzing computer user satisfaction. Management Sci.295, May 530--545., Ives et al. Ives, B., M. Olson, J. J. Baroudi. 1983. The measure of user information satisfaction. Comm. ACM2610, October 785--793. conduct an exploratory factor analysis and recommend a 13-item instrument two indicators per item for measuring user information satisfaction. Ives et al. also contend that UIS is comprised of three component measures information product, EDP staff and services, and user knowledge or involvement. In a replication using exploratory techniques, Baroudi and Orlikowski Baroudi, J. J., W. J. Orlikowski. 1988. A short-form measure of user information satisfaction: A psychometric evaluation and notes on use. J. Management Inform. Systems44, Spring 44--59. confirm the three factor structure and support the diagnostic utility of the three factor model. Other researchers have suggested a need for caution in using the UIS instrument as a single measure of user satisfaction; they contend that the instrument's three components measure quite different dimensions whose antecedents and consequences should be studied separately. The acceptance of UIS as a standardized instrument requires confirmation that it explains and measures the user information satisfaction construct and its components. Based on a sample of 224 respondents, this research uses confirmatory factor analysis LISREL to test alternative models of underlying factor structure and assess the reliability and validity of factors and items. The results provide support for a revised UIS model with four first-order factors and one second-order higher-order factor. To cross-validate these results, the authors reexamine two data sets, including the original Baroudi and Orlikowski data, to assess the revised UIS model. The results show that the revised model provides better model-data fit in all three data sets. Thus, the evidence supports the use of: 1 the 13-item instrument as a measure of an overall UIS; and 2 four component factors for explaining the UIS construct.

[1]  P. Bentler,et al.  Significance Tests and Goodness of Fit in the Analysis of Covariance Structures , 1980 .

[2]  N. Melone A theoretical assessment of the user-satisfaction construct in information systems research , 1990 .

[3]  Wanda J. Orlikowski,et al.  A Short Form Measure of User Information Satisfaction: A Psychometric Evaluation and Notes on Use , 1987, J. Manag. Inf. Syst..

[4]  Blake Ives,et al.  The measurement of user information satisfaction , 1983, CACM.

[5]  Detmar W. Straub,et al.  Validating Instruments in MIS Research , 1989, MIS Q..

[6]  H. Marsh,et al.  Application of confirmatory factor analysis to the study of self-concept: First- and higher order factor models and their invariance across groups. , 1985 .

[7]  R. Harvey,et al.  Confirmatory factor analysis of the Job Diagnostic Survey: Good news and bad news. , 1985 .

[8]  E. B. Swanson,et al.  Measuring user attitudes in MIS research: a review , 1982 .

[9]  Sammy W. Pearson,et al.  Development of a Tool for Measuring and Analyzing Computer User Satisfaction , 1983 .

[10]  B. Byrne A Primer of Lisrel: Basic Applications and Programming for Confirmatory Factor Analytic Models , 1989 .

[11]  Ephraim R. McLean,et al.  Information Systems Success: The Quest for the Dependent Variable , 1992, Inf. Syst. Res..

[12]  D. Larcker,et al.  PERCEIVED USEFULNESS OF INFORMATION: A PSYCHOMETRIC EXAMINATION* , 1980 .

[13]  Robert W. Zmud,et al.  AN EMPIRICAL INVESTIGATION OF THE DIMENSIONALITY OF THE CONCEPT OF INFORMATION , 1978 .

[14]  Blake Ives,et al.  User Involvement and MIS Success: A Review of Research , 1984 .

[15]  R. P. McDonald,et al.  Structural Equations with Latent Variables , 1989 .

[16]  Dennis F. Galletta,et al.  Some Cautions on the Measurement of User Information Satisfaction , 1989 .

[17]  William R. King,et al.  The impact of information systems planning on the organization , 1988 .

[18]  William J. Doll,et al.  The Measurement of End-User Computing Satisfaction , 1988, MIS Q..

[19]  J. S. Tanaka,et al.  Confirmatory hierarchical factor analyses of psychological distress measures. , 1984 .