Research Report - The Importance of Specification in Causal Modeling: The Case of End-User Computing Satisfaction

In a survey of IS instruments spanning the years 1973 to 1988 Zmud and Boynton [Zmud, R. W., A. C. Boynton. 1991. Survey measures and instruments in MIS inventory and appraisal. K. I. Kraemer, ed. The Information Systems Research Challenge Survey Research Methods, Vol. 3. Harvard Business School, Boston, 149--180.], Doll and Torkzadeh's Doll, W. J., G. Torkzadeh. 1988. The measurement of end-user computing satisfaction. MIS Quart. June 259--274. 12-item End-User Computing Satisfaction instrument was reported as one of three IS instruments that met conditions to qualify as “well developed.” Recently, Etezadi-Amoli and Farhoomand Etezadi-Amoli, J., A. F. Farhoomand. 1991. Issues and opinions on end-user computing satisfaction. MIS Quart. March 1--5. questioned the validity of these measures. Part of their critique centered on the poor model fit obtained in a re-analysis using LISREL. While other potentially valid points were raised by Etezadi-Amoli and Farhoomand's critique, this report focuses only on their use of confirmatory factor analysis. In our re-analyses of Doll and Torkzadeh's original covariance measures, we show how model fit is extremely dependent on model specification. While still maintaining the same number of constructs and respective measures, we demonstrate how two alternatives to the original model analyzed by Etezadi-Amoli and Farhoomand can result in models with acceptable fits.

[1]  P. Bentler,et al.  Comparative fit indexes in structural models. , 1990, Psychological bulletin.

[2]  Wynne W. Chin,et al.  An examination of the relative importance of four belief constructs on the GSS adoption decision: a comparison of four methods , 1993, [1993] Proceedings of the Twenty-sixth Hawaii International Conference on System Sciences.

[3]  Kenneth A. Bollen,et al.  Overall Fit in Covariance Structure Models: Two Types of Sample Size Effects , 1990 .

[4]  Karin Klenke,et al.  Construct Measurement in Management Information systems: A Review and Critique of User Satisfaction , 1992 .

[5]  S. Mulaik,et al.  EVALUATION OF GOODNESS-OF-FIT INDICES FOR STRUCTURAL EQUATION MODELS , 1989 .

[6]  William J. Doll,et al.  The Measurement of End-User Computing Satisfaction , 1988, MIS Q..

[7]  R. Bagozzi,et al.  On the evaluation of structural equation models , 1988 .

[8]  Kenneth A. Bollen,et al.  Structural Equations with Latent Variables , 1989 .

[9]  Karl G. Jöreskog,et al.  LISREL 7: A guide to the program and applications , 1988 .

[10]  A. Shapiro,et al.  On the multivariate asymptotic distribution of sequential Chi-square statistics , 1985 .

[11]  R. P. McDonald,et al.  Choosing a multivariate model: Noncentrality and goodness of fit. , 1990 .

[12]  Peter M. Bentler,et al.  EQS : structural equations program manual , 1989 .

[13]  Ali F. Farhoomand,et al.  On end-user computing satisfaction , 1991 .

[14]  Leslie A. Hayduk.  Structural equation modeling with LISREL: essentials and advances , 1987 .

[15]  H. L. Le Roy,et al.  Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability; Vol. IV , 1969 .

[16]  L. Harlow,et al.  Towards a General Hierarchical Model of Meaning and Satisfaction in Life. , 1990, Multivariate behavioral research.

[17]  Jeffrey S. Tanaka,et al.  Influence of sample size, estimation method, and model specification on goodness-of-fit assessments in structural equation models. , 1989 .

[18]  P. Bentler,et al.  Significance Tests and Goodness of Fit in the Analysis of Covariance Structures , 1980 .

[19]  Detmar W. Straub,et al.  Validating Instruments in MIS Research , 1989, MIS Q..

[20]  William J. Doll,et al.  The measurement of end-user computing satisfaction: theoretical and methodological issues , 1991 .

[21]  William J. Doll,et al.  Test‐Retest Reliability of the End‐User Computing Satisfaction Instrument , 1991 .

[22]  L. Hayduk.  Structural equation modeling with LISREL , 1987 .

[23]  R. P. McDonald,et al.  Goodness-of-fit indexes in confirmatory factor analysis : The effect of sample size , 1988 .