Assessing the Validity of IS Success Models: An Empirical Test and Theoretical Analysis

The purpose of the present study is to empirically and theoretically assess DeLone and McLean's (1992) and Seddon's (1997) models of information systems (IS) success in a quasi-voluntary IS use context. Structural modeling techniques were applied to data collected by questionnaire from 274 system users of an integrated student information system at a midwestern university. The Seddon structural model and the DeLone and McLean structural model each contained five variables (system quality, information quality, perceived usefulness, user satisfaction, and IS use). Both models exhibit reasonable fit with the collected data. The empirical findings are assessed in the broader theoretical context of the IS success literature, including the Technology Acceptance Model and the Theory of Planned Behavior. Our results support DeLone and McLean's focus on integrated IS success models and their observation that IS success models need to be carefully specified in a given context. The Seddon model conceptually elaborates and clarifies aspects of the DeLone and McLean model, thereby effectively integrating core theoretical relationships espoused in the IS success literature. Our study also supports Seddon's three construct categories (system and information quality, general perceptual measures aboutnetbene fts about IS use, and IS behavior), as defining IS success and its impact on nature of IS use.

[1]  Albert H. Segars,et al.  Re-examining perceived ease of use and usefulness , 1993 .

[2]  Gordon B. Davis,et al.  Testing the Determinants of Microcomputer Usage via a Structural Equation Model , 1995, J. Manag. Inf. Syst..

[3]  Detmar W. Straub,et al.  Measuring System Usage: Implications for IS Theory Testing , 1995 .

[4]  Dale Goodhue,et al.  Understanding user evaluations of information systems , 1995 .

[5]  R. P. McDonald,et al.  Goodness-of-fit indexes in confirmatory factor analysis : The effect of sample size , 1988 .

[6]  Detmar W. Straub,et al.  Validation in Information Systems Research: A State-of-the-Art Assessment , 2001, MIS Q..

[7]  Peter B. Seddon,et al.  A Partial Test and Development of Delone and Mclean's Model of IS Success , 1996, Australas. J. Inf. Syst..

[8]  Simha R. Magal.  A Model for Evaluating Information Center Success , 1991, J. Manag. Inf. Syst..

[9]  William J. Doll,et al.  The Measurement of End-User Computing Satisfaction , 1988, MIS Q..

[10]  R. P. McDonald,et al.  Choosing a multivariate model: Noncentrality and goodness of fit. , 1990 .

[11]  Detmar W. Straub,et al.  Validating Instruments in MIS Research , 1989, MIS Q..

[12]  Fred D. Davis,et al.  User Acceptance of Computer Technology: A Comparison of Two Theoretical Models , 1989 .

[13]  James C. Anderson,et al.  STRUCTURAL EQUATION MODELING IN PRACTICE: A REVIEW AND RECOMMENDED TWO-STEP APPROACH , 1988 .

[14]  Timothy Paul Cronan,et al.  On the Repeated Test-Retest Reliability of the End-User Computing Satisfaction Instrument: A Comment* , 1994 .

[15]  Wynne W. Chin,et al.  On the use, usefulness, and ease of use of structural equation modeling in MIS research: a note of caution , 1995 .

[16]  D. Sandy Staples,et al.  Dimensions of Information Systems Success , 1999, Commun. Assoc. Inf. Syst..

[17]  Sammy W. Pearson,et al.  Development of a Tool for Measuring and Analyzing Computer User Satisfaction , 1983 .

[18]  Henri Barki,et al.  Explaining the Role of User Participation in Information System Use , 1994 .

[19]  Timothy Paul Cronan,et al.  On the Test-Retest Reliability of Perceived Usefulness and Perceived Ease of Use Scales , 1993 .

[20]  P. Bentler,et al.  Significance Tests and Goodness of Fit in the Analysis of Covariance Structures , 1980 .

[21]  J. S. Long,et al.  Testing Structural Equation Models , 1993 .

[22]  Andrew Martin,et al.  The 3-D Model of Information Systems Success: The Search for the Dependent Variable Continues , 1996 .

[23]  J. H. Steiger.  Structural Model Evaluation and Modification: An Interval Estimation Approach. , 1990, Multivariate behavioral research.

[24]  Stephen G. West,et al.  Structural equation models with non-normal variables: Problems and remedies , 1995 .

[25]  Michael Ishman,et al.  Measuring Information Success at the Individual Level in Cross-Cultural Environments , 1996 .

[26]  Peter A. Todd,et al.  Understanding Information Technology Usage: A Test of Competing Models , 1995, Inf. Syst. Res..

[27]  R. Kelly Rainer,et al.  The Keys to Executive Information Systems Success , 1995, J. Manag. Inf. Syst..

[28]  Wanda J. Orlikowski,et al.  A Short Form Measure of User Information Satisfaction: A Psychometric Evaluation and Notes on Use , 1987, J. Manag. Inf. Syst..

[29]  Richard O. Mason,et al.  Measuring information output: A communication systems approach , 1978, Inf. Manag..

[30]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[31]  M. Browne,et al.  Alternative Ways of Assessing Model Fit , 1992 .

[32]  J. Long.  Confirmatory Factor Analysis , 1983 .

[33]  Izak Benbasat,et al.  Integrating Diffusion of Innovations and Theory of Reasoned Action models to predict utilization of information technology by end-users , 1996 .

[34]  Peter M. Bentler,et al.  Estimates and tests in structural equation modeling. , 1995 .

[35]  William J. Doll,et al.  A Confirmatory Factor Analysis of the End-User Computing Satisfaction Instrument , 1994, MIS Q..

[36]  Jane M. Howell,et al.  Influence of Experience on Personal Computer Utilization: Testing a Conceptual Model , 1994, J. Manag. Inf. Syst..

[37]  Peter B. Seddon.  A Respecification and Extension of the DeLone and McLean Model of IS Success , 1997, Inf. Syst. Res..

[38]  James C. Anderson,et al.  Monte Carlo Evaluations of Goodness of Fit Indices for Structural Equation Models , 1992 .

[39]  Leon A. Kappelman,et al.  A Comprehensive Model for Assessing the Quality and Productivity of the Information Systems Function: Toward a Theory for Information Systems Assessment , 1997 .

[40]  Dale Goodhue,et al.  Task-Technology Fit and Individual Performance , 1995, MIS Q..

[41]  Mark W. Johnston,et al.  Analysis of role conflict and role ambiguity in a structural equations framework , 1990 .

[42]  Terry S. Overton,et al.  Estimating Nonresponse Bias in Mail Surveys , 1977 .

[43]  C. Fornell,et al.  Evaluating structural equation models with unobservable variables and measurement error. , 1981 .

[44]  H. Marsh,et al.  Application of confirmatory factor analysis to the study of self-concept: First- and higher order factor models and their invariance across groups. , 1985 .

[45]  Edward J. Garrity,et al.  Information systems success measurement , 1998 .

[46]  Stephen Doyle,et al.  Understanding Information Technology , 2000 .

[47]  Peter A. Todd,et al.  Perceived Usefulness, Ease of Use, and Usage of Information Technology: A Replication , 1992, MIS Q..

[48]  William J. Doll,et al.  Test‐Retest Reliability of the End‐User Computing Satisfaction Instrument , 1991 .

[49]  Ephraim R. McLean,et al.  Information Systems Success: The Quest for the Dependent Variable , 1992, Inf. Syst. Res..