Measurement: A blueprint for theory-building in MIS

Abstract This paper provides a methodology for validating measures used in MIS research. In the absence of any referent disciplines upon which to base the development of a measure, the appropriate method would be to refine the instrument through a series of validation checks. We describe a procedure that accomplishes this function. The methodology consists of combining three statistical methods, namely, principal components analysis or exploratory factor analysis, multitrait- multimethod analysis, and confirmatory factor analysis. The use of these three conforms to the notion of triangulation in research methods. The user information satisfaction measure is employed to illustrate the application of our methodology. We feel that such cumulative testing gives information system researchers a valuable tool for theory-building.

[1]  Sammy W. Pearson,et al.  Development of a Tool for Measuring and Analyzing Computer User Satisfaction , 1983 .

[2]  Peter Weill,et al.  Managing Investment in Information Technology: Mini Case Examples and Implications , 1989, MIS Q..

[3]  D. Larcker,et al.  PERCEIVED USEFULNESS OF INFORMATION: A PSYCHOMETRIC EXAMINATION* , 1980 .

[4]  K. Jöreskog.  Statistical analysis of sets of congeneric tests , 1971 .

[5]  Robert W. Zmud,et al.  AN EMPIRICAL INVESTIGATION OF THE DIMENSIONALITY OF THE CONCEPT OF INFORMATION , 1978 .

[6]  J. Schaubroeck,et al.  Confirmatory Modeling in Organizational Behavior/Human Resource Management: Issues and Applications , 1990 .

[7]  Blake Ives,et al.  The measurement of user information satisfaction , 1983, CACM.

[8]  T. Kuhn.  The Structure of Scientific Revolutions. , 1964 .

[9]  E. Burton Swanson,et al.  Measurement as an MIS foundation , 1982, DATB.

[10]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[11]  Jacob Jacoby,et al.  Consumer Research: How valid and useful are all our consumer behavior research findings? , 1978 .

[12]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[13]  J. Jacoby.  Consumer Research: A State of the Art Review , 1978 .

[14]  S. Zionts,et al.  An Interactive Multiple Objective Linear Programming Method for a Class of Underlying Nonlinear Utility Functions , 1983 .

[15]  William J. Doll,et al.  The Measurement of End-User Computing Satisfaction , 1988, MIS Q..

[16]  J. March,et al.  A Behavioral Theory of the Firm , 1964 .

[17]  R. Bagozzi,et al.  The Construct Validity Of The Affective, Behavioral, And Cognitive Components Of Attitude By Analysis Of Covariance Structures. , 1978, Multivariate behavioral research.

[18]  Michael J. Ginzberg,et al.  Early Diagnosis of MIS Implementation Failure: Promising Results and Unanswered Questions , 1981 .

[19]  E. B. Swanson,et al.  Management Information Systems: Appreciation and Involvement , 1974 .

[20]  Andrew Ehrenberg.  Models of Fact: Examples from Marketing , 1970 .

[21]  N. Melone.  A theoretical assessment of the user-satisfaction construct in information systems research , 1990 .

[22]  Wanda J. Orlikowski,et al.  A Short Form Measure of User Information Satisfaction: A Psychometric Evaluation and Notes on Use , 1987, J. Manag. Inf. Syst..

[23]  Michael E. Treacy,et al.  An Empirical Examination of a Causal Model of User Information Satisfaction , 1985, ICIS.

[24]  Neal Schmitt,et al.  Methodology Review: Analysis of Multitrait-Multimethod Matrices , 1986 .

[25]  C. R. Franz,et al.  Strategies for research on information systems in organizations. A critical analysis of research purpose and time frame , 1987 .