Validating Instruments in MIS Research

Calls for new directions in MIS research bring with them a call for renewed methodological rigor. This article offers an operating paradigm for renewal along dimensions previously unstressed. The basic contention is that confirmatory empirical findings will be strengthened when instrument validation precedes both internal and statistical conclusion validity and that, in many situations, MIS researchers need to validate their research instruments. This contention is supported by a survey of instrumentation as reported in sample IS journals over the last several years. A demonstration exercise of instrument validation follows as an illustration of some of the basic principles of validation. The validated instrument was designed to gather data on the impact of computer security administration on the incidence of computer abuse in the U.S.A.

[1]  Scott Hamilton,et al.  Knowledge Utilization Among MIS Researchers , 1982, MIS Q..

[2]  D. Campbell.  III. “Degrees of Freedom” and the Case Study , 1975 .

[3]  C. Coombs.  A theory of data. , 1965, Psychology Review.

[4]  Ron Weber,et al.  Research on Structured Programming: An Empiricist's Evaluation , 1984, IEEE Transactions on Software Engineering.

[5]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[6]  Subhash Sharma,et al.  Identification and Analysis of Moderator Variables , 1981 .

[7]  James C. Wetherbe,et al.  Key issues in information systems management , 1987 .

[8]  Wanda J. Orlikowski,et al.  The Problem of Statistical Power in MIS Research , 1989, MIS Q..

[9]  E. Hanushek.  Statistical methods for social scientists , 1977 .

[10]  Jr. D W Straub,et al.  Deviancy by bits and bytes: computer abusers and control measures , 1984 .

[11]  Thomas W. Ferratt,et al.  Are Information Systems People Different: An Investigation of Motivational Differences , 1986, MIS Q..

[12]  T. Mitchell.  An Evaluation of the Validity of Correlational Research Conducted in Organizations , 1985 .

[13]  Rob Kling,et al.  Computer abuse and computer crime as organizational activities , 1981, CSOC.

[14]  Suzanne Rivard,et al.  Factors of success for end-user computing , 1988, CACM.

[15]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[16]  James C. Wetherbe,et al.  Key Information Systems Issues for the 1980's , 1984, MIS Q..

[17]  Blake Ives,et al.  User Involvement and MIS Success: A Review of Research , 1984 .

[18]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.

[19]  Izak Benbasat,et al.  The Case Research Strategy in Studies of Information Systems , 1987, MIS Q..

[20]  E. Burton Swanson,et al.  A Note on Information Attributes , 1985, J. Manag. Inf. Syst..

[21]  Jacob Cohen,et al.  Statistical Power Analysis For The Behavioral Sciences Revised Edition , 1987 .

[22]  Robert W. Zmud,et al.  AN EMPIRICAL INVESTIGATION OF THE DIMENSIONALITY OF THE CONCEPT OF INFORMATION , 1978 .

[23]  D. Parker.  Computer Security Management , 1981 .

[24]  Sammy W. Pearson,et al.  Development of a Tool for Measuring and Analyzing Computer User Satisfaction , 1983 .

[25]  Scott Hamilton,et al.  MIS research strategies , 1982, Inf. Manag..

[26]  J. Hair.  Multivariate data analysis , 1972 .

[27]  Gilbert A. Churchill.  A Paradigm for Developing Better Measures of Marketing Constructs , 1979 .

[28]  Charles A. O'Reilly,et al.  Variations in Decision Makers' Use of Information Sources: The Impact of Quality and Accessibility of Information , 1982 .

[29]  Jiing-Lih Farh,et al.  ASSESSING ENVIRONMENTAL SCANNING AT THE SUBUNIT LEVEL: A MULTITRAIT‐MULTIMETHOD ANALYSIS* , 1984 .

[30]  E. B. Swanson,et al.  Management Information Systems: Appreciation and Involvement , 1974 .

[31]  Iris Vessey,et al.  The Effect of User Involvement on System Success: A Contingency Approach , 1988, MIS Q..

[32]  Gayle J. Yaverbaum,et al.  Critical Factors in the User Environment: An Experimental Study of Users, Organizations and Tasks , 1988, MIS Q..

[33]  Herbert W. Marsh,et al.  Confirmatory Factor Analysis of Multitrait Multimethod Matrices. , 1983 .

[34]  Izak Benbasat,et al.  The Management Information Systems Area: Problems, Challenges and Opportunities , 1980, ICIS.

[35]  Gerardine DeSanctis,et al.  ICIS Paper: Methodological Issues in Experimental IS Research: Experiences and Recommendations , 1985, MIS Q..

[36]  Helena Chmura Kraemer,et al.  How Many Subjects? Statistical Power Analysis in Research , 1987 .

[37]  Gregg B. Jackson,et al.  Meta-Analysis: Cumulating Research Findings Across Studies , 1982 .

[38]  L. Cronbach.  Coefficient alpha and the internal structure of tests , 1951 .

[39]  M. J. Allen.  Introduction to Measurement Theory , 1979 .

[40]  A. Strauss,et al.  The discovery of grounded theory: strategies for qualitative research aldine de gruyter , 1968 .

[41]  D. Larcker,et al.  PERCEIVED USEFULNESS OF INFORMATION: A PSYCHOMETRIC EXAMINATION* , 1980 .

[42]  K. Bailey.  Methods of Social Research , 1978 .

[43]  Howard B. Lee,et al.  Foundations of Behavioral Research , 1965 .

[44]  Gerardine DeSanctis,et al.  Group decision making and group decision support systems : a 3-year plan for the GDSS research project , 1987 .

[45]  J. C. Brancheau,et al.  The diffusion of information technology: testing and extending innovation diffusion theory in the context of end-user computing , 1987 .

[46]  Ali F. Farhoomand,et al.  Scientific progress of management information systems , 1987, DATB.

[47]  P. Cook.  Research in Criminal Deterrence: Laying the Groundwork for the Second Decade , 1980, Crime and Justice.

[48]  William R. King,et al.  An experimental study of the value of information , 1982 .

[49]  Blake Ives,et al.  The measurement of user information satisfaction , 1983, CACM.

[50]  Dale Goodhue,et al.  Supporting users of corporate data : the effect of I/S policy choices , 1988 .

[51]  E. Burton Swanson,et al.  INFORMATION CHANNEL DISPOSITION AND USE , 1987 .

[52]  Ann-Marie K. Baronas,et al.  Restoring a Sense of Control During Implementation: How User Involvement Leads to System Acceptance , 1988, MIS Q..