A quasi-experimental assessment of the effect of computerizing noncognitive paper-and-pencil measurements: A test of measurement equivalence.

Previous studies have provided evidence to question the equivalence of data gathered by different administration modes and to suggest that noncognitive instruments validated for paper-and-pencil administration may not be valid for computerized administration. In this study, a series of analyses of the variance-covariance matrices tested the measurement equivalence of data collected from paper-and-pencil and computerized formats. Four work-related noncognitive psychological measures were tested in this study. There was no evidence that administration mode had an effect on measurement equivalence.

[1]  A. Pokorny,et al.  SELF‐DEROGATION AND PSYCHOSOCIAL ADJUSTMENT , 1969, The Journal of nervous and mental disease.

[2]  N. Schmitt,et al.  The Use Of Analysis Of Covariance Structures To Assess Beta And Gamma Change. , 1982, Multivariate behavioral research.

[3]  Robert J. Vandenberg,et al.  A Central Question in Cross-Cultural Research: Do Employees of Different Cultures Interpret Work-related Measures in an Equivalent Manner?: , 1994 .

[4]  KieslerSara,et al.  Affect in computer-mediated communication , 1985 .

[5]  Paul Rosenfeld,et al.  Impression management, social desirability, and computer administration of attitude questionnaires: Does the computer make a difference? , 1992 .

[6]  Richard J. Harris.  A primer of multivariate statistics , 1975 .

[7]  Karl G. Jöreskog,et al.  Lisrel 8: Structural Equation Modeling With the Simplis Command Language , 1993 .

[8]  S. Kiesler,et al.  Response Effects in the Electronic Survey , 1986 .

[9]  Edward A. Powers,et al.  Further Analysis of Rosenberg's Self-Esteem Scale , 1979 .

[10]  W. E. Hensley,et al.  Dimensions of Rosenburg's Self-Esteem Scale , 1976, Psychological reports.

[11]  M. Rosenberg.  Society and the adolescent self-image , 1966 .

[12]  Judith A. Hall.  Gender Effects in Decoding Nonverbal Cues , 1978 .

[13]  E. Labouvie,et al.  Identity versus equivalence of psychological measures and constructs. , 1980 .

[14]  Robert T. Golembiewski,et al.  Measuring Change and Persistence in Human Affairs: Types of Change Generated by OD Designs , 1976 .

[15]  Christopher L. Martin,et al.  Some effects of computerized interviewing on job applicant responses , 1989 .

[16]  Robert J. Vandenberg,et al.  Assessing newcomers' changing commitments to the organization during the first 6 months of work , 1993 .

[17]  Karl G. Jöreskog,et al.  LISREL 7: A guide to the program and applications , 1988 .

[18]  Educational and Psychological Measurement , 1953 .

[19]  R R Holden,et al.  Computerized versus standard administration of the Jenkins Activity Survey (Form T). , 1987, Journal of human stress.

[20]  William R. King,et al.  An Evaluation of the Role and Performance of a Decision Support System in Business Education , 1990 .

[21]  F. Drasgow,et al.  Equivalence of computerized and paper-and-pencil cognitive ability tests: A meta-analysis. , 1993 .

[22]  Kenneth A. Bollen,et al.  Structural Equations with Latent Variables , 1989 .

[23]  R. P. McDonald,et al.  Goodness-of-fit indexes in confirmatory factor analysis : The effect of sample size , 1988 .

[24]  L. Tucker,et al.  A reliability coefficient for maximum likelihood factor analysis , 1973 .

[25]  E. Miles,et al.  The Equity Sensitivity Construct: Potential Implications for Worker Performance , 1989 .

[26]  W. E. Hensley.  Differences between Males and Females on Rosenburg Scale of Self-Esteem , 1977, Psychological reports.

[27]  Gary J. Lautenschlager,et al.  Computer administration of questions: More desirable or more social desirability? , 1990 .

[28]  Stephen G. Green,et al.  Confirmatory factor analytic procedures for assessing change during organizational entry , 1989 .

[29]  J. Tomaka,et al.  Measures of self-esteem. , 1991 .

[30]  Gina J. Medsker,et al.  A Review of Current Practices for Evaluating Causal Models in Organizational Behavior and Human Resources Management Research , 1994 .

[31]  Sara Kiesler,et al.  Social psychological aspects of computer-mediated communication , 1984 .

[32]  Urs E. Gattiker,et al.  Computer Skills Acquisition: A Review and Future Directions for Research , 1992 .

[33]  M. Cowles,et al.  Automated Psychological Testing: Method of Administration, Need for Approval, and Measures of Anxiety , 1989 .

[34]  David Schuldberg,et al.  The MMPI Is Less Sensitive to the Automated Testing Format than It Is to Repeated Testing: Item and Scale Effects , 1988 .

[35]  R. Christie,et al.  Studies in Machiavellianism , 1970 .

[36]  J. S. Long,et al.  Testing Structural Equation Models , 1993 .

[37]  D. Paulhus.  Measurement and control of response bias. , 1991 .

[38]  A. Shapiro,et al.  On the multivariate asymptotic distribution of sequential Chi-square statistics , 1985 .

[39]  John P. Robinson,et al.  Measures Of Personality And Social Psychological Attitudes , 1991 .

[40]  Scott E. Maxwell,et al.  Multitrait-Multimethod Comparisons Across Populations: A Confirmatory Factor Analytic Approach. , 1985, Multivariate behavioral research.

[41]  W. C. King,et al.  The measurement of equity sensitivity , 1994 .