Mode and gender effects on survey data quality

Abstract Affordable and user-friendly computer technology has made it possible to administer surveys on computers. However, even though computer administration of surveys is becoming a popular mode of data acquisition, little is known about the effect that this method may have on the quality of data collected. Gender differences are known to exist with regard to cognitive dimensions of computer literacy, but reports of gender effects on various modes of data collection are conflicting. This study examined the effects of mode of acquisition on data quality and the interaction effects of mode and gender. Computer-administered questionnaires and pencil-and-paper questionnaires served as the modes of administration. Omission rates, response distortion, completeness of the answer, and psychometric scale reliability were the measures of data quality. A student sample of 400 respondents was surveyed, and mode of administration did not impact data quality alone or in interaction with gender.

[1]  J. Cacioppo,et al.  The Effects of Involvement on Responses to Argument Quantity and Quality: Central and Peripheral Routes to Persuasion , 1984 .

[2]  D. L. Mitchell.  A multivariate analysis of the effects of gender and computer vs paper/pencil modes of administration on survey results , 1993 .

[3]  Gary J. Lautenschlager,et al.  Computer administration of questions: More desirable or more social desirability? , 1990 .

[4]  Seymour Sudman,et al.  Asking Questions: A Practical Guide to Questionnaire Design.@@@The Design and Understanding of Survey Questions. , 1982 .

[5]  M. Cowles,et al.  Automated Psychological Testing: Method of Administration, Need for Approval, and Measures of Anxiety , 1989 .

[6]  L. Cronbach.  Coefficient alpha and the internal structure of tests , 1951 .

[7]  J. B. Herman,et al.  Mixed-mode data collection: Telephone and personal interviewing. , 1977 .

[8]  John W. Tukey,et al.  Data Analysis and Regression: A Second Course in Statistics , 1977 .

[9]  R. Rosenthal.  Experimenter effects in behavioral research , 1968 .

[10]  John D. McKenzie,et al.  Number Cruncher Statistical Systems (NCSS) , 1985 .

[11]  M. Kochen,et al.  Psychological Testing by Computer: Effect On Response Bias , 1970 .

[12]  Maria Elena Sanchez,et al.  EFFECTS OF QUESTIONNAIRE DESIGN ON THE QUALITY OF SURVEY DATA , 1992 .

[13]  Christopher L. Martin,et al.  Some effects of computerized interviewing on job applicant responses , 1989 .

[14]  B F Green,et al.  The challenge of competence and creativity in computerized psychological testing. , 1985, Journal of consulting and clinical psychology.

[15]  Joseph F. Hair,et al.  An Assessment of the Mall Intercept as a Data Collection Method , 1985 .

[16]  Gary Klein,et al.  Bias in computer-assisted surveys , 1996, IEEE Trans. Syst. Man Cybern. Part A.

[17]  Paul Rosenfeld,et al.  Impression management, social desirability, and computer administration of attitude questionnaires: Does the computer make a difference? , 1992 .

[18]  R. Hess,et al.  Gender differences in enrollment in computer camps and classes , 1985 .

[19]  Lee Sproull,et al.  Pool Halls, Chips, and War Games: Women in the Culture of Computing , 1985 .

[20]  S. Kiesler,et al.  Response Effects in the Electronic Survey , 1986 .

[21]  J. E. Jackson,et al.  Factor analysis, an applied approach , 1983 .

[22]  Nicolaos E. Synodinos,et al.  Computer interactive interviewing in survey research , 1988 .