Response effects and computer-administered questionnaires: the role of the entry task and previous computer experience

Abstract In a field experiment at a tourist attraction, a between-subject; design was used to compare paper-and-pencil survey responses against those collected from two computer-administered questionnaire ( CAQ) packages; one using a cursor movement answering protocol, and the second using number pad entry. Three response effects were identified for the groups completing computerized questionnaires: an increase in the range of responses to scale questions, a tendency to select only one choice in answering multiple response questions, and longer answers to open-ended questions. Response effects were shown to be as much a function of the specific computer entry task, as the computerized interviewing situation in general. This finding suggests that computer-collected data should not be compared with data from other methodologies or even different questionnaire software without qualification. Respondent's previous computer experience was shown to have a marginal effect on the size of response effects, and onl...

[1]  S. Millstein,et al.  Acceptability and Reliability of Sensitive Information Collected via Computer Interview , 1987 .

[2]  Robert P. Hawkins,et al.  Advancing communication science : merging mass and interpersonal processes , 1988 .

[3]  Jonathan F. Antin,et al.  An empirical comparison of menu selection, command entry and combined modes of computer control , 1988 .

[4]  G. Mellsop,et al.  The reliability of a micro-computer administration of the MMPI. , 1986, Journal of clinical psychology.

[5]  S. Kiesler,et al.  Response Effects in the Electronic Survey , 1986 .

[6]  Dennis Menezes,et al.  Alternative Semantic Scaling Formats for Measuring Store Image: An Evaluation , 1979 .

[7]  H L Canoune,et al.  Human versus computer interviewing. , 1985, Journal of personality assessment.

[8]  Bert F. Green,et al.  Equivalence of Conventional and Computer Presentation of Speed Tests , 1986 .

[9]  L Katz,et al.  Computer and manual administration of the Eysenck Personality Inventory. , 1981, Journal of clinical psychology.

[10]  Lee Sproull,et al.  Using Electronic Mail for Data Collection in Organizational Research , 1986 .

[11]  Stanley R. Parkinson,et al.  Effects of Breadth, Depth and Number of Responses on Computer Menu Search Performance , 1988, Int. J. Man Mach. Stud..

[12]  R. W. Lucas,et al.  Psychiatrists and a Computer as Interrogators of Patients with Alcohol-Related Illnesses: A Comparison , 1977, British Journal of Psychiatry.

[13]  Sheizaf Rafaeli,et al.  Computerized tests and time: measuring, limiting and providing visual cues for response time in on-line questioning , 1989 .

[14]  Stanley R. Parkinson,et al.  Considerations of Menu Structure and Communication Rate for the Design of Computer Menu Displays , 1986, Int. J. Man Mach. Stud..

[15]  J. Liefeld,et al.  Response Effects in Computer-Administered Questioning , 1988 .

[16]  J H Greist,et al.  Comparison of computer- and interviewer-administered versions of the Diagnostic Interview Schedule. , 1987, Hospital & community psychiatry.

[17]  Richard J. Harris.  A primer of multivariate statistics , 1975 .

[18]  William M. Evan,et al.  Differential effects on response bias of computer vs. conventional administration of a social science questionnaire: An exploratory methodological experiment , 1969 .

[19]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[20]  Jo Ann Lee.  The Effects of Past Computer Experience on Computerized Aptitude Test Performance , 1986 .

[21]  Helman I. Stern,et al.  Alternative Option Selection Methods in Menu-Driven Computer Programs , 1987 .

[22]  M. Burke,et al.  Examinee attitudes toward computer-administered ability testing , 1987 .

[23]  David M. White,et al.  A comparison of computer administration with standard administration of the MMPI , 1985 .

[24]  J. Greist,et al.  Direct patient computer interviewing. , 1985, Journal of consulting and clinical psychology.

[25]  John I. Kiger,et al.  The Depth/Breadth Trade-Off in the Design of Menu-Driven User Interfaces , 1984, Int. J. Man Mach. Stud..

[26]  David F. Allen.  Computers versus Scanners: An Experiment in Nontraditional Forms of Survey Administration. , 1987 .

[27]  T. H. Harrell,et al.  Validation of an automated 16PF administration procedure. , 1984, Journal of personality assessment.