UPDATING A PANEL SURVEY QUESTIONNAIRE

In a panel survey where the same set of questions is asked repeatedly over time, the need to update the survey questionnaire may arise. Knowledge of the quality of earlier responses can be used to improve the questionnaires for subsequent waves. Response rate and item non-response can be improved through information obtained in earlier waves. Changes in layout, appearance, number of questions and wording, influence the quality of the responses. However, the need for continuity of the questionnaire's content and appearance across waves, substantially limits the choices for redesign. Therefore, the redesign of a questionnaire is a constrained problem with an ultimate objective of increasing the response rate, item response, and accuracy of the responses, within the limits imposed by the need to maintain continuity. A travel impact analysis conducted in connection with the State of California Telecommuting Pilot Project offers an opportunity to study panel questionnaire updating. The process of updating a three-day travel diary is documented, and its effects on trip reporting and reporting accuracy are discussed in this paper. The results indicate that improved wording and layout contribute to improved data quality, but do not help to prevent under-reporting of trips due to panel fatigue.

[1]  R. Herriot.  Collecting Income Data on Sample Surveys: Evidence from Split-Panel Studies , 1977 .

[2]  Graham Kalton,et al.  Compensating for missing survey data , 1982 .

[3]  Jean M. Converse,et al.  Striving for Response Accuracy: Experiments in New Interviewing Techniques , 1977 .

[4]  Henk Meurs,et al.  The Dutch mobility panel: Experiences and evaluation , 1989 .

[5]  Graham Kalton,et al.  Introduction to Survey Sampling , 1983 .

[6]  A. C. Clark,et al.  MAIL-OUT/MAIL-BACK TRAVEL SURVEY IN HOUSTON, TEXAS , 1986 .

[7]  Peter R. Stopher,et al.  Survey sampling and multivariate analysis for social scientists and engineers , 1979 .

[8]  J. Mckenzie.  An Investigation into Interviewer Effects in Market Research , 1977 .

[9]  J. Wilcox,et al.  The Pretest in Survey Research: Issues and Preliminary Findings , 1982 .

[10]  R. Acevedo,et al.  Research report , 1967, Revista odontologica de Puerto Rico.

[11]  T. Walsh.  Selected Results from the 1972–73 Diary Surveys , 1977 .

[12]  A Note on the Importance of Layout in Self-Administered Questionnaires , 1982 .

[13]  M. Dix,et al.  Error and uncertainty in travel surveys , 1981 .

[14]  E I Pas,et al.  Multiday Samples, Parameter Estimation Precision, and Data Collection Costs for Least Squares Regression Trip-Generation Models , 1986 .

[15]  Clive Payne,et al.  Exploring data structures , 1977 .

[16]  John B. Forsythe,et al.  Obtaining Cooperation in a Survey of Business Executives , 1977 .

[17]  D A Hensher,et al.  STATISTICAL MODELING OF DISCRETE CHOICES IN DISCRETE TIME WITH PANEL DATA , 1986 .

[18]  David A. Hensher,et al.  LONGITUDINAL SURVEYS IN TRANSPORT: AN ASSESSMENT , 1983 .

[19]  K Fallast,et al.  SELECTED RESULTS OF A STANDARDIZED SURVEY INSTRUMENT FOR LARGE-SCALE TRAVEL SURVEYS IN SEVERAL EUROPEAN COUNTRIES , 1985 .

[20]  C. Purvis.  SURVEY OF TRAVEL SURVEYS , 1989 .

[21]  Ryuichi Kitamura,et al.  Panel Analysis in Transportation Planning: An Overview , 1990 .

[22]  Ira M. Sheskin,et al.  PILOT TESTING OF ALTERNATIVE ADMINISTRATIVE PROCEDURES AND SURVEY INSTRUMENTS , 1982 .

[23]  John P. Houston,et al.  Fundamentals of learning and memory , 1976 .

[24]  H. Cooper,et al.  A Quantitative Review of Research Design Effects on Response Rates to Questionnaires , 1983 .

[25]  Ram M. Pendyala,et al.  TELECOMMUTING AND TRAVEL DEMAND: AN IMPACT ASSESSMENT FOR STATE OF CALIFORNIA TELECOMMUTE PILOT PROJECT PARTICIPANTS , 1990 .

[26]  R Kitamura,et al.  TELECOMMUTING AND TRAVEL DEMAND: AN ACTIVITY-BASED IMPACT ASSESSMENT. INTERIM REPORT NO. 1, BASELINE TRAVEL CHARACTERISTICS , 1989 .

[27]  P. Browning,et al.  New survey methods in transport , 1983 .

[28]  Leroy Bailey,et al.  Measures of Interviewer Bias and Variance , 1977 .

[29]  Arnim H. Meyburg,et al.  COLLECTION OF HOUSEHOLD TRAVEL AND ACTIVITY DATA: DEVELOPMENT OF A SURVEY INSTRUMENT , 1985 .

[30]  Ryuichi Kitamura,et al.  Analysis of attrition biases and trip reporting errors for panel data , 1987 .

[31]  Jerome B. Kernan,et al.  Compliance with an Interview Request: A Foot-in-the-Door, Self-Perception Interpretation , 1977 .

[32]  P. J. Campion,et al.  Error and Uncertainty , 1973 .

[33]  W. Tullar,et al.  A Factor Interactive Investigation of Mail Survey Response Rates from a Commercial Population , 1977 .

[34]  N. Bradburn,et al.  How to Ask Questions about Drinking and Sex: Response Effects in Measuring Consumer Behavior , 1976 .

[35]  F. Wiseman,et al.  An Experimental Test of the Effects of a Monetary Incentive on Cooperation Rates and Data Collection Costs in Central-Location Interviewing , 1983 .

[36]  J M Golob,et al.  THE DECISION AND POLICY APPLICATIONS OF A PANEL FOR STUDYING CHANGES IN MOBILITY OVER TIME , 1986 .

[37]  Arnim H. Meyburg,et al.  DEVELOPMENT OF SURVEY INSTRUMENTS SUITABLE FOR DETERMINING NONHOME ACTIVITY PATTERNS , 1983 .

[38]  David A. Hensher,et al.  ISSUES IN THE PRE-ANALYSIS OF PANEL DATA , 1987 .