Optimal Sampling Designs for Multi-Day and Multi-Period Panel Surveys

Abstract Purpose — This study proposes an optimal survey design method for multi-day and multi-period panels that maximizes the statistical power of the parameter of interest under the conditions that non-linear changes in response to a policy intervention over time can be expected. Design/methodology/approach — The proposed method addresses balances among sample size, survey duration for each wave and frequency of observation. Higher-order polynomial changes in the parameter are also addressed, allowing us to calculate optimal sampling designs for non-linear changes in response to a given policy intervention. Findings — One of the most important findings is that variation structure in the behaviour of interest strongly influences how surveys are designed to maximize statistical power, while the type of policy to be evaluated does not influence it so much. Empirical results done by using German Mobility Panel data indicate that not only are more data collection waves needed, but longer multi-day periods of behavioural observations per wave are needed as well, with the increase in the non-linearity of the changes in response to a policy intervention. Originality/value — This study extends previous studies on sampling designs for travel diary survey by dealing with statistical relations between sample size, survey duration for each wave, and frequency of observation, and provides the numerical and empirical results to show how the proposed method works.

[1]  R. Moineddin,et al.  A simulation study of sample size for multilevel logistic regression models , 2007, BMC medical research methodology.

[2]  D. Bloch,et al.  Sample size requirements and the cost of a randomized clinical trial with repeated measurements. , 1986, Statistics in medicine.

[3]  W. S. Robinson Ecological correlations and the behavior of individuals. , 1950, International journal of epidemiology.

[4]  Bengt Muthén,et al.  General Longitudinal Modeling of Individual Differences in Experimental Designs: A Latent Variable Framework for Analysis and Power Estimation , 1997 .

[5]  E I Pas,et al.  Multiday Samples, Parameter Estimation Precision, and Data Collection Costs for Least Squares Regression Trip-Generation Models , 1986 .

[6]  E. I. Pas,et al.  Intrapersonal variability in daily urban travel behavior: Some additional evidence , 1995 .

[7]  S. Raudenbush Statistical analysis and optimal design for cluster randomized trials , 1997 .

[8]  J. Schlesselman,et al.  Planning a longitudinal study. II. Frequency of measurement and study duration. , 1973, Journal of chronic diseases.

[9]  Kay W. Axhausen,et al.  How routine is a routine? : An analysis of the day-to-day variability in prism vertex location , 2006 .

[10]  Kay W. Axhausen,et al.  Exploring Variation Properties of Departure Time Choice Behavior by Using Multilevel Analysis Approach , 2009 .

[11]  Peter R. Stopher,et al.  The Travel Survey Toolkit: Where to From Here? , 2009 .

[12]  S. Raudenbush,et al.  Effects of study duration, frequency of observation, and sample size on power in studies of group differences in polynomial change. , 2001, Psychological methods.

[13]  Michael P. Cohen Sample Size Considerations for Multilevel Surveys , 2005 .

[14]  H E Smart THE DYNAMICS OF CHANGE - APPLICATIONS OF THE PANEL TECHNIQUE TO TRANSPORTATION SURVEYS IN TYNE AND WEAR , 1984 .

[15]  X Basagaña,et al.  Power and sample size calculations for longitudinal studies comparing rates of change with a time‐varying exposure , 2010, Statistics in medicine.

[16]  Bjorn Winkens,et al.  Optimal time‐points in clinical trials with linearly divergent treatment effects , 2005, Statistics in medicine.

[17]  Eric I. Pas,et al.  INTRAPERSONAL VARIABILITY AND MODEL GOODNESS-OF-FIT , 1987 .

[18]  Satoshi Fujii,et al.  The effectiveness of panels in detecting changes in discrete travel behavior , 2003 .

[19]  Tom A. B. Snijders Power and Sample Size in Multilevel Linear Models , 2005 .

[20]  Ming Zhang,et al.  Metrics of Urban Form and the Modifiable Areal Unit Problem , 2005 .

[21]  K. Axhausen,et al.  Observing the rhythms of daily life: A six-week travel diary , 2002 .

[22]  Michael E Smith,et al.  DESIGN OF SMALL-SAMPLE HOME-INTERVIEW TRAVEL SURVEYS , 1979 .

[23]  Sally Galbraith,et al.  Guidelines for the design of clinical trials with longitudinal outcomes. , 2002, Controlled clinical trials.

[24]  Kay W. Axhausen,et al.  Changes in Variations of Travel Time Expenditure , 2011 .

[25]  K. Axhausen,et al.  Exploring Variation Properties of Time Use Behavior on the Basis of a Multilevel Multiple Discrete–Continuous Extreme Value Model , 2010 .

[26]  Mirjam Moerbeek,et al.  Power and money in cluster randomized trials: when is it worth measuring a covariate? , 2006, Statistics in medicine.

[27]  Ryuichi Kitamura,et al.  Panel Analysis in Transportation Planning: An Overview , 1990 .