High group level validity but high random error of a self-report travel diary, as assessed by wearable cameras

Abstract Self-report remains the most common method for collecting epidemiological evidence of the links between travel and health outcomes. This study assesses the validity and reliability of a self-reported travel diary (a modified version of a well-established UK travel diary; The National Travel Survey (NTS)) by comparison with wearable camera data. Across four locations (Oxford, UK; Romford, UK; San Diego, USA; and Auckland, New Zealand) we collected 3–4 days of SenseCam (wearable camera) and travel diary data from 84 adult participants (purposive sample). Compliance with the data collection protocol was high and inspection of the crude results suggests acceptable agreement between measures for total days of data collected (diary=278; SenseCam=274), daily journey frequency (diary=4.78; SenseCam=4.64) and average journey duration in minutes (diary=17:46; SenseCam=15:40). Once these data were examined for total daily time spent travelling in minutes agreement was poorer (diary=84:53; SenseCam=72:35). Analysis of matched pairs of journey measurements ( n =1127) suggests a positive bias on self-reported journey duration of 2:08 min (95% CI=1:48–2:28; 95% limits-of-agreement=−9:10 to 13:26). Similar analysis of diary days matched to complete SenseCam days ( n =201) showed a very small positive bias with a very large limits-of-agreement (1:41 min; 95% CI=−2:00 to 5:24; 95% limits-of-agreement=−50:29 to 53:41). These results suggest self-reported journey and daily travel exposure data are relatively valid at a population level, though corrections according to reported bias could be considered. The large limits of agreement for matched journey and diary summary analysis suggest self-report diaries may be unsuitable for assessment of an individual׳s travel behaviour.

[1]  A. Bauman,et al.  Health benefits of cycling: a systematic review , 2011, Scandinavian journal of medicine & science in sports.

[2]  R. Zarama,et al.  The Ciclovia and Cicloruta programs: promising interventions to promote physical activity and social capital in Bogotá, Colombia. , 2013, American journal of public health.

[3]  D. Altman,et al.  STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT , 1986, The Lancet.

[4]  Scott Duncan,et al.  Combining GPS, GIS, and accelerometry: methodological issues in the assessment of location and intensity of travel behaviors. , 2010, Journal of physical activity & health.

[5]  Aiden R Doherty,et al.  Automatically assisting human memory: A SenseCam browser , 2011, Memory.

[6]  Edward G. Carmines,et al.  Reliability and Validity Assessment , 1979 .

[7]  Hannah Badland,et al.  Using wearable cameras to categorise type and context of accelerometer-identified episodes of physical activity , 2013, International Journal of Behavioral Nutrition and Physical Activity.

[8]  James Woodcock,et al.  Non-vigorous physical activity and all-cause mortality: systematic review and meta-analysis of cohort studies. , 2011, International journal of epidemiology.

[9]  Steve Hodges,et al.  Can we use digital life-log images to investigate active and sedentary travel behaviour? Results from a pilot study , 2011, The international journal of behavioral nutrition and physical activity.

[10]  M. Hamer,et al.  Walking and primary prevention: a meta-analysis of prospective cohort studies , 2007, British Journal of Sports Medicine.

[11]  C. Matthews,et al.  Best practices for using physical activity monitors in population-based research. , 2012, Medicine and science in sports and exercise.

[12]  Piet Rietveld,et al.  Rounding of Arrival and Departure Times in Travel Surveys: An Interpretation in Terms of Scheduled Activities , 2001 .

[13]  A. Beckett,et al.  AKUFO AND IBARAPA. , 1965, Lancet.

[14]  Peter R. Stopher,et al.  Quantifying the Difference Between Self-Reported and Global Positioning Systems-Measured Journey Durations: A Systematic Review , 2013 .

[15]  Kara M. Kockelman,et al.  Reducing Burden and Sample Sizes in Multiday Household Travel Surveys , 2008 .

[16]  David Ogilvie,et al.  Neighbourhood, Route and Workplace-Related Environmental Characteristics Predict Adults' Mode of Travel to Work , 2013, PloS one.

[17]  S. Marshall,et al.  Using the SenseCam to improve classifications of sedentary behavior in free-living settings. , 2013, American journal of preventive medicine.

[18]  Jo Salmon,et al.  A hitchhiker's guide to assessing young people's physical activity: Deciding what method to use. , 2009, Journal of science and medicine in sport.

[19]  Paul Kelly,et al.  The relationship between active travel to school and health-related fitness in children and adolescents: a systematic review , 2011, The international journal of behavioral nutrition and physical activity.

[20]  B. Ainsworth,et al.  International physical activity questionnaire: 12-country reliability and validity. , 2003, Medicine and science in sports and exercise.

[21]  H. Weisberg The Total Survey Error Approach: A Guide to the New Science of Survey Research , 2005 .

[22]  Luis Fernando Gómez,et al.  Time spent traveling in motor vehicles and its association with overweight and abdominal obesity in Colombian adults who do not own a car. , 2012, Preventive medicine.

[23]  P. Kelly,et al.  Evaluating the Feasibility of Measuring Travel to School Using a Wearable Camera , 2012, American journal of preventive medicine.

[24]  A. Bauman,et al.  The Toronto Charter for Physical Activity: a global call for action. , 2010, Journal of physical activity & health.

[25]  M. Pratt,et al.  The Ciclovía-Recreativa: A mass-recreational program with public health potential. , 2010, Journal of physical activity & health.

[26]  Gregory J. Welk,et al.  Physical Activity Assessments for Health-Related Research , 2002 .

[27]  Nanette Mutrie,et al.  Recruiting participants to walking intervention studies: a systematic review , 2011, The international journal of behavioral nutrition and physical activity.

[28]  N. Mutrie,et al.  Interventions to promote walking: systematic review , 2007, BMJ : British Medical Journal.

[29]  P. Stopher,et al.  Assessing the accuracy of the Sydney Household Travel Survey with GPS , 2007 .

[30]  Neil Armstrong,et al.  The Physical Activity Patterns of European Youth with Reference to Methods of Assessment , 2006, Sports medicine.

[31]  Steve E Hodges,et al.  Wearable cameras in health: the state of the art and future possibilities. , 2013, American journal of preventive medicine.

[32]  J F Sallis,et al.  Behavioral epidemiology: A systematic framework to classify phases of research on health promotion and disease prevention , 2000, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[33]  D. Altman,et al.  Calculating correlation coefficients with repeated observations: Part 2—correlation between subjects , 1995, BMJ.

[34]  D. Altman,et al.  Agreement Between Methods of Measurement with Multiple Observations Per Individual , 2007, Journal of biopharmaceutical statistics.

[35]  Scott Duncan,et al.  Using global positioning systems in health research: a practical approach to data collection and processing. , 2011, American journal of preventive medicine.

[36]  M. Givoni,et al.  Health Impact Modelling of Active Travel Visions for England and Wales Using an Integrated Transport and Health Impact Modelling Tool (ITHIM) , 2013, PloS one.

[37]  S. Marshall,et al.  An ethical framework for automated, wearable cameras in health behavior research. , 2013, American journal of preventive medicine.

[38]  D. Ogilvie,et al.  Interventions to promote cycling: systematic review , 2010, BMJ : British Medical Journal.

[39]  N. Day,et al.  Validity and repeatability of the EPIC-Norfolk Physical Activity Questionnaire. , 2002, International journal of epidemiology.

[40]  Johanna Zmud,et al.  Household Travel Surveys with GPS , 2009 .

[41]  Paul Kelly,et al.  Assessing the utility of wearable cameras in the measurement of walking and cycling , 2013 .

[42]  D. Altman,et al.  Statistics notes: Calculating correlation coefficients with repeated observations: Part 1—correlation within subjects , 1995 .

[43]  Kevin J. Krizek,et al.  Explaining Changes in Walking and Bicycling Behavior: Challenges for Transportation Research , 2009 .

[44]  P. Kelly,et al.  Feasibility of a SenseCam-assisted 24-h recall to reduce under-reporting of energy intake , 2013, European Journal of Clinical Nutrition.

[45]  Stephen Greaves,et al.  Household travel surveys: Where are we going? , 2007 .