Out with the old, in with the new: Assessing change in screen time when measurement changes over time

We examined if screen time can be assessed over time when the measurement protocol has changed to reflect advances in technology. Beginning in 2011, 929 youth (9–12 years at time one) living in in New Brunswick (Canada) self-reported the amount of time spent watching television (cycles 1–13), using computers (cycles 1–13), and playing video games (cycles 3–13). Using longitudinal invariance to test a shifting indicators model of screen time, we found that the relationships between the latent variable reflecting overall screen time and the indicators used to assess screen time were invariant across cycles (weak invariance). We also found that 31 out of 37 indicator intercepts were invariant, meaning that most indicators were answered similarly (i.e., on the same metric) across cycles (partial strong invariance), and that 28 out of 37 indicator residuals were invariant indicating that similar sources of error were present over time (partial strict invariance). Overall, across all survey cycles, 76% of indicators were fully invariant. Whereas issues were noted when new examples of screen-based technology (e.g., iPads) were added, having established partial invariance, we suggest it is still possible to assess change in screen time despite having changing indicators over time. Although it is not possible to draw definitive conclusions concerning other self-report measures of screen time, our findings may assist other researchers considering modifying self-report measures in longitudinal studies to reflect technological advancements and increase the precision of their results.

[1]  Stephen Hunter,et al.  Systematic review of sedentary behaviour and health indicators in school-aged children and youth: an update. , 2016, Applied physiology, nutrition, and metabolism = Physiologie appliquee, nutrition et metabolisme.

[2]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[3]  B. Swinburn,et al.  Screen time and physical activity behaviours are associated with health-related quality of life in Australian adolescents , 2012, Quality of Life Research.

[4]  Jennifer Utter,et al.  Couch potatoes or french fries: are sedentary behaviors associated with body mass index, physical activity, and dietary behaviors among adolescents? , 2003, Journal of the American Dietetic Association.

[5]  S. Gregorich Do Self-Report Instruments Allow Meaningful Comparisons Across Diverse Population Groups?: Testing Measurement Invariance Using the Confirmatory Factor Analysis Framework , 2006, Medical care.

[6]  M. Flament,et al.  Examining the bidirectional relationship between physical activity, screen time, and symptoms of anxiety and depression over time during adolescence. , 2016, Preventive medicine.

[7]  Gordon W. Cheung,et al.  Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance , 2002 .

[8]  L. Siegel,et al.  When Measures Change over Time: A Workable Solution for Analysing Change and Growth across Multiple Waves , 2009 .

[9]  Richard Larouche,et al.  Systematic review of sedentary behaviour and health indicators in school-aged children and youth , 2011, The international journal of behavioral nutrition and physical activity.

[10]  G. Hancock,et al.  Second-Order Latent Growth Models with Shifting Indicators , 2008 .

[11]  J. Beauchamp,et al.  Monitoring activities of teenagers to comprehend their habits: study protocol for a mixed-methods cohort study , 2013, BMC Public Health.

[12]  B. Byrne,et al.  Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. , 1989 .

[13]  Deborah L. Bandalos,et al.  Capturing Family–School Partnership Constructs Over Time: Creating Developmental Measurement Models , 2015 .

[14]  T. Little Longitudinal Structural Equation Modeling , 2013 .

[15]  J. Steenkamp,et al.  Assessing Measurement Invariance in Cross-National Consumer Research , 1998 .

[16]  E. Ferrer,et al.  Factorial Invariance within Longitudinal Structural Equation Models: Measuring the Same Construct across Time. , 2010, Child development perspectives.

[17]  Ulrich Trautwein,et al.  A new look at the big five factor structure through exploratory structural equation modeling. , 2010, Psychological assessment.

[18]  Anne Taylor Young Canadians in a Wired World: How Canadian Kids Are Using the Internet. , 2001 .

[19]  R. Vandenberg,et al.  A Review and Synthesis of the Measurement Invariance Literature: Suggestions, Practices, and Recommendations for Organizational Research , 2000 .

[20]  George C Patton,et al.  Physical activity, leisure-time screen use and depression among children and young adolescents. , 2014, Journal of science and medicine in sport.

[21]  Phil Wood Confirmatory Factor Analysis for Applied Research , 2008 .

[22]  F. Chen Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance , 2007 .