Development and reliability testing of a food store observation form.

OBJECTIVE To develop a reliable food store observational data collection instrument to be used for measuring product availability, pricing, and promotion. DESIGN Observational data collection. SETTING A total of 120 food stores (26 supermarkets, 34 grocery stores, 54 gas/convenience stores, and 6 mass merchandise stores) in the Chicago metropolitan statistical area. MAIN OUTCOME MEASURES Inter-rater reliability for product availability, pricing, and promotion measures on a food store observational data collection instrument. ANALYSIS Cohen's kappa coefficient and proportion of overall agreement for dichotomous variables and intra-class correlation coefficient for continuous variables. RESULTS Inter-rater reliability, as measured by average kappa coefficient, was 0.84 for food and beverage product availability measures, 0.80 for interior store characteristics, and 0.70 for exterior store characteristics. For continuous measures, average intra-class correlation coefficient was 0.82 for product pricing measures; 0.90 for counts of fresh, frozen, and canned fruit and vegetable options; and 0.85 for counts of advertisements on the store exterior and property. CONCLUSIONS AND IMPLICATIONS The vast majority of measures demonstrated substantial or almost perfect agreement. Although some items may require revision, results suggest that the instrument may be used to reliably measure the food store environment.

[1]  Laura C. Leviton,et al.  Measuring Food Environments: A Guide to Available Instruments , 2010, American journal of health promotion : AJHP.

[2]  L. Parker,et al.  Local Government Actions to Prevent Childhood Obesity , 2009 .

[3]  B. Psaty,et al.  Evaluating community-based nutrition programs: assessing the reliability of a survey of grocery store product displays. , 1990, American journal of public health.

[4]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[5]  Michael D M Bader,et al.  Retail grocery store marketing strategies and obesity: an integrative review. , 2012, American journal of preventive medicine.

[6]  S. Sugerman,et al.  Reliability of a retail food store survey and development of an accompanying retail scoring system to communicate survey findings and identify vendors for healthful food and marketing initiatives. , 2011, Journal of nutrition education and behavior.

[7]  W. Willett,et al.  The public health and economic benefits of taxing sugar-sweetened beverages. , 2009, The New England journal of medicine.

[8]  Leslie A Lytle,et al.  Measures of the food environment: a compilation of the literature, 1990-2007. , 2009, American journal of preventive medicine.

[9]  Laura Kettel Khan,et al.  Recommended community strategies and measurements to prevent obesity in the United States. , 2009, MMWR. Recommendations and reports : Morbidity and mortality weekly report. Recommendations and reports.

[10]  Lawrence D Frank,et al.  Nutrition Environment Measures Survey in stores (NEMS-S): development and evaluation. , 2007, American journal of preventive medicine.

[11]  D. Neumark-Sztainer,et al.  Individual and environmental influences on adolescent eating behaviors. , 2002, Journal of the American Dietetic Association.

[12]  A. Feinstein,et al.  High agreement but low kappa: II. Resolving the paradoxes. , 1990, Journal of clinical epidemiology.

[13]  Carol R Horowitz,et al.  Barriers to buying healthy foods for people with diabetes: evidence of environmental disparities. , 2004, American journal of public health.

[14]  John T Brooks,et al.  Guidelines for prevention and treatment of opportunistic infections in HIV-infected adults and adolescents: recommendations from CDC, the National Institutes of Health, and the HIV Medicine Association of the Infectious Diseases Society of America. , 2009, MMWR. Recommendations and reports : Morbidity and mortality weekly report. Recommendations and reports.

[15]  S. Gortmaker,et al.  Increasing Caloric Contribution From Sugar-Sweetened Beverages and 100% Fruit Juices Among US Children and Adolescents, 1988–2004 , 2008, Pediatrics.

[16]  Corinna Hawkes,et al.  Sales promotions and food consumption. , 2009, Nutrition reviews.

[17]  Andrew Lawson,et al.  Food store types, availability, and cost of foods in a rural environment. , 2007, Journal of the American Dietetic Association.

[18]  D. Crawford,et al.  Association between food marketing exposure and adolescents’ food choices and eating behaviors , 2012, Appetite.

[19]  Karen Glanz,et al.  Strategies for increasing fruit and vegetable intake in grocery stores and communities: policy, pricing, and environmental change. , 2004, Preventive medicine.

[20]  C. Perry,et al.  Factors influencing food choices of adolescents: findings from focus-group discussions with adolescents. , 1999, Journal of the American Dietetic Association.

[21]  F. Chaloupka,et al.  Food prices and obesity: evidence and policy implications for taxes and subsidies. , 2009, The Milbank quarterly.

[22]  K. McGraw,et al.  Forming inferences about some intraclass correlation coefficients. , 1996 .

[23]  T. Farley,et al.  Reliability of a Store Observation Tool in Measuring Availability of Alcohol and Selected Foods , 2007, Journal of Urban Health.

[24]  S. French,et al.  Pricing effects on food choices. , 2003, The Journal of nutrition.

[25]  Shannon N Zenk,et al.  Inter-rater and test-retest reliability: methods and results for the neighborhood observational checklist. , 2007, Health & place.

[26]  L. Grummer-Strawn,et al.  State-specific trends in fruit and vegetable consumption among adults --- United States, 2000-2009. , 2010, MMWR. Morbidity and mortality weekly report.

[27]  G. Foster,et al.  Snacking in Children: The Role of Urban Corner Stores , 2009, Pediatrics.

[28]  J. Reedy,et al.  Dietary sources of energy, solid fats, and added sugars among children and adolescents in the United States. , 2010, Journal of the American Dietetic Association.

[29]  Melissa C. Nelson,et al.  Neighborhood environments: disparities in access to healthy foods in the U.S. , 2009, American journal of preventive medicine.