Validity and reliability testing of a short questionnaire developed to assess consumers’ use, understanding and perception of food labels

Background:Food labels may have an important function in communicating nutrition information and have considerable potential to influence food choice and dietary behaviour.Objectives:To assess the validity and reliability of a short (self-complete) questionnaire designed to measure consumers’ use and understanding of food labels.Methods:Questionnaire content was determined by gaps highlighted in a literature review of food labelling. Nineteen questions (49 items) assessing frequency of label reading perceived importance of food labels, regularity of dining out, desire to have nutrition information at specific catering outlets and ability to perform nutrition information tasks were formulated and presented on four pages of A4. With the exception of two open-ended questions, all items were presented as closed (field box) structures. Content validity, face validity, item analysis, repeat and internal reliability were assessed.Results:Nutrition experts (26) completed detailed content validity assessment, resulting in high scores for appropriateness, importance and phrasing of questions, although grammar and terminology changes were required. Face validity indicated that the questionnaire was quick to complete (<15 min), easy to follow and comprehensible. Cronbach's alpha scores (internal reliability) for questions with multiple sections ranged from 0.72 to 0.91, indicating good internal consistency. Repeat reliability testing showed Spearman's correlation coefficients ranging from 0.51 to 0.97 (all P<0.001) showing high temporal stability. Item Difficulty analysis indicated that questions (Section C only) were at an appropriate level (with P between 20 and 80% for all items). Item discrimination analysis ranged from r=0.43 to 0.70, highlighting that items were suitable for inclusion.Conclusions:This questionnaire is a suitable tool for assessing consumers’ use, understanding and perception of food labels.

[1]  Seymour Sudman,et al.  Asking Questions: A Practical Guide to Questionnaire Design.@@@The Design and Understanding of Survey Questions. , 1982 .

[2]  P. Kline.  Handbook of Psychological Testing , 2013 .

[3]  M. Rayner,et al.  Just read the label , 1992 .

[4]  David A Asch,et al.  In a mailed physician survey, questionnaire length had a threshold effect on response rate. , 2005, Journal of clinical epidemiology.

[5]  S. Wunderlich,et al.  Relationship Between Use of Food Labels and Nutrition Knowledge of People With Diabetes , 1999, The Diabetes educator.

[6]  T. R. Kirk,et al.  The nutrition label – which information is looked at? , 2002 .

[7]  Mn DipN Cert Ed Rgn Scm and Janice Rattray PhD.  Essential elements of questionnaire design and development , 2007 .

[8]  R. Flesch.  A new readability yardstick. , 1948, The Journal of applied psychology.

[9]  M L Neuhouser,et al.  Use of food nutrition labels is associated with lower fat intake. , 1999, Journal of the American Dietetic Association.

[10]  R. Nayga,et al.  French consumers' use of nutrition labels , 2006 .

[11]  John A. Bower,et al.  Dimensional analysis of schoolchildren's food label comprehension: a pilot study , 2004 .

[12]  Janice Rattray,et al.  Essential elements of questionnaire design and development. , 2007, Journal of clinical nursing.

[13]  Klaus G. Grunert,et al.  A review of European research on consumer response to nutrition information on food labels , 2007, Journal of Public Health.

[14]  D. Altman,et al.  Statistics notes: Cronbach's alpha , 1997 .

[15]  Lynn Stockley,et al.  Consumer understanding and use of nutrition labelling: a systematic review , 2005, Public Health Nutrition.

[16]  Jean Harvey-Berino,et al.  Consumers may not use or understand calorie labeling in restaurants. , 2006, Journal of the American Dietetic Association.

[17]  N. Hatton.  ASKING QUESTIONS , 1979, The Medical journal of Australia.

[18]  H. DeVon,et al.  A psychometric toolbox for testing validity and reliability. , 2007, Journal of nursing scholarship : an official publication of Sigma Theta Tau International Honor Society of Nursing.

[19]  M. Clarke,et al.  Increasing response rates to postal questionnaires: systematic review , 2002, BMJ : British Medical Journal.

[20]  K. Welshimer,et al.  Knowledge, attitudes, and behaviors of college students regarding the 1990 Nutrition Labeling Education Act food labels. , 1999, Journal of the American Dietetic Association.

[21]  Paul Kline.  A Handbook of Test Construction , 1987 .

[22]  S. Fein,et al.  Consumers’ Ability to Perform Tasks Using Nutrition Labels , 1998 .

[23]  Paul Kline,et al.  A Handbook of Test Construction : Introduction to Psychometric Design , 1987 .

[24]  E McColl,et al.  Design and use of questionnaires: a review of best practice applicable to surveys of health service staff and patients. , 2001, Health technology assessment.

[25]  Dianne Davis,et al.  Patient understanding of food labels: the role of literacy and numeracy. , 2006, American journal of preventive medicine.

[26]  M. Clarke,et al.  Methods to increase response rates to postal questionnaires. , 2007, The Cochrane database of systematic reviews.