Interobserver error in a large scale anthropometric survey

The adverse effects of interobserver error on morphometric population comparisons are well documented in the literature. While interobserver error can rarely be avoided, it can be minimized by having a single individual locate and mark relevant landmarks, by limiting the number of observers for each variable, and by reviewing repeated measures data daily to catch and correct measurer drift during data collection. In this study, two pairs of experts participated in interobserver error trials designed to pre‐set observer error limits for use in the quality control of a large scale anthropometric survey. Repeatability data were also collected twice daily in the field and reviewed with the measurers. Interobserver errors obtained in the field were lower than those achieved by the experts for 27 of 30 dimensions. These results suggest that establishment of permissible interobserver error in advance of data collection and frequent review of repeated measurements during data collection can reduce the magnitude of interobserver error below that obtained by experts measuring in a laboratory setting. However, even differences of small magnitude can be serios when they are directional, and 17 of 30 dimensions exhibited statistically significant bias between measurers despite all quality control efforts. The magnitudes of interobserver error observed in this study have proven particularly useful in evaluating the biological relevance of statistically significant differences which are of relatively small magnitude.

[1]  C. G. Turner,et al.  Intra- and interobserver concordance in classifying dental morphology. , 1986, American journal of physical anthropology.

[2]  J. Buckler,et al.  The Measurement of Human Growth , 1985 .

[3]  Claire C. Gordon,et al.  2012 Anthropometric Survey of U.S. Army Personnel: Methods and Summary Statistics , 2014 .

[4]  J. Himes,et al.  Reliability of anthropometric methods and replicate measurements. , 1989, American journal of physical anthropology.

[5]  M J Healy,et al.  Measuring measuring errors. , 1989, Statistics in medicine.

[6]  R. Bailey,et al.  A NEW, OLD METHOD FOR ASSESSING MEASUREMENT ERROR IN BOTH UNIVARIATE AND MULTIVARIATE MORPHOMETRIC STUDIES , 1990 .

[7]  S. Zegura,et al.  A univariate and multivariate examination of measurement error in anthropometry. , 1974, American journal of physical anthropology.

[8]  John T. McConville,et al.  Measurer's Handbook: U.S. Army Anthropometric Survey, 1987-1988 , 1988 .

[9]  Claire C. Gordon,et al.  An Assessment of Long-Term Changes in Anthropometric Dimensions: Secular Trends of U.S. Army Males , 1990 .

[10]  A. Roche,et al.  Errors of Measurement for Methods of Recumbent Nutritional Anthropometry in the Elderly , 1985 .

[11]  K. Liu,et al.  Measurement error and its impact on partial correlation and multiple linear regression analyses. , 1988, American journal of epidemiology.

[12]  W. Mueller,et al.  Reliability, dependability, and precision of anthropometric measurements. The Second National Health and Nutrition Examination Survey 1976-1980. , 1989, American journal of epidemiology.

[13]  R. Francis,et al.  A possible pitfall in the morphometric application of discriminant analysis: measurement bias , 1986 .

[14]  S. Zegura,et al.  Intra- and interobserver error in craniometry: a cautionary tale. , 1982, American journal of physical anthropology.

[15]  K A Bennett,et al.  Interobserver measurement reliability in anthropometry. , 1986, Human biology.

[16]  S. Zegura,et al.  Multiple observers, humidity, and choice of precision statistics: factors influencing craniometric data quality. , 1983, American journal of physical anthropology.

[17]  Bernard R. Rosner,et al.  Fundamentals of Biostatistics. , 1992 .

[18]  Claire C. Gordon,et al.  Computer Software Used in U.S. Army Anthropometric Survey 1987-1988 , 1988 .