Distributions of Final Digits in Data

Usually, all the values in a variate (e.g. the plot yields in a field experiment) are recorded to the same degree of precision (e.g. to the nearest ,uth of a kilogram), and that degree of precision is often such that the final digits in the values ought to have a uniform distribution. In practice, however, the expected uniformity can be seriously disturbed. This paper discusses the main causes of such disturbances, and shows how a cause can often be deduced from the pattern of a disturbance. Patterns arising from the reading of scales are considered, instances are examined of different degrees of precision being mixed within a variate, and some final-digit distributions arising from arithmetical rounding are tabulated. Then follow three short detective stories in which explanations are found for seeming oddities in sets of real data. The fields of application touched on throughout the paper include agricultural experimentation, analytical chemistry, anthropometry, beer sales, electrical component manufacture, geography, medical records, meteorology, micrometry, and population statistics.

[1]  M. Kaufman,et al.  Handbook for Chemical Technicians , 1976 .

[2]  Churchill Eisenhart,et al.  Realistic evaluation of the precision and accuracy of instrument calibration systems , 1963 .

[3]  E. Walker XXIX. Description of an improved micrometer , 1811 .

[4]  Emerson M. Pugh,et al.  The analysis of physical measurements , 1966 .

[5]  H. Lamb Climate: present, past and future , 1977 .

[6]  H. Jeffreys,et al.  The Theory of Probability , 1896 .

[7]  Brian Ellis,et al.  Basic Concepts of Measurement. , 1966 .

[8]  C. Myers Contributions to Egyptian Anthropology: III. The Anthropometry of the Modern Mahommedans; IV. The Comparison of the Mahommedans With the Copts and With the 'Mixed' Group , 1906 .

[9]  L. H. C. Tippett,et al.  ON THE EXTREME INDIVIDUALS AND THE RANGE OF SAMPLES TAKEN FROM A NORMAL POPULATION , 1925 .

[10]  Don Conway,et al.  Interactive Data Analysis: A Practical Primer , 1977 .

[11]  S. Rosenbaum Heights and Weights of the Army Intake, 1951 , 1954 .

[12]  Mordecai Ezekiel,et al.  Methods of Correlation Analysis. , 1931 .

[13]  S S Stevens,et al.  On the Theory of Scales of Measurement. , 1946, Science.

[14]  W. R. Garner,et al.  The Maximum Precision of Reading Fine Scales , 1952 .

[15]  E. S. Pearson Biometrika tables for statisticians , 1967 .

[16]  R. D. Gibson Theory and problems of heat transfer, (schaum's outline series): McGraw-Hill, New York (1978) , 1979 .

[17]  G. V. Dyke,et al.  Comparative experiments with field crops , 1989 .