Compliance of LC50 and NOEC data with Benford's Law: an indication of reliability?

Reliability of research data is essential, especially when potentially far-reaching conclusions will be based on them. This is also, amongst others, the case for ecotoxicological data used in risk assessment. Currently, several approaches are available to classify the reliability of ecotoxicological data. The process of classification, such as using the Klimisch score, is time-consuming and focuses on the application of standardised protocols and the documentation of the study. The presence of irregularities and the integrity of the performed work, however, are not addressed. The present study shows that Benford's Law, based on the occurrence of first digits following a logarithmic scale, can be applied to ecotoxicity test data for identifying irregularities. This approach is already successfully applied in accounting. Benford's Law can be used as reliability indicator, in addition to existing reliability classifications. The law can be used to efficiently trace irregularities in large data sets of interpolated (no) effect concentrations such as LC50s (possibly the result of data manipulation), without having to evaluate the source of each individual record. Application of the law to systems in which large amounts of toxicity data are registered (e.g., European Commission Regulation concerning the Registration, Evaluation, Authorisation and Restriction of Chemicals) can therefore be valuable.

[1]  W Slob,et al.  No-effect concentration as a basis for ecological risk assessment. , 1996, Risk analysis : an official publication of the Society for Risk Analysis.

[2]  Eleanor Dallaway.  Editorial: Bad habits die hard , 2010 .

[3]  Simon Newcomb,et al.  Note on the Frequency of Use of the Different Digits in Natural Numbers , 1881 .

[4]  George G. Judge,et al.  Detecting Problems in Survey Data Using Benford’s Law , 2007, The Journal of Human Resources.

[5]  J R Wheeler,et al.  Species sensitivity distributions: data and model choice. , 2002, Marine pollution bulletin.

[6]  Bernhard Rauch,et al.  Fact and Fiction in EU-Governmental Economic Data , 2011 .

[7]  F. Wilcoxon,et al.  A simplified method of evaluating dose-effect experiments. , 1948, The Journal of pharmacology and experimental therapeutics.

[8]  Patricia Pepple Williamson,et al.  Detecting Fraud in Data Sets Using Benford's Law , 2004 .

[9]  T. Jager.  Bad habits die hard: The NOEC's persistence reflects poorly on ecotoxicology , 2012, Environmental toxicology and chemistry.

[10]  K S Crump,et al.  A new method for determining allowable daily intakes. , 1984, Fundamental and applied toxicology : official journal of the Society of Toxicology.

[11]  Marlene Ågerstrand,et al.  Comparison of four different methods for reliability evaluation of ecotoxicity data: a case study of non-standard test data used in environmental risk assessments of pharmaceutical substances , 2011 .

[12]  Christopher F. Dumas,et al.  DETECTING EVIDENCE OF NON-COMPLIANCE IN SELF-REPORTED POLLUTION EMISSIONS DATA: AN APPLICATION OF BENFORD'S LAW , 2000 .

[13]  Cindy Durtschi,et al.  The effective use of Benford's Law to assist in detecting fraud in accounting data , 2004 .

[14]  A. Casadevall,et al.  Misconduct accounts for the majority of retracted scientific publications , 2012, Proceedings of the National Academy of Sciences.

[15]  T. Hill.  The Significant-Digit Phenomenon , 1995 .

[16]  Leo Posthuma,et al.  Species Sensitivity Distributions , 2018, Statistical Analysis of Ecotoxicity Studies.

[17]  J. Hamilton,et al.  Assessing the Accuracy of Self-Reported Data: an Evaluation of the Toxics Release Inventory , 2006 .

[18]  D. Zwart.  Observed Regularities in Species Sensitivity Distributions for Aquatic Species , 2001 .

[19]  R. Fewster.  A Simple Explanation of Benford's Law , 2009 .

[20]  I. Purchase,et al.  Fraud, errors and gamesmanship in experimental toxicology. , 2004, Toxicology.

[21]  Arno Berger,et al.  Benford’s Law Strikes Back: No Simple Explanation in Sight for Mathematical Gem , 2011 .

[22]  Brian J. Gaines,et al.  Breaking the (Benford) Law , 2007 .

[23]  U. Tillmann,et al.  A systematic approach for evaluating the quality of experimental toxicological and ecotoxicological data. , 1997, Regulatory toxicology and pharmacology : RTP.

[24]  H N Nigg,et al.  Scientific misconduct in environmental science and toxicology. , 1994, JAMA.