Estimation of Moments and Quantiles using Censored Data

Censored data sets are often encountered in water quality investigations and streamflow analyses. A Monte Carlo analysis examined the performance of three techniques for estimating the moments and quantiles of a distribution using censored data sets. These techniques include a lognormal maximum likelihood estimator (MLE), a log-probability plot regression estimator, and a new log-partial probability-weighted moment estimator. Data sets were generated from a number of distributions commonly used to describe water quality and water quantity variables. A “robust” fill-in method, which circumvents transformation bias in the real space moments, was implemented with all three estimation techniques to obtain a complete sample for computation of the sample mean and standard deviation. Regardless of the underlying distribution, the MLE generally performed as well as or better than the other estimators, though the moment and quantile estimators using all three techniques had comparable log-space root mean square errors (rmse) for censoring at or below the 20th percentile for samples sizes of n=10, the 40th percentile for n=25, and the 60th percentile for n=50. Comparison of the log-space rmse and real-space rmse indicated that a log-space rmse was a better overall metric of estimator precision.

[1]  J. Aitchison,et al.  The Lognormal Distribution. , 1958 .

[2]  Robert M. Hirsch,et al.  Estimating constituent loads , 1989 .

[3]  D. Helsel,et al.  Estimation of Distributional Parameters for Censored Trace Level Water Quality Data: 2. Verification and Applications , 1986 .

[4]  Timothy A. Cohn,et al.  Estimation of descriptive statistics for multiply censored water quality data , 1988 .

[5]  R. Vogel,et al.  Low-Flow Frequency Analysis Using Probability-Plot Correlation Coefficients , 1989 .

[6]  A. Cohen Truncated and Censored Samples , 1991 .

[7]  Philip M. Dixon,et al.  ESTIMATING MEAN AND VARIANCE FOR ENVIRONMENTAL SAMPLES WITH BELOW DETECTION LIMIT OBSERVATIONS , 1989 .

[8]  J. Aitchison On the Distribution of a Positive Random Variable Having a Discrete Probability Mass at the Origin , 1955 .

[9]  J. Stedinger Frequency analysis of extreme events , 1993 .

[10]  J. Stedinger,et al.  Flood Frequency Analysis With Historical and Paleoflood Information , 1986 .

[11]  Jery R. Stedinger,et al.  Plotting positions for historical floods and their precision , 1987 .

[12]  R. J. Gilliom,et al.  ESTIMATION OF DISTRIBUTIONAL PARAMETERS FOR CENSORED TRACE-LEVEL WATER-QUALITY DATA , 1984 .

[13]  J. R. Wallis,et al.  Estimation of the generalized extreme-value distribution by the method of probability-weighted moments , 1985 .

[14]  D. Helsel,et al.  Statistical methods in water resources , 2020, Techniques and Methods.

[15]  A. Gupta,et al.  ESTIMATION OF THE MEAN AND STANDARD DEVIATION OF A NORMAL POPULATION FROM A CENSORED SAMPLE , 1952 .

[16]  Robert J. Gilliom,et al.  Estimation of Distributional Parameters for Censored Trace Level Water Quality Data: 1. Estimation Techniques , 1986 .

[17]  Jerry L. Anderson Water Resources Planning and Management and Urban Water Resources , 1991 .

[18]  J. R. Wallis,et al.  Probability weighted moments compared with some traditional techniques in estimating Gumbel Parameters and quantiles , 1979 .

[19]  Dennis R. Helsel,et al.  Less than obvious - statistical treatment of data below the detection limit , 1990 .

[20]  B. L. Joiner,et al.  Some Properties of the Range in Samples from Tukey's Symmetric Lambda Distributions , 1971 .

[21]  Martin A. Cohen,et al.  Observations less than the analytical limit of detection , 1989 .

[22]  J. Hosking,et al.  Parameter and quantile estimation for the generalized pareto distribution , 1987 .

[23]  Quan J. Wang Estimation of the GEV distribution from censored samples by method of partial probability weighted moments , 1990 .

[24]  Gary D. Tasker,et al.  A COMPARISON OF METHODS FOR ESTIMATING LOW FLOW CHARACTERISTICS OF STREAMS , 1987 .

[25]  K. M. Hammett Low-flow frequency analyses for streams in west-central Florida , 1985 .

[26]  D. J. Finney On the Distribution of a Variate Whose Logarithm is Normally Distributed , 1941 .