Quality Control of Weather Data during Extreme Events

Abstract Quality assurance (QA) procedures have been automated to reduce the time and labor necessary to discover outliers in weather data. Measurements from neighboring stations are used in this study in a spatial regression test to provide preliminary estimates of the measured data points. The new method does not assign the largest weight to the nearest estimate but, instead, assigns the weights according to the standard error of estimate. In this paper, the spatial test was employed to study patterns in flagged data in the following extreme events: the 1993 Midwest floods, the 2002 drought, Hurricane Andrew (1992), and a series of cold fronts during October 1990. The location of flagged records and the influence zones for such events relative to QA were compared. The behavior of the spatial test in these events provides important information on the probability of making a type I error in the assignment of the quality control flag. Simple pattern recognition tools that identify zones wherein frequent fl...

[1]  Steve Goddard,et al.  Performance of Quality Assurance Procedures for an Applied Climate Information System , 2005 .

[2]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Michael Geiger,et al.  A Web service for controlling the quality of measurements of global solar irradiation , 2002 .

[4]  Kenneth G. Hubbard,et al.  SERVICES: A Modern Applied Climate Information System , 2004 .

[5]  J. N. Lott.  The US summer of 1993: A sharp contrast in weather extremes , 1994 .

[6]  V. Shuler,et al.  Measuring the Performance of Data Validators , 1988 .

[7]  Mat Collins.  Extreme weather and climate events , 2004 .

[8]  Henry F. Diaz,et al.  The Quality Control of Long-Term Climatological Data Using Objective Data Analysis , 1995 .

[9]  Jinsheng You,et al.  Sensitivity Analysis of Quality Assurance Using the Spatial Regression Approach—A Case Study of the Maximum/Minimum Air Temperature , 2005 .

[10]  Qi Hu,et al.  Quality control of daily meteorological data in China, 1951–2000: a new dataset , 2004 .

[11]  Henry F. Diaz,et al.  Creating a Serially Complete, National Daily Time Series of Temperature and Precipitation for the Western United States , 2000 .

[12]  Qi Hu,et al.  Quality Control for USDA NRCS SM–ST Network Soil Temperatures: A Method and a Dataset* , 2002 .

[13]  Richard G. Allen,et al.  Assessing Integrity of Weather Data for Reference Evapotranspiration Estimation , 1996 .

[14]  Jerry L. Hatfield,et al.  Data quality checking for single station meteorological databases , 1994 .

[15]  Charles G. Wade,et al.  A Quality Control Program for Surface Mesometeorological Data , 1987 .

[16]  Robert G. Quayle,et al.  A Review of Cooperative Temperature Data Validation , 1990 .

[17]  L. Gandin,et al.  Complex Quality Control of Meteorological Observations , 1988 .