Which Polarimetric Variables Are Important for Weather/No-Weather Discrimination?

AbstractRecently, a radar data quality control algorithm has been devised to discriminate between weather echoes and echoes due to nonmeteorological phenomena, such as bioscatter, instrument artifacts, and ground clutter (Lakshmanan et al.), using the values of polarimetric moments at and around a range gate. Because the algorithm was created by optimizing its weights over a large reference dataset, statistical methods can be employed to examine the importance of the different variables in the context of discriminating between weather and no-weather echoes. Among the variables studied for their impact on the ability to identify and censor nonmeteorological artifacts from weather radar data, the method of successive permutations ranks the variance of Zdr, the reflectivity structure of the virtual volume scan, and the range derivative of the differential phase on propagation [PhiDP (Kdp)] as the most important. The same statistical framework can be used to study the impact of calibration errors in variables...

[1]  Igor R. Ivic.  Multi-Lag Hybrid Correlation Coefficient Estimator , 2013 .

[2]  P. Heidke,et al.  Berechnung Des Erfolges Und Der Güte Der Windstärkevorhersagen Im Sturmwarnungsdienst , 1926 .

[3]  Lans P. Rothfusz,et al.  MPING: Crowd-Sourcing Weather Reports for Research , 2014 .

[4]  Valliappa Lakshmanan,et al.  A Statistical Approach to Mitigating Persistent Clutter in Radar Reflectivity Data , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[5]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[6]  Valliappa Lakshmanan,et al.  A Technique to Censor Biological Echoes in Radar Reflectivity Data , 2010 .

[7]  A. V. Ryzhkov,et al.  Areal rainfall estimates using differential phase , 1998 .

[8]  Valliappa Lakshmanan,et al.  Quality Control of Weather Radar Data Using Polarimetric Variables , 2014 .

[9]  Alexander V. Ryzhkov,et al.  The Hydrometeor Classification Algorithm for the Polarimetric WSR-88D: Description and Application to an MCS , 2009 .

[10]  Jianhua Lin,et al.  Divergence measures based on the Shannon entropy , 1991, IEEE Trans. Inf. Theory.

[11]  M. J. Laan.  Statistical Inference for Variable Importance , 2006 .

[12]  Jian Zhang,et al.  WSR-88D reflectivity quality control using horizontal and vertical reflectivity structure , 2004 .

[13]  Travis M. Smith,et al.  An Automated Technique to Quality Control Radar Reflectivity Data , 2007 .

[14]  Matthias Steiner,et al.  Use of Three-Dimensional Reflectivity Structure for Automated Detection and Removal of Nonprecipitating Echoes in Radar Data , 2002 .

[15]  Scott E. Giangrande,et al.  An Application of Linear Programming to Polarimetric Radar Differential Phase Processing , 2013 .

[16]  V. Lakshmanan.  Automating the Analysis of Spatial Grids , 2012 .

[17]  H. Jeffreys.  An invariant form for the prior probability in estimation problems , 1946, Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences.

[18]  Alexander V. Ryzhkov,et al.  Calibration Issues of Dual-Polarization Radar Measurements , 2005 .

[19]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[20]  A. Ryzhkov.  The Impact of Beam Broadening on the Quality of Radar Polarimetric Data , 2007 .

[21]  Alexander V. Ryzhkov,et al.  Depolarization in Ice Crystals and Its Effect on Radar Polarimetric Measurements , 2007 .

[22]  Heikki Mannila,et al.  Principles of Data Mining , 2001, Undergraduate Topics in Computer Science.

[23]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[24]  Lin Tang,et al.  A Physically Based Precipitation–Nonprecipitation Radar Echo Classifier Using Polarimetric and Environmental Data in a Real-Time National System , 2014 .

[25]  Claude E. Shannon,et al.  The mathematical theory of communication , 1950 .

[26]  Achim Zeileis,et al.  Bias in random forest variable importance measures: Illustrations, sources and a solution , 2007, BMC Bioinformatics.

[27]  Zoran Obradovic,et al.  Feature Selection Filters Based on the Permutation Test , 2004, ECML.

[28]  Dmitri Moisseev,et al.  Recent advances in classification of observations from dual polarization weather radars , 2013 .

[29]  Lin Tang.  A multi-sensor physically based weather / non-weather radar echo classifier using polarimetric and environmental data in a real-time national system , 2013 .

[30]  Alexandra Filová,et al.  Application of linear programming , 2016 .

[31]  V. Lakshmanan.  Automating the Analysis of Spatial Grids: A Practical Guide to Data Mining Geospatial Images for Human & Environmental Applications , 2012 .

[32]  V. Chandrasekar,et al.  Algorithm for Estimation of the Specific Differential Phase , 2009 .

[33]  Jonathan J. Gourley,et al.  A Fuzzy Logic Algorithm for the Separation of Precipitating from Nonprecipitating Echoes Using Polarimetric Radar Observations , 2007 .

[34]  Witold F. Krajewski,et al.  An Efficient Methodology for Detection of Anomalous Propagation Echoes in Radar Reflectivity Data Using Neural Networks , 2000 .

[35]  M. McCarthy.  The statistical approach , 1959 .