论文信息 - A Probabilistic Derivation of Heidke Skill Score

A Probabilistic Derivation of Heidke Skill Score

AbstractAn alternative derivation of Heidke skill score for 2 × 2 tables is presented, starting from the assumption that a categorical forecast is useful, if the probability of an occurrence of an event, given the forecast, is greater than the base rate of the event. A tentative measure of skill would then be the difference of these probabilities, normalized by the maximum value based on the base rate. For binary events, the Heidke skill score is then the harmonic mean of these differences for both the occurrence and the nonoccurrence of the event. This derivation differs from the usual derivation in that the concept of chance agreement is not used. It is Bayesian in nature with implied updating of prior probabilities to posterior probabilities.

Otto Hyvärinen | Otto Hyvärinen

[1] Alexander von Eye,et al. Analyzing Rater Agreement: Manifest Variable Methods , 2004 .

[2] I. Jolliffe. Uncertainty and Inference for Verification Measures , 2007 .

[3] V. Smith,et al. Multivariate analysis: Theory and practice , 1974 .

[4] James C. Reed. Book Reviews : Visual Perceptual Abilities and Early Reading Progress by Jean Turner Goins, Supplementary Educational Monographs, #87, Chicago: University of Chicago Press, 1958, Pp. x + 108 , 1960 .

[5] W. Ferger. The Nature and Use of the Harmonic Mean , 1931 .

[6] A. H. Murphy. The Finley Affair: A Signal Event in the History of Forecast Verification , 1996 .

[7] P. Heidke,et al. Berechnung Des Erfolges Und Der Güte Der Windstärkevorhersagen Im Sturmwarnungsdienst , 1926 .

[8] Xindong Wu,et al. Fundamentals of association rules in data mining and knowledge discovery , 2011, Wiley Interdiscip. Rev. Data Min. Knowl. Discov..

[9] Stephen V. Stehman,et al. Selecting and interpreting measures of thematic classification accuracy , 1997 .

[10] C S Peirce,et al. The numerical measure of the success of predictions. , 1884, Science.

[11] C. J. van Rijsbergen,et al. FOUNDATION OF EVALUATION , 1974 .

[12] M. Pepe. The Statistical Evaluation of Medical Tests for Classification and Prediction , 2003 .

[13] Jacob Cohen. A Coefficient of Agreement for Nominal Scales , 1960 .