A parimutuel gambling perspective to compare probabilistic seismicity forecasts

SUMMARY Using analogies to gaming, we consider the problem of comparing multiple probabilistic seismicity forecasts. To measure relative model performance, we suggest a parimutuel gambling perspective which addresses shortcomings of other methods such as likelihood ratio, information gain and Molchan diagrams. We describe two variants of the parimutuel approach for a set of forecasts: head-to-head, in which forecasts are compared in pairs, and round table, in which all forecasts are compared simultaneously. For illustration, we compare the 5-yr forecasts of the Regional Earthquake Likelihood Models experiment for M4.95+ seismicity in California.

[1]  David Vere-Jones,et al.  The Entropy Score and its Uses in Earthquake Forecasting , 2005 .

[2]  David A. Rhoades,et al.  The precursory earthquake swarm in New Zealand: Hypothesis tests , 1993 .

[3]  G. Molchan,et al.  Structure of optimal strategies in earthquake prediction , 1991 .

[4]  D. Turcotte,et al.  Reverse tracing of short-term earthquake precursors , 2004 .

[5]  David A. Rhoades,et al.  Efficient testing of earthquake forecasting models , 2011 .

[6]  Matthew C. Gerstenberger,et al.  New Zealand Earthquake Forecast Testing Centre , 2010 .

[7]  J. Douglas Zechar,et al.  Risk and return: evaluating Reverse Tracing of Precursors earthquake predictions , 2010 .

[8]  J. Douglas Zechar,et al.  The Area Skill Score Statistic for Evaluating Earthquake Predictability Experiments , 2010 .

[9]  Philip B. Stark,et al.  Earthquake prediction: the null hypothesis , 1997 .

[10]  Warner Marzocchi,et al.  On the Validation of Earthquake-Forecasting Models: The Case of Pattern Recognition Algorithms , 2003 .

[11]  Gerassimos A. Papadopoulos,et al.  OPERATIONAL EARTHQUAKE FORECASTING. State of Knowledge and Guidelines for Utilization , 2011 .

[12]  G. Molchan,et al.  Gambling score in earthquake prediction analysis , 2010 .

[13]  G. Molchan,et al.  Earthquake prediction as a decision-making problem , 1997 .

[14]  J. Hsu.  Multiple Comparisons: Theory and Methods , 1996 .

[15]  Yan Y. Kagan,et al.  Earthquake risk prediction as a stochastic process , 1977 .

[16]  F. Schoenberg,et al.  Residual analysis methods for space--time point processes with applications to earthquake forecast models in California , 2011, 1202.6487.

[17]  G. Molchan,et al.  Earthquake prediction: probabilistic aspect , 2008, 0802.1126.

[18]  G. Molchan.  Space–Time Earthquake Prediction: The Error Diagrams , 2008 .

[19]  J. D. Zechar,et al.  Completeness of the Mainland China Earthquake Catalog and Implications for the Setup of the China Earthquake Forecast Testing Center , 2013 .

[20]  J. Douglas Zechar,et al.  Bayesian Forecast Evaluation and Ensemble Earthquake Forecasting , 2012 .

[21]  Danijel Schorlemmer,et al.  ALM: An Asperity-based Likelihood Model for California , 2007 .

[22]  Gábor Lugosi,et al.  Prediction, learning, and games , 2006 .

[23]  Danijel Schorlemmer,et al.  Setting up an earthquake forecast experiment in Italy , 2010 .

[24]  D. Turcotte,et al.  Earthquake forecasting and its verification , 2005, cond-mat/0508476.

[25]  J. D. Zechar,et al.  Regional Earthquake Likelihood Models I: First-Order Results , 2013 .

[26]  J. Douglas Zechar,et al.  Simple smoothed seismicity earthquake forecasts for Italy , 2010 .

[27]  Yan Y. Kagan,et al.  New seismic gap hypothesis: Five years after , 1995 .

[28]  George Molchan,et al.  On the testing of seismicity models , 2011, Acta Geophysica.

[29]  Testing earthquake predictions , 2008, 0805.3032.

[30]  P. Reasenberg.  Second‐order moment of central California seismicity, 1969–1982 , 1985 .

[31]  Naoshi Hirata,et al.  Overview of the first earthquake forecast testing experiment in Japan , 2011 .

[32]  Danijel Schorlemmer,et al.  First Results of the Regional Earthquake Likelihood Models Experiment , 2010 .

[33]  J. D. Zechar,et al.  A prospective earthquake forecast experiment in the western Pacific , 2012 .

[34]  J. D. Zechar,et al.  Assessing annual global M6+ seismicity forecasts , 2014 .

[35]  Philip B. Stark,et al.  A few considerations for ascribing statistical significance to earthquake predictions , 1996 .

[36]  D. Jackson,et al.  Are spontaneous earthquakes stationary in California , 2010 .

[37]  Kristy F. Tiampo,et al.  A RELM earthquake forecast based on pattern informatics , 2005 .

[38]  Vladimir Kossobokov,et al.  TESTING EARTHQUAKE PREDICTION ALGORITHMS : STATISTICALLY SIGNIFICANT ADVANCE PREDICTION OF THE LARGEST EARTHQUAKES IN THE CIRCUM-PACIFIC, 1992-1997 , 1999 .

[39]  Jiancang Zhuang,et al.  Gambling scores for earthquake predictions and forecasts , 2010 .

[40]  S. Wiemer,et al.  Earthquake Likelihood Model Testing , 2007 .

[41]  M. Yamada,et al.  Earthquake forecast enrichment scores , 2012 .

[42]  Y. Kagan,et al.  Earthquakes Cannot Be Predicted , 1997, Science.

[43]  Steven N. Ward,et al.  Methods for Evaluating Earthquake Potential and Likelihood in and around California , 2007 .

[44]  Jenny A. Baglivo,et al.  Non-Poissonian Earthquake Clustering and the Hidden Markov Model as Bases for Earthquake Forecasting in California , 2007 .

[45]  Y. Kagan,et al.  Long‐term probabilistic forecasting of earthquakes , 1994 .

[46]  Scoring annual earthquake predictions in China , 2012 .

[47]  V. Kossobokov.  Testing earthquake prediction methods: «The West Pacific short-term forecast of earthquakes with magnitude MwHRV ≥ 5.8» , 2006 .

[48]  Y. Kagan,et al.  On Earthquake Predictability Measurement: Information Score and Error Diagram , 2007 .

[49]  Yan Y. Kagan,et al.  A Testable Five-Year Forecast of Moderate and Large Earthquakes in Southern California Based on Smoothed Seismicity , 2007 .

[50]  Y. Kagan,et al.  High-resolution Time-independent Grid-based Forecast for M ≥ 5 Earthquakes in California , 2007 .

[51]  G. M. Molchan,et al.  Earthquake prediction and its optimization , 1992 .

[52]  Y. Kagan,et al.  Implications of Geodetic Strain Rate for Future Earthquakes, with a Five-Year Forecast of M5 Earthquakes in Southern California , 2007 .

[53]  Thomas H. Jordan,et al.  Operational Earthquake Forecasting: Some Thoughts on Why and How , 2010 .

[54]  Vladimir Kossobokov,et al.  Earthquake prediction: basics, achievements, perspectives , 2004 .

[55]  G. Molchan,et al.  Earthquake prediction analysis based on empirical seismic rate: the M8 algorithm , 2010 .

[56]  J. Douglas Zechar,et al.  Earthquake Forecasting and Earthquake Prediction: Different Approaches for Obtaining the Best Model , 2011 .

[57]  Zhen Liu,et al.  Seismic Hazard Inferred from Tectonics: California , 2005 .

[58]  J. Douglas Zechar,et al.  Testing alarm‐based earthquake predictions , 2008 .

[59]  L. Knopoff,et al.  Statistical Short-Term Earthquake Prediction , 1987, Science.