TOWARD RELIABLE BENCHMARKING OF SOLAR FLARE FORECASTING METHODS

Solar flares occur in complex sunspot groups, but it remains unclear how the probability of producing a flare of a given magnitude relates to the characteristics of the sunspot group. Here, we use Geostationary Operational Environmental Satellite X-ray flares and McIntosh group classifications from solar cycles 21 and 22 to calculate average flare rates for each McIntosh class and use these to determine Poisson probabilities for different flare magnitudes. Forecast verification measures are studied to find optimum thresholds to convert Poisson flare probabilities into yes/no predictions of cycle 23 flares. A case is presented to adopt the true skill statistic (TSS) as a standard for forecast comparison over the commonly used Heidke skill score (HSS). In predicting flares over 24 hr, the maximum values of TSS achieved are 0.44 (C-class), 0.53 (M-class), 0.74 (X-class), 0.54 (≥M1.0), and 0.46 (≥C1.0). The maximum values of HSS are 0.38 (C-class), 0.27 (M-class), 0.14 (X-class), 0.28 (≥M1.0), and 0.41 (≥C1.0). These show that Poisson probabilities perform comparably to some more complex prediction systems, but the overall inaccuracy highlights the problem with using average values to represent flaring rate distributions.

[1]  K. D. Leka,et al.  Evaluating the Performance of Solar Flare Forecasting Methods , 2008 .

[2]  Daren Yu,et al.  Short-Term Solar Flare Prediction Using Predictor Teams , 2010 .

[3]  Everlyn A. Schumer,et al.  Probabilistic forecasting of solar flares from vector magnetogram data , 2007 .

[4]  P. Bornmann,et al.  Flare rates and the McIntosh active-region classifications , 1994 .

[5]  Haimin Wang,et al.  Automated flare forecasting using a statistical learning technique , 2010 .

[6]  M. Aschwanden,et al.  RECONCILIATION OF WAITING TIME STATISTICS OF SOLAR FLARES OBSERVED IN HARD X-RAYS , 2010, 1002.4869.

[7]  J. McTiernan,et al.  Multispacecraft observations of the hard X-ray emission from the giant solar flare on 2003 November 4 , 2005 .

[8]  Haimin Wang,et al.  Active-Region Monitoring and Flare Forecasting – I. Data Processing and First Results , 2002 .

[9]  A. F. Barghouty,et al.  A tool for empirical forecasting of major flares, coronal mass ejections, and solar particle events from a proxy of active‐region free magnetic energy , 2011 .

[10]  H. Künzel,et al.  Die Flare-Häufigkeit in Fleckengruppen unterschiedlicher Klasse und magnetischer Struktur (Mitteilungen des Astrophysikalischen Observatoriums Potsdam Nr. 87) , 1959 .

[11]  Daren Yu,et al.  SHORT-TERM SOLAR FLARE PREDICTION USING MULTIRESOLUTION PREDICTORS , 2010 .

[12]  Haimin Wang,et al.  Statistical Assessment of Photospheric Magnetic Features in Imminent Solar Flare Predictions , 2009 .

[13]  Xin Huang,et al.  SHORT-TERM SOLAR FLARE LEVEL PREDICTION USING A BAYESIAN NETWORK APPROACH , 2010 .

[14]  Markus J. Aschwanden,et al.  AUTOMATED SOLAR FLARE STATISTICS IN SOFT X-RAYS OVER 37 YEARS OF GOES OBSERVATIONS: THE INVARIANCE OF SELF-ORGANIZED CRITICALITY DURING THREE SOLAR CYCLES , 2012, 1205.6712.

[15]  Daren Yu,et al.  Short-Term Solar Flare Prediction Using a Sequential Supervised Learning Method , 2009 .

[16]  M. S. Wheatland.  A statistical solar flare forecast method , 2005 .

[17]  George E. Hale,et al.  The Magnetic Polarity of Sun-Spots , 1919 .

[18]  F. Woodcock,et al.  The Evaluation of Yes/No Forecasts for Scientific and Administrative Purposes , 1976 .

[19]  Rongzhi Li,et al.  Support Vector Machine combined with K-Nearest Neighbors for Solar Flare Forecasting , 2007 .

[20]  Mike Hapgood,et al.  Space weather : its impact on Earth and implications for business , 2010 .

[21]  Rami Qahwaji,et al.  Automated Solar Activity Prediction: A hybrid computer platform using machine learning and solar imaging for automated prediction of solar flares , 2009 .

[22]  Rami Qahwaji,et al.  Solar Flare Prediction Using Advanced Feature Extraction, Machine Learning, and Feature Selection , 2011, Solar Physics.

[23]  J. P. Mason,et al.  TESTING AUTOMATED SOLAR FLARE FORECASTING WITH 13 YEARS OF MICHELSON DOPPLER IMAGER MAGNETOGRAMS , 2010 .

[24]  P. McIntosh.  The classification of sunspot groups , 1990 .

[25]  Brian R. Dennis,et al.  Refinements to flare energy estimates: A followup to “Energy partition in two solar flare/CME events” by A. G. Emslie et al. , 2005 .