A novel approach to the bias-variance problem in bump hunting

This study explores various data-driven methods for performing background-model selection, and for assigning uncertainty on the signal-strength estimator that arises due to the choice of background model. The performance of these methods is evaluated in the context of several realistic example problems. Furthermore, a novel strategy is proposed that greatly simplifies the process of performing a bump hunt when little is assumed to be known about the background. This new approach is shown to greatly reduce the potential bias in the signal-strength estimator, without degrading the sensitivity by increasing the variance, and to produce confidence intervals with valid coverage properties.

[1]  B. Guegan,et al.  Model selection for amplitude analysis , 2015, 1505.05133.

[2]  M. Williams,et al.  Searching for a particle of unknown mass and lifetime in the presence of an unknown non-monotonic background , 2015, 1503.04767.

[3]  J. T. Childers,et al.  Measurement of Higgs boson production in the diphoton decay channel in pp collisions at center-of-mass energies of 7 and 8 TeV with the ATLAS detector , 2014, 1408.7084.

[4]  P. D. Dauncey,et al.  Handling uncertainties in background shapes: the discrete profiling method , 2014, 1408.6865.

[5]  V. M. Ghete,et al.  Observation of the diphoton decay of the Higgs boson and measurement of its properties , 2014, The European physical journal. C, Particles and fields.

[6]  K. Cranmer,et al.  Search for a new gauge boson in electron-nucleus fixed-target scattering by the APEX experiment. , 2011, Physical review letters.

[7]  K. Cranmer,et al.  Asymptotic formulae for likelihood-based tests of new physics , 2010, 1007.1727.

[8]  E. Gross,et al.  Trial factors for the look elsewhere effect in high energy physics , 2010, 1005.1891.

[9]  N. Hjort,et al.  The Focused Information Criterion , 2003 .

[10]  David R. Anderson,et al.  Model selection and multimodel inference : a practical information-theoretic approach , 2003 .

[11]  K. Burnham,et al.  Model selection: An integral part of inference , 1997 .

[12]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[13]  M. Stone.  An Asymptotic Equivalence of Choice of Model by Cross‐Validation and Akaike's Criterion , 1977 .

[14]  H. Akaike.  A new look at the statistical model identification , 1974 .

[15]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[16]  Nils Lid Hjort,et al.  Model Selection and Model Averaging , 2001 .

[17]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[18]  T. Skwarnicki.  A study of the radiative CASCADE transitions between the Upsilon-Prime and Upsilon resonances , 1986 .