Pragmatic warrant for frequentist statistical practice: the case of high energy physics

Amidst long-running debates within the field, high energy physics (HEP) has adopted a statistical methodology that primarily employs standard frequentist techniques such as significance testing and confidence interval estimation, but incorporates Bayesian methods for limited purposes. The discovery of the Higgs boson has drawn increased attention to the statistical methods employed within HEP. Here I argue that the warrant for the practice in HEP of relying primarily on frequentist methods can best be understood as pragmatic, in the sense that statistical methods are chosen for their suitability for the practical demands of experimental HEP, rather than reflecting a commitment to a particular epistemic framework. In particular, I argue that understanding the statistical methodology of HEP through the perspective of pragmatism clarifies the role of and rationale for significance testing in the search for new phenomena such as the Higgs boson.

[1]  R. Fisher Statistical methods for research workers , 1927, Protoplasma.

[2]  V. M. Ghete,et al.  Combined results of searches for the standard model Higgs boson in pp collisions at √s = 7 TeV , 2012 .

[3]  P. Blackett The Positive Electron , 1933, Nature.

[4]  Heather Douglas Science, Policy, and the Value-Free Ideal , 2009 .

[5]  Margaret Morrison,et al.  Reconstructing Reality: Models, Mathematics, and Simulations , 2015 .

[6]  Richard Dawid Bayesian perspectives on the discovery of the Higgs particle , 2015, Synthese.

[7]  G. Unal,et al.  Evidence for top quark production in p p collisions at s = 1.8 TeV , 1994 .

[8]  J. T. Childers,et al.  Observation of a new particle in the search for the Standard Model Higgs boson with the ATLAS detector at the LHC , 2012 .

[9]  W. Bhimji,et al.  Computer simulations and experiments: The case of the Higgs boson , 2015 .

[10]  S. Maxfield Combined search for the Standard Model Higgs boson in $pp$ collisions at $\sqrts = 7$ TeV with the ATLAS detector , 2012 .

[11]  Robert D. Cousins,et al.  The Jeffreys–Lindley paradox and discovery criteria in high energy physics , 2013, Synthese.

[12]  R. Dawid Higgs Discovery and the Look Elsewhere Effect , 2015, Philosophy of Science.

[13]  Butler,et al.  Observation of the Top Quark. , 1995, Physical review letters.

[14]  Louis Lyons,et al.  Discovering the Significance of 5 sigma , 2013, 1310.1284.

[15]  R. Harlander,et al.  Next-to-next-to-leading order Higgs production at Hadron Colliders. , 2002, Physical review letters.

[16]  Kent W. Staley,et al.  Decisions , Decisions : Inductive Risk and the Higgs Boson , 2022 .

[17]  Kent W. Staley,et al.  The CDF Collaboration and Argumentation Theory: The Role of Process in Objective Knowledge , 2008, Perspectives on Science.

[18]  G. Unal Evidence for top quark production in p¯p collisions at s=1.8TeV , 1995 .

[19]  Robin Willink,et al.  Measurement Uncertainty and Probability: References , 2013 .

[20]  G. C. Pomraning A Method for Computing , 1965 .

[21]  Isaac Levi,et al.  On the Seriousness of Mistakes , 1962, Philosophy of Science.

[22]  C. Anderson The Positive Electron , 1933 .

[23]  Kent W. Staley What Experiment Did We Just Do? Counterfactual Error Statistics And Uncertainties About The Reference Class* , 2002, Philosophy of Science.

[24]  M. Albrow,et al.  OBSERVATION OF TOP QUARK PRODUCTION IN PP COLLISIONS WITH THE DETECTOR AT FERMILAB , 1995 .

[25]  G. Aad,et al.  Combined search for the Standard Model Higgs boson in $pp$ collisions at $\sqrt{s} = 7$ TeV with the ATLAS detector , 2012 .

[26]  Allan Franklin,et al.  Shifting Standards: Experiments in Particle Physics in the Twentieth Century , 2013 .

[27]  C. Jacoboni W. T. Eadie, D. Dryard, F. E. James, M. Roos e B. Sadoulet — Statistical methods in experimental physics , 1977 .

[28]  A. Ribon,et al.  Observation of top quark production in $\bar{p}p$ collisions , 1995 .

[29]  The Cms Collaboration Observation of a new boson at a mass of 125 GeV with the CMS experiment at the LHC , 2012, 1207.7235.

[30]  F. James Statistical Methods in Experimental Physics , 1973 .

[31]  Kent W. Staley The Evidence for the Top Quark: Objectivity and Bias in Collaborative Experimentation , 2004 .

[32]  Ryszard S. Romaniuk,et al.  Observation of a new boson at a mass of 125 GeV with the CMS experiment at the LHC , 2012 .

[33]  Charles S. Peirce,et al.  A theory of probable inference. , 1883 .

[34]  Jan Sprenger,et al.  Bayesianism vs. Frequentism in Statistical Inference , 2016 .

[35]  R. Cousins,et al.  A Unified Approach to the Classical Statistical Analysis of Small Signals , 1997, physics/9711021.

[36]  Richard S. Rudner The Scientist Qua Scientist Makes Value Judgments , 1953, Philosophy of Science.

[37]  Christopher Hitchcock,et al.  The Oxford Handbook of Probability and Philosophy , 2016 .

[38]  C. West Churchman,et al.  Statistics, Pragmatics, Induction , 1948, Philosophy of Science.

[39]  S. Moolgavkar,et al.  A Method for Computing Profile-Likelihood- Based Confidence Intervals , 1988 .

[40]  P. Achinstein Evidence and Method: Scientific Strategies of Isaac Newton and James Clerk Maxwell , 2013 .

[41]  David R. Cox The analysis of binary data , 1970 .

[42]  Robert Cousins,et al.  Incorporating systematic uncertainties into an upper limit , 1992 .