Where Do We Go Wrong in Assessing Risk Factors, Diagnostic and Prognostic Tests?The Problems of Two-by-Two Association

FULL DISCLOSURE POLICY In accordance with the Accreditation Council for Continuing Medical Education’s Standards for Commercial Support, all CME providers are required to disclose to the activity audience the relevant financial relationships of the planners, teachers, and authors involved in the development of CME content. An individual has a relevant financial relationship if he or she has a financial relationship in any amount occurring in the last 12 months with a commercial interest whose products or services are discussed in the CME activity content over which the individual has control. Relationship information appears at the beginning of each CME-accredited article in this issue.

[1]  D. Huff,et al.  How to Lie with Statistics , 1956 .

[2]  Jerome Cornfield,et al.  A Statistical Problem Arising from Retrospective Studies , 1956 .

[3]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[4]  Jacob Cohen,et al.  Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. , 1968 .

[5]  J. Fleiss.  On the asserted invariance of the odds ratio. , 1970, British journal of preventive & social medicine.

[6]  H. Herne,et al.  How to Lie with Statistics , 1973 .

[7]  B. Efron,et al.  A Leisurely Look at the Bootstrap, the Jackknife, and , 1983 .

[8]  F. Harrell,et al.  Factors affecting sensitivity and specificity of exercise electrocardiography. Multivariable analysis. , 1984, The American journal of medicine.

[9]  F. Harrell,et al.  Rethinking sensitivity and specificity. , 1987, The American journal of cardiology.

[10]  H. Kraemer,et al.  2 x 2 kappa coefficients: measures of agreement or association. , 1989, Biometrics.

[11]  Jacob Cohen.  The earth is round (p < .05) , 1994 .

[12]  R. Serlin,et al.  Misuse of statistical test in three decades of psychotherapy research. , 1994, Journal of consulting and clinical psychology.

[13]  D. Sackett,et al.  The number needed to treat: a clinically useful measure of treatment effect , 1995, BMJ.

[14]  M. O'Brecht,et al.  Evaluating medical tests: Objective and quantitative guidelines , 1995 .

[15]  Jonathan J. Deeks,et al.  Down with odds ratios! , 1996, Evidence Based Medicine.

[16]  M. Borenstein.  Hypothesis testing and effect size estimation in clinical trials. , 1997, Annals of allergy, asthma & immunology : official publication of the American College of Allergy, Asthma, & Immunology.

[17]  Patrick E. Shrout,et al.  Should Significance Tests be Banned? Introduction to a Special Section Exploring the Pros and Cons , 1997 .

[18]  J. Hunter.  Needed: A Ban on the Significance Test , 1997 .

[19]  Michael Borenstein,et al.  3.14 – The Shift from Significance Testing to Effect Size Estimation , 1998 .

[20]  Alan E. Kazdin,et al.  Measuring the potency of risk factors for clinical or policy significance. , 1999 .

[21]  Bruce Thompson,et al.  Journal Editorial Policies Regarding Statistical Significance Tests: Heat Is to Fire as p Is to Importance , 1999 .

[22]  Leland Wilkinson,et al.  Statistical Methods in Psychology Journals Guidelines and Explanations , 2005 .

[23]  R. Nickerson,et al.  Null hypothesis significance testing: a review of an old and continuing controversy. , 2000, Psychological methods.

[24]  L. V. Jones,et al.  A sensible formulation of the significance test. , 2000, Psychological methods.

[25]  P. Meehl.  Theoretical Risks and Tabular Asterisks: Sir Karl, Sir Ronald, and the Slow Progress of Soft Psychology , 2004 .

[26]  Helena Chmura Kraemer,et al.  Reconsidering the odds ratio as a measure of 2×2 association in a population , 2004, Statistics in medicine.

[27]  H. Kraemer.  Correlation coefficients in medical research: from product moment correlation to the odds ratio , 2006, Statistical methods in medical research.

[28]  R. Newcombe,et al.  A deficiency of the odds ratio as a measure of effect size , 2006, Statistics in medicine.

[29]  David J. Kupfer,et al.  Size of Treatment Effects and Their Importance to Clinical Research and Practice , 2006, Biological Psychiatry.

[30]  Robert Tibshirani,et al.  Computer‐Intensive Statistical Methods , 2006 .

[31]  David Hinkley,et al.  Bootstrap Methods: Another Look at the Jackknife , 2008 .