Evidence-based medicine, systematic reviews, and guidelines in interventional pain management: part 4: observational studies.

Evidence-based medicine (EBM) stresses the examination of evidence from clinical research and describes it as a shift in medical paradigms, in contrast to intuition, unsystematic clinical experience, and pathophysiologic rationale. While the importance of randomized trials has been created by the concept of the hierarchy of evidence in guiding therapy, much of the medical research is observational. There is competition, contrast, and a feeling of inferiority and uselessness for observational studies, created by a lack of understanding of medical research. However, observational studies and randomized clinical trials (RCTs) can be viewed as the steps of observation and experimentation that form the basis of the scientific methodology. Further, rational healthcare practices require knowledge about the etiology and pathogenesis, diagnosis, prognosis, and treatment of disorders. The reporting of observational research is often not detailed and clear enough with insufficient quality and poor reporting, which hampers the assessment of strengths and weaknesses of the study and the generalizability of the mixed results. Thus, design, implementation, and reporting of observational studies is crucial. The biased interpretation of results from observational studies, either in favor of or opposed to a treatment, and lack of proper understanding of observational studies, leads to a poor appraisal of the quality. Similar to the Consolidated Standards of Reporting Trials (CONSORT) statement for the reporting of randomized trials, the Strengthening of the Reporting of Observational Studies in Epidemiology (STROBE) statement was developed with recommendations to improve the quality of reporting observational studies. The STROBE statement consists of a checklist of 22 items, which relate to the title, abstract, introduction, methods, results, and discussion sections of articles. Multiple types of observational studies are conducted; however, 3 types have been highlighted in the STROBE document and also in the present review, which include cohort studies, case-controlled studies, and cross-sectional studies. This comprehensive review provides an introduction and rationale, types, design, and reporting of observational studies; outcomes assessment and data presentation and analysis; statistical analysis, results, and a discussion of observational studies.

[1]  P. Sedgwick Matching , 2009, BMJ : British Medical Journal.

[2]  Joshua H Levin,et al.  Prospective, double-blind, randomized placebo-controlled trials in interventional spine: what the highest quality literature tells us. , 2009, The spine journal : official journal of the North American Spine Society.

[3]  S. Datta,et al.  Systematic review of diagnostic utility and therapeutic effectiveness of cervical facet joint interventions. , 2009, Pain physician.

[4]  D. Moher,et al.  Improving the reporting of pragmatic trials: an extension of the CONSORT statement , 2008, BMJ : British Medical Journal.

[5]  L. Manchikanti,et al.  Preliminary results of a randomized, equivalence trial of fluoroscopic caudal epidural injections in managing chronic low back pain: Part 4--Spinal stenosis. , 2008, Pain physician.

[6]  L. Manchikanti,et al.  Preliminary results of a randomized, equivalence trial of fluoroscopic caudal epidural injections in managing chronic low back pain: Part 2--Disc herniation and radiculitis. , 2008, Pain physician.

[7]  Howard S. Smith,et al.  Preliminary results of a randomized, equivalence trial of fluoroscopic caudal epidural injections in managing chronic low back pain: Part 1--Discogenic pain without disc herniation or radiculitis. , 2008, Pain physician.

[8]  A. Hoes,et al.  Poor quality of reporting confounding bias in observational intervention studies: a systematic review. , 2008, Annals of epidemiology.

[9]  Jonathan J Deeks,et al.  Including Non‐Randomized Studies , 2008 .

[10]  John P A Ioannidis,et al.  Effect of formal statistical significance on the credibility of observational associations. , 2008, American journal of epidemiology.

[11]  L. Manchikanti,et al.  Cervical Medial Branch Blocks for Chronic Cervical Facet Joint Pain: A Randomized, Double-Blind, Controlled Trial With One-Year Follow-up , 2008, Spine.

[12]  H. D. de Vet,et al.  Injection therapy for subacute and chronic low-back pain. , 2008, The Cochrane database of systematic reviews.

[13]  L. Manchikanti,et al.  Reassessment of evidence synthesis of occupational medicine practice guidelines for interventional pain management. , 2008, Pain physician.

[14]  L. Manchikanti,et al.  Effectiveness of thoracic medial branch blocks in managing chronic pain: a preliminary report of a randomized, double-blind controlled trial. , 2008, Pain physician.

[15]  R. Chou Using evidence in pain practice: Part I: Assessing quality of systematic reviews and clinical practice guidelines. , 2008, Pain medicine.

[16]  R. Chou Using evidence in pain practice: Part II: Interpreting and applying systematic reviews and clinical practice guidelines. , 2008, Pain medicine.

[17]  M. Setia Observational studies: how to go about them? , 2008, Indian journal of dermatology, venereology and leprology.

[18]  L. Manchikanti,et al.  A critical appraisal of 2007 American College of Occupational and Environmental Medicine (ACOEM) Practice Guidelines for Interventional Pain Management: an independent review utilizing AGREE, AMA, IOM, and other criteria. , 2008, Pain physician.

[19]  P. Staats,et al.  Review of occupational medicine practice guidelines for interventional pain management and potential implications. , 2008, Pain physician.

[20]  D. Moher,et al.  Endorsement of the CONSORT Statement by high impact factor medical journals: a survey of journal editors and journal 'Instructions to Authors' , 2008, Trials.

[21]  Laxmaiah Manchikanti,et al.  Evidence-based medicine, systematic reviews, and guidelines in interventional pain management, part I: introduction and general considerations. , 2008, Pain physician.

[22]  L. Manchikanti,et al.  Lumbar facet joint nerve blocks in managing chronic facet joint pain: one-year follow-up of a randomized, double-blind controlled trial: Clinical Trial NCT00355914. , 2008, Pain physician.

[23]  M. Nordin,et al.  Treatment of Neck Pain: Injections and Surgical Interventions: Results of the Bone and Joint Decade 2000–2010 Task Force on Neck Pain and Its Associated Disorders , 2008, Spine.

[24]  H. MacPherson,et al.  A Systematic Evaluation of the Impact of STRICTA and CONSORT Recommendations on Quality of Reporting for Acupuncture Trials , 2008, PloS one.

[25]  J. Tyson,et al.  Clinical research methodology I: introduction to randomized trials. , 2008, Journal of the American College of Surgeons.

[26]  L. Manchikanti Interventional Pain Management: Past, Present, and Future. The Prithvi Raj Lecture: Presented at the 4th World Congress—World Institute of Pain, Budapest, 2007 , 2007, Pain practice : the official journal of World Institute of Pain.

[27]  Stephen W Lagakos,et al.  Statistics in medicine--reporting of subgroup analyses in clinical trials. , 2007, The New England journal of medicine.

[28]  Ian Shrier,et al.  Should meta-analyses of interventions include observational studies in addition to randomized controlled trials? A critical examination of underlying principles. , 2007, American journal of epidemiology.

[29]  S. Pocock,et al.  Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): Explanation and Elaboration , 2007, Epidemiology.

[30]  S. Pocock,et al.  Strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies , 2007, BMJ : British Medical Journal.

[31]  J. Higgins,et al.  Tools for assessing quality and susceptibility to bias in observational studies in epidemiology: a systematic review and annotated bibliography. , 2007, International journal of epidemiology.

[32]  L. Manchikanti,et al.  Evaluation of lumbar facet joint nerve blocks in the management of chronic low back pain: preliminary report of a randomized, double-blind controlled trial: clinical trial NCT00355914. , 2007, Pain physician.

[33]  G. Kingsley,et al.  Non-steroidal anti-inflammatory drugs and myocardial infarctions: comparative systematic review of evidence from observational studies and randomised controlled trials , 2007, Annals of the rheumatic diseases.

[34]  C. Argoff,et al.  Assessment: Use of epidural steroid injections to treat radicular lumbosacral pain , 2007, Neurology.

[35]  M. Hotopf,et al.  Bias in psychiatric case–control studies , 2007, British Journal of Psychiatry.

[36]  C. Short,et al.  Placebo Theory and Its Implications for Research and Clinical Practice: A Review of the Recent Literature , 2007, Pain practice : the official journal of World Institute of Pain.

[37]  L. Manchikanti,et al.  Evidence-based interventional pain management: principles, problems, potential and applications. , 2007, Pain physician.

[38]  E. Boyd,et al.  Improving the use of research evidence in guideline development: 4. Managing conflicts of interests , 2006, Health research policy and systems.

[39]  Diana Elbourne,et al.  Standards of Reporting of Randomized Controlled Trials in General Surgery: Can We Do Better? , 2006, Annals of surgery.

[40]  D. Moher,et al.  The Reporting of Randomized Clinical Trials Using a Surgical Intervention Is in Need of Immediate Improvement: A Systematic Review , 2006, Annals of surgery.

[41]  T. Nakayama,et al.  Comparison of Effects in Randomized Controlled Trials With Observational Studies in Digestive Surgery , 2006, Annals of surgery.

[42]  Steven Woloshin,et al.  Ratio measures in leading medical journals: structured review of accessibility of underlying absolute risks , 2006, BMJ : British Medical Journal.

[43]  S. London,et al.  Exposure to Alternaria alternata in US homes is associated with asthma symptoms. , 2006, The Journal of allergy and clinical immunology.

[44]  L. Manchikanti,et al.  Therapeutic cervical medial branch blocks in managing chronic neck pain: a preliminary report of a randomized, double-blind, controlled trial: clinical trial NCT0033272. , 2006, Pain physician.

[45]  D. Moher,et al.  Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review , 2006, The Medical journal of Australia.

[46]  L. Lenke,et al.  Nerve root blocks in the treatment of lumbar radicular pain. A minimum five-year follow-up. , 2006, The Journal of bone and joint surgery. American volume.

[47]  Peter C Gøtzsche,et al.  Believability of relative risks and odds ratios in abstracts: cross sectional study , 2006, BMJ : British Medical Journal.

[48]  T. Koepsell,et al.  Hormonal exposures and the risk of intracranial meningioma in women: a population-based case-control study , 2006, BMC Cancer.

[49]  S. Lagakos The challenge of subgroup analyses--reporting without distorting. , 2006, The New England journal of medicine.

[50]  L. Manchikanti,et al.  Evaluation of therapeutic thoracic medial branch block effectiveness in chronic thoracic pain: a prospective outcome study with minimum 1-year follow up. , 2006, Pain physician.

[51]  Henrica C W de Vet,et al.  Minimal Clinically Important Change for Pain Intensity, Functional Status, and General Health Status in Patients With Nonspecific Low Back Pain , 2006, Spine.

[52]  H. Ursin,et al.  Chapter 4 European guidelines for the management of chronic nonspecific low back pain , 2006, European Spine Journal.

[53]  John P.A. Ioannidis,et al.  Comparison of evidence on harms of medical interventions in randomized and nonrandomized studies , 2006, Canadian Medical Association Journal.

[54]  J. Habbema,et al.  Subgroup analyses in therapeutic cardiovascular clinical trials: are most of them misleading? , 2006, American heart journal.

[55]  Douglas G Altman,et al.  Dichotomizing continuous predictors in multiple regression: a bad idea , 2006, Statistics in medicine.

[56]  A. Dobson,et al.  RE: “QUALITY OF REPORTING OF OBSERVATIONAL LONGITUDINAL RESEARCH” , 2005 .

[57]  Andrew J Vickers,et al.  Parametric versus non-parametric statistics in the analysis of randomized trials with non-normally distributed data , 2005, BMC medical research methodology.

[58]  R Slama,et al.  Controlling for continuous confounding factors: non- and semiparametric approaches. , 2005, Revue d'epidemiologie et de sante publique.

[59]  G. Preminger,et al.  Clinical research and statistical methods in the urology literature. , 2005, The Journal of urology.

[60]  D. Lanska,et al.  Assessing observational studies of medical treatments , 2005, Emerging themes in epidemiology.

[61]  R. Burgkart,et al.  [Chronic radiculopathy. Use of minimally invasive percutaneous epidural neurolysis according to Racz]. , 2005, Schmerz.

[62]  C. Farquhar,et al.  High dose chemotherapy and autologous bone marrow or stem cell transplantation versus conventional chemotherapy for women with metastatic breast cancer. , 2005, The Cochrane database of systematic reviews.

[63]  L. Barnsley Percutaneous radiofrequency neurotomy for chronic neck pain: outcomes in a series of consecutive patients. , 2005, Pain medicine.

[64]  Kay Dickersin,et al.  Selective exposure reporting and Medline indexing limited the search sensitivity for observational studies of the adverse effects of oral contraceptives. , 2005, Journal of clinical epidemiology.

[65]  Jeffrey E. Lee,et al.  Feasibility of a randomized trial of extended lymphadenectomy for pancreatic cancer. , 2005, Archives of surgery.

[66]  J. Manson,et al.  Prospective study of type 2 diabetes mellitus and risk of primary open-angle glaucoma in women. , 2005, Ophthalmology.

[67]  K. Schulz,et al.  Sample size calculations in randomised trials: mandatory and mystical , 2005, The Lancet.

[68]  D. Urbach,et al.  Users' guide to the surgical literature. Case-control studies in surgical journals. , 2005, Canadian journal of surgery. Journal canadien de chirurgie.

[69]  P. Rothwell Subgroup analysis in randomised controlled trials: importance, indications, and interpretation , 2005, The Lancet.

[70]  P. Whincup,et al.  The British Regional Heart Study 1975-2004. , 2004, International journal of epidemiology.

[71]  V. McCormack,et al.  Issues in the reporting of epidemiological studies: a survey of recent practice , 2004, BMJ : British Medical Journal.

[72]  D. Hess,et al.  How to write an effective discussion. , 2004, Respiratory care.

[73]  G. Buttermann The effect of spinal steroid injections for degenerative disc disease. , 2004, The spine journal : official journal of the North American Spine Society.

[74]  A. Hrõbjartsson,et al.  Is the placebo powerless? Update of a systematic review with 52 new randomized trials comparing placebo with no treatment , 2004, Journal of internal medicine.

[75]  Y. Hirabayashi,et al.  Lysis of adhesions and epidural injection of steroid/local anaesthetic during epiduroscopy potentially alleviate low back and leg pain in elderly patients with lumbar spinal stenosis. , 2004, British journal of anaesthesia.

[76]  Thomas V Perneger,et al.  Writing a research article: advice to beginners. , 2004, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[77]  H. MacPherson Pragmatic clinical trials. , 2004, Complementary therapies in medicine.

[78]  A. Buda,et al.  Increased Risk of Hepatocellular Carcinoma and Liver Cirrhosis in Vinyl Chloride Workers: Synergistic Effect of Occupational Exposure with Alcohol Intake , 2004, Environmental health perspectives.

[79]  A. Hrõbjartsson,et al.  Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. , 2004, JAMA.

[80]  L. Manchikanti,et al.  Effectiveness of cervical medial branch blocks in chronic neck pain: a prospective outcome study. , 2004, Pain physician.

[81]  G. Buttermann Treatment of Lumbar Disc Herniation : Epidural Steroid Injection Compared with Discectomy , 2004 .

[82]  Paul Glasziou,et al.  Assessing the quality of research , 2004, BMJ : British Medical Journal.

[83]  T. Peters,et al.  The duration of acute cough in pre-school children presenting to primary care: a prospective cohort study. , 2003, Family practice.

[84]  P. Bossuyt,et al.  BMC Medical Research Methodology , 2002 .

[85]  M. Bhandari,et al.  Assessing Observational Studies of Spinal Fusion and Chemonucleolysis , 2003, Spine.

[86]  F. Song,et al.  Evaluating non-randomised intervention studies. , 2003, Health technology assessment.

[87]  E. Kalso,et al.  Radiofrequency Denervation for Neck and Back Pain: A Systematic Review Within the Framework of the Cochrane Collaboration Back Review Group , 2003, Spine.

[88]  L. Arab,et al.  Commentary: This study failed? , 2003, International journal of epidemiology.

[89]  Carl V Phillips,et al.  Quantifying and Reporting Uncertainty from Systematic Errors , 2003, Epidemiology.

[90]  Timothy L Lash,et al.  Semi-Automated Sensitivity Analysis to Assess Systematic Errors in Observational Data , 2003, Epidemiology.

[91]  B. Djulbegovic,et al.  Pharmaceutical industry sponsorship and research outcome and quality: systematic review , 2003, BMJ : British Medical Journal.

[92]  B. Beermann,et al.  Evidence b(i)ased medicine—selective reporting from studies sponsored by pharmaceutical industry: review of studies in new drug applications , 2003, BMJ : British Medical Journal.

[93]  J. Eng,et al.  Sample Size Estimation : How Many Individuals Should Be Studied ? , 2022 .

[94]  Sander Greenland,et al.  The Impact of Prior Distributions for Uncontrolled Confounding and Response Bias , 2003 .

[95]  JoDee Anderson,et al.  Development of a quality assessment scale for retrospective clinical studies in pediatric surgery. , 2003, Journal of pediatric surgery.

[96]  C. Gross,et al.  Scope and impact of financial conflicts of interest in biomedical research: a systematic review. , 2003, JAMA.

[97]  D. Rennie,et al.  Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative , 2003, Annals of Internal Medicine.

[98]  D. Rennie,et al.  Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative , 2003, BMJ : British Medical Journal.

[99]  C. Mann,et al.  Observational research methods. Research design II: cohort, cross sectional, and case-control studies , 2003, Emergency medicine journal : EMJ.

[100]  K. Botwin,et al.  Fluoroscopically Guided Lumbar Transformational Epidural Steroid Injections in Degenerative Lumbar Stenosis: An Outcome Study , 2002, American journal of physical medicine & rehabilitation.

[101]  Gonghuan Yang,et al.  Risk factors for suicide in China: a national case-control psychological autopsy study , 2002, The Lancet.

[102]  D. Turk Clinical Effectiveness and Cost-Effectiveness of Treatments for Patients With Chronic Pain , 2002, The Clinical journal of pain.

[103]  P. Orris,et al.  Providing employer-arranged occupational medical care: conflicting interests. , 2002, Occupational medicine.

[104]  L. Manchikanti,et al.  Medial branch neurotomy in management of chronic spinal pain: systematic review of the evidence. , 2002, Pain physician.

[105]  M. Elwood Forward projection--using critical appraisal in the design of studies. , 2002, International journal of epidemiology.

[106]  M. Hotopf The pragmatic randomised controlled trial , 2002 .

[107]  D. Safer DESIGN AND REPORTING MODIFICATIONS IN INDUSTRY-SPONSORED COMPARATIVE PSYCHOPHARMACOLOGY TRIALS , 2002, The Journal of nervous and mental disease.

[108]  L. Manchikanti,et al.  Research designs in interventional pain management: is randomization superior, desirable or essential? , 2002, Pain physician.

[109]  Mitsuru Sasako,et al.  Randomised trials in surgery: problems and possible solutions , 2002, BMJ : British Medical Journal.

[110]  Richard Horton,et al.  The hidden research paper. , 2002, JAMA.

[111]  Douglas G Altman,et al.  Survival plots of time-to-event outcomes in clinical trials: good practice and pitfalls , 2002, The Lancet.

[112]  Til Stürmer,et al.  Flexible matching strategies to increase power and efficiency to detect and estimate gene-environment interactions in case-control studies. , 2002, American journal of epidemiology.

[113]  N McKoy,et al.  Systems to rate the strength of scientific evidence. , 2002, Evidence report/technology assessment.

[114]  R. Pietrobon,et al.  Standard Scales for Measurement of Functional Outcome for Cervical Pain or Dysfunction: A Systematic Review , 2002, Spine.

[115]  K. Schulz,et al.  Case-control studies: research in reverse , 2002, The Lancet.

[116]  Jane Garner,et al.  The case against ‘the evidence’: A different perspective on evidence-based medicine , 2002, British Journal of Psychiatry.

[117]  Michael Yost,et al.  A Nested Case-Control Study of Residential and Personal Magnetic Field Measures and Miscarriages , 2002, Epidemiology.

[118]  W. V. D. van den Heuvel,et al.  How to validate clinically important change in health-related functional status. Is the magnitude of the effect size consistently related to magnitude of change as indicated by a global question rating? , 2001, Journal of evaluation in clinical practice.

[119]  J. Farrar,et al.  Clinical importance of changes in chronic pain intensity measured on an 11-point numerical pain rating scale , 2001, PAIN.

[120]  L. Manchikanti,et al.  Caudal epidural injections with sarapin or steroids in chronic low back pain. , 2001, Pain physician.

[121]  M. Radford,et al.  How do observational studies expand the evidence base for therapy? , 2001, JAMA.

[122]  H. Worthington,et al.  Systematic review of population-based epidemiological studies of oro-facial pain. , 2001, Journal of dentistry.

[123]  R. Harbour,et al.  A new system for grading recommendations in evidence based guidelines , 2001, BMJ : British Medical Journal.

[124]  C V Phillips,et al.  The economics of 'more research is needed'. , 2001, International journal of epidemiology.

[125]  Douglas G Altman,et al.  Systematic reviews in health care: Assessing the quality of controlled clinical trials. , 2001, BMJ.

[126]  Andrew J Vickers,et al.  The use of percentage change from baseline as an outcome in a controlled trial is statistically inefficient: a simulation study , 2001, BMC medical research methodology.

[127]  G. Groen,et al.  Targeted Methylprednisolone Acetate/Hyaluronidase/Clonidine Injection After Diagnostic Epiduroscopy for Chronic Sciatica: A Prospective, 1-Year Follow-up Study , 2001, Regional Anesthesia & Pain Medicine.

[128]  W Uter,et al.  The application of methods to quantify attributable risk in medical practice , 2001, Statistical methods in medical research.

[129]  A. Hrõbjartsson,et al.  Is the placebo powerless? An analysis of clinical trials comparing placebo with no treatment. , 2001, The New England journal of medicine.

[130]  J. Robins Data, Design, and Background Knowledge in Etiologic Inference , 2001, Epidemiology.

[131]  O. Tervonen,et al.  Periradicular Infiltration for Sciatica: A Randomized Controlled Trial , 2001, Spine.

[132]  D. Rennie CONSORT revised--improving the reporting of randomized trials. , 2001, JAMA.

[133]  D. Moher,et al.  Use of the CONSORT statement and quality of reports of randomized trials: a comparative before-and-after evaluation. , 2001, JAMA.

[134]  D. Moher,et al.  The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration , 2001, Annals of Internal Medicine.

[135]  L S Rothenberg,et al.  Conflict of interest policies in science and medical journals: Editorial practices and author disclosures , 2001, Science and engineering ethics.

[136]  D. Mroczek,et al.  The neglect of response bias in mental health research. , 2001, The Journal of nervous and mental disease.

[137]  R. Lilford,et al.  Are randomized clinical trials good for us (in the short term)? Evidence for a "trial effect". , 2001, Journal of clinical epidemiology.

[138]  F. Sturmans,et al.  Injection Therapy for Subacute and Chronic Benign Low Back Pain , 2001, The Cochrane database of systematic reviews.

[139]  M. Thorogood,et al.  The relationship between use of oral contraceptives and myocardial infarction in young women with fatal outcome, compared to those who survive: results from the MICA case-control study. , 2001, Contraception.

[140]  R. Stolker,et al.  Efficacy of Radiofrequency Procedures for the Treatment of Spinal Pain: A Systematic Review of Randomized Clinical Trials , 2001, Regional Anesthesia & Pain Medicine.

[141]  E. Funai,et al.  Distribution of Study Designs in Four Major US Journals of Obstetrics and Gynecology , 2001, Gynecologic and Obstetric Investigation.

[142]  P. Pynsent,et al.  The Oswestry Disability Index. , 2000, Spine.

[143]  D. Turk,et al.  "Statistical significance and clinical significance are not synonyms!". , 2000, The Clinical journal of pain.

[144]  L. Manchikanti,et al.  The diagnostic validity and therapeutic value of lumbar facet joint nerve blocks with or without adjuvant agents , 2000, Current review of pain.

[145]  T. Greene Are Observational Studies ‘Just as Effective’ as Randomized Clinical Trials? , 2000, Blood Purification.

[146]  Dianne C Barker,et al.  Effect of restrictions on smoking at home, at school, and in public places on teenage smoking: cross sectional study , 2000, BMJ : British Medical Journal.

[147]  N. Nagelkerke,et al.  Estimating treatment effects in randomized clinical trials in the presence of non-compliance. , 2000, Statistics in medicine.

[148]  A. Silman,et al.  Occupational risk factors for shoulder pain: a systematic review , 2000, Occupational and environmental medicine.

[149]  G. Eknoyan,et al.  Methods used to evaluate the quality of evidence underlying the National Kidney Foundation-Dialysis Outcomes Quality Initiative Clinical Practice Guidelines: description, findings, and implications. , 2000, American journal of kidney diseases : the official journal of the National Kidney Foundation.

[150]  A. Hartz,et al.  A comparison of observational studies and randomized, controlled trials , 2000, American journal of ophthalmology.

[151]  J. Concato,et al.  Randomized, controlled trials, observational studies, and the hierarchy of research designs. , 2000, The New England journal of medicine.

[152]  B Halbrook,et al.  Efficacy and validity of radiofrequency neurotomy for chronic lumbar zygapophysial joint pain. , 2000, Spine.

[153]  B. Charlton,et al.  New perspectives in the evidence-based healthcare debate. , 2000, Journal of evaluation in clinical practice.

[154]  I. Olkin,et al.  Meta-analysis of observational studies in epidemiology - A proposal for reporting , 2000 .

[155]  M. Martínez-González,et al.  Intention to treat analysis is related to methodological quality , 2000, BMJ : British Medical Journal.

[156]  H. Williams,et al.  How well are randomized controlled trials reported in the dermatology literature? , 2000, Archives of dermatology.

[157]  P M Bongers,et al.  Physical risk factors for neck pain. , 2000, Scandinavian journal of work, environment & health.

[158]  G. Corrao,et al.  Exploring the dose-response relationship between alcohol consumption and the risk of several alcohol-related conditions: a meta-analysis. , 1999, Addiction.

[159]  D. Rennie,et al.  Measuring the quality of trials: the quality of quality scales. , 1999, JAMA.

[160]  P. Bossuyt,et al.  Empirical evidence of design-related bias in studies of diagnostic tests. , 1999, JAMA.

[161]  M. Hotopf,et al.  Pragmatic randomised controlled trials in psychiatry , 1999, British Journal of Psychiatry.

[162]  J. Ioannidis,et al.  Pooling research results: benefits and limitations of meta-analysis. , 1999, The Joint Commission journal on quality improvement.

[163]  K. Lohr,et al.  Assessing "best evidence": issues in grading the quality of studies for systematic reviews. , 1999, The Joint Commission journal on quality improvement.

[164]  M Lipsett,et al.  Occupational exposure to diesel exhaust and lung cancer: a meta-analysis. , 1999, American journal of public health.

[165]  S. Goodman Toward Evidence-Based Medical Statistics. 1: The P Value Fallacy , 1999, Annals of Internal Medicine.

[166]  B. Stricker,et al.  Confounding by indication: an example of variation in the use of epidemiologic terminology. , 1999, American journal of epidemiology.

[167]  A R Feinstein,et al.  Clinical epidemiological quality in molecular genetic research: the need for methodological standards. , 1999, JAMA.

[168]  M Docherty,et al.  The case for structuring the discussion of scientific papers , 1999, BMJ.

[169]  W M Tierney,et al.  Linking clinical relevance and statistical significance in evaluating intra-individual changes in health-related quality of life. , 1999, Medical care.

[170]  W. Hardin,et al.  Evidence-based practice in pediatric surgery. , 1999, Journal of pediatric surgery.

[171]  K. Covinsky,et al.  Assessing the Generalizability of Prognostic Information , 1999, Annals of Internal Medicine.

[172]  P. Bridge,et al.  Increasing physicians' awareness of the impact of statistics on research outcomes: comparative power of the t-test and and Wilcoxon Rank-Sum test in small samples applied research. , 1999, Journal of clinical epidemiology.

[173]  M Blettner,et al.  Traditional reviews, meta-analyses and pooled analyses in epidemiology. , 1999, International journal of epidemiology.

[174]  J. Olsen,et al.  Re: Residual confounding. , 1999, American journal of epidemiology.

[175]  A. Feinstein,et al.  Antecedent therapy versus detection bias as causes of neoplastic multimorbidity. , 1999, American journal of clinical oncology.

[176]  Warren S. Browner,et al.  Publishing and presenting clinical research , 1999 .

[177]  C Poole,et al.  More research is needed. , 1999, Annals of epidemiology.

[178]  G H Guyatt,et al.  Sensitivity to change of the Roland-Morris Back Pain Questionnaire: part 1. , 1998, Physical therapy.

[179]  G. Lutz,et al.  Fluoroscopic transforaminal lumbar epidural steroids: an outcome study. , 1998, Archives of physical medicine and rehabilitation.

[180]  C. Adams,et al.  Content and quality of 2000 controlled trials in schizophrenia over 50 years , 1998, BMJ.

[181]  F. Davidoff,et al.  Changes to manuscripts during the editorial process: characterizing the evolution of a clinical paper. , 1998, JAMA.

[182]  O. Devine,et al.  Estimating sample size for epidemiologic studies: the impact of ignoring exposure measurement uncertainty. , 1998, Statistics in medicine.

[183]  J. Kaprio,et al.  Lone atrial fibrillation in vigorously exercising middle aged men: case-control study , 1998, BMJ.

[184]  N. Black,et al.  The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. , 1998, Journal of epidemiology and community health.

[185]  G. Smith,et al.  Adverse socioeconomic conditions in childhood and cause specific adult mortality: prospective observational study , 1998, BMJ.

[186]  T. Nakayama,et al.  Reporting of attributable and relative risks, 1966–97 , 1998, The Lancet.

[187]  A R Feinstein,et al.  P-values and confidence intervals: two sides of the same unsatisfactory coin. , 1998, Journal of clinical epidemiology.

[188]  M. Swiontkowski,et al.  Closed Fractures of the Tibial Shaft: A Meta-Analysis of Three Methods of Treatment* , 1998, The Journal of bone and joint surgery. American volume.

[189]  T. Kiviluoto,et al.  Randomised trial of laparoscopic versus open cholecystectomy for acute and gangrenous cholecystitis , 1998, The Lancet.

[190]  G. Smith,et al.  Meta-analysis Spurious precision? Meta-analysis of observational studies , 1998, BMJ.

[191]  G Lewith,et al.  How Should we Research Unconventional Therapies? A Panel Report from the Conference on Complementary and Alternative Medicine Research Methodology, National Institutes of Health , 1997, International Journal of Technology Assessment in Health Care.

[192]  A. Feinstein,et al.  Problems in the "evidence" of "evidence-based medicine". , 1997, The American journal of medicine.

[193]  J. L. Botha,et al.  How do individuals with diabetes use the accident and emergency department? , 1997, Journal of accident & emergency medicine.

[194]  Lex M. Bouter,et al.  Conservative Treatment of Acute and Chronic Nonspecific Low Back Pain: A Systematic Review of Randomized Controlled Trials of the Most Common Interventions , 1997, Spine.

[195]  G Lewis,et al.  Putting trials on trial--the costs and consequences of small trials in depression: a systematic review of methodology. , 1997, Journal of epidemiology and community health.

[196]  Stephen Senn,et al.  Statistical Issues in Drug Development , 1997 .

[197]  A. Jadad,et al.  How Consumers and Policymakers Can Use Systematic Reviews for Decision Making , 1997, Annals of Internal Medicine.

[198]  H Brenner,et al.  Controlling for Continuous Confounders in Epidemiologic Research , 1997, Epidemiology.

[199]  S. Carette,et al.  Epidural corticosteroid injections for sciatica due to herniated nucleus pulposus. , 1997, The New England journal of medicine.

[200]  N Bogduk,et al.  Percutaneous radio-frequency neurotomy for chronic cervical zygapophyseal-joint pain. , 1996, The New England journal of medicine.

[201]  Ebm Notebook,et al.  Transferring evidence from research into practice: 1. The role of clinical care research evidence in clinical decisions , 1996, ACP Journal Club.

[202]  James Hartley,et al.  Obtaining information accurately and quickly: are structured abstracts more efficient? , 1996, J. Inf. Sci..

[203]  D G Altman,et al.  Absence of evidence is not evidence of absence. , 1996, Australian veterinary journal.

[204]  D. Torgerson,et al.  Patient Preferences in Randomised Trials: Threat or Opportunity? , 1996, Journal of health services research & policy.

[205]  D C Hadorn,et al.  Rating the quality of evidence for clinical practice guidelines. , 1996, Journal of clinical epidemiology.

[206]  L. Bero,et al.  Industry-funded research and conflict of interest: an analysis of research sponsored by the tobacco industry through the Center for Indoor Air Research. , 1996, Journal of health politics, policy and law.

[207]  C. Weijer,et al.  What difference does it make to be treated in a clinical trial? A pilot study. , 1996, Clinical and investigative medicine. Medecine clinique et experimentale.

[208]  N. Black Why we need observational studies to evaluate the effectiveness of health care , 1996, BMJ.

[209]  N. Talley,et al.  Drug treatment of functional dyspepsia: a systematic analysis of trial methodology with recommendations for design of future trials. , 1996, The American journal of gastroenterology.

[210]  I. Tannock,et al.  False-positive results in clinical trials: multiple significance tests and the problem of unreported comparisons. , 1996, Journal of the National Cancer Institute.

[211]  James Hartley,et al.  Which layout do you prefer? An analysis of readers' preferences for different typographic layouts of structured abstracts , 1996, J. Inf. Sci..

[212]  L. Bouter,et al.  Efficacy of epidural steroid injections for low-back pain and sciatica: a systematic review of randomized clinical trials , 1995, Pain.

[213]  R. L. Aspinall,et al.  Denial of effective treatment and poor quality of clinical information in placebo controlled trials of ondansetron for postoperative nausea and vomiting: a review of published trials , 1995, BMJ.

[214]  R. McLeod,et al.  Should we be performing more randomized controlled trials evaluating surgical operations? , 1995, Surgery.

[215]  D. Cowley,et al.  Prostheses for Primary Total Hip Replacement: A Critical Appraisal of the Literature , 1995, International Journal of Technology Assessment in Health Care.

[216]  A R Feinstein,et al.  Use of methodological standards in diagnostic test research. Getting better but still not good. , 1995, JAMA.

[217]  D G Altman,et al.  Statistics notes: Absence of evidence is not evidence of absence , 1995 .

[218]  D. G. Altman,et al.  Review of survival analyses published in cancer journals. , 1995, British Journal of Cancer.

[219]  R. Horton The rhetoric of research , 1995, BMJ.

[220]  D. Rubin,et al.  Intention‐to‐treat analysis and the goals of clinical trials , 1995, Clinical pharmacology and therapeutics.

[221]  C. Mann Can meta-analysis make policy? , 1994, Science.

[222]  M. Avis Reading research critically. II. An introduction to appraisal: assessing the evidence. , 1994, Journal of clinical nursing.

[223]  P Tugwell,et al.  Users' guides to the medical literature. V. How to use an article about prognosis. Evidence-Based Medicine Working Group. , 1994, JAMA.

[224]  Gordon H. Guyatt,et al.  Users' Guides to the Medical Literature: V. How to Use an Article About Prognosis , 1994 .

[225]  M. Cho,et al.  Instruments for assessing the quality of drug studies published in the medical literature. , 1994, JAMA.

[226]  D. Moher,et al.  Statistical power, sample size, and their reporting in randomized controlled trials. , 1994, JAMA.

[227]  A D Oxman,et al.  An approach to the development of practice guidelines for community health interventions. , 1994, Canadian journal of public health = Revue canadienne de sante publique.

[228]  S. Goodman,et al.  Manuscript Quality before and after Peer Review and Editing at Annals of Internal Medicine , 1994, Annals of Internal Medicine.

[229]  W. Sauerbrei,et al.  Dangers of using "optimal" cutpoints in the evaluation of prognostic factors. , 1994, Journal of the National Cancer Institute.

[230]  D. Sackett,et al.  Users' guides to the medical literature. IV. How to use an article about harm. Evidence-Based Medicine Working Group. , 1994, JAMA.

[231]  T R Einarson,et al.  Quality of nonstructured and structured abstracts of original research articles in the British Medical Journal, the Canadian Medical Association Journal and the Journal of the American Medical Association. , 1994, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[232]  S. Greenland,et al.  Simulation study of confounder-selection strategies. , 1993, American journal of epidemiology.

[233]  P. Freeman,et al.  The role of p-values in analysing trial results. , 1993, Statistics in medicine.

[234]  C. Bradley Designing Medical and Educational Intervention Studies: A review of some alternatives to conventional randomized controlled trials , 1993, Diabetes Care.

[235]  M. Woodward Formulae for Sample Size, Power and Minimum Detectable Relative Risk in Medical Studies , 1992 .

[236]  C. Sherbourne,et al.  The MOS 36-Item Short-Form Health Survey (SF-36) , 1992 .

[237]  D. Altman Confidence intervals in research evaluation , 1992, ACP Journal Club.

[238]  R. Blair,et al.  A more realistic look at the robustness and Type II error properties of the t test to departures from population normality. , 1992 .

[239]  W Vach,et al.  Biased estimation of the odds ratio in case-control studies due to the use of ad hoc methods of correcting for missing values for confounding variables. , 1991, American journal of epidemiology.

[240]  Marie E. Latulippe,et al.  A controlled trial of corticosteroid injections into facet joints for chronic low back pain. , 1991, The New England journal of medicine.

[241]  S. Mior,et al.  The Neck Disability Index: a study of reliability and validity. , 1991, Journal of manipulative and physiological therapeutics.

[242]  F G Fowkes,et al.  Critical appraisal of published research: introductory guidelines. , 1991, BMJ.

[243]  J. Vandenbroucke Prospective or retrospective: what's in a name? , 1991, BMJ.

[244]  C. Viscoli,et al.  Developing improved observational methods for evaluating therapeutic effectiveness. , 1990, The American journal of medicine.

[245]  Bruno D. Zumbo,et al.  Effect of Outliers on the Relative Power of Parametric and Nonparametric Statistical Tests , 1990 .

[246]  M. Gardner,et al.  More informative abstracts revisited. , 1990, The Cleft palate-craniofacial journal : official publication of the American Cleft Palate-Craniofacial Association.

[247]  K Drescher,et al.  The design of case-control studies: the effect of confounding on sample size requirements. , 1990, Statistics in medicine.

[248]  L Abenhaim,et al.  Links between passive smoking and disease: a best-evidence synthesis. A report of the Working Group on Passive Smoking. , 1990, Clinical and investigative medicine. Medecine clinique et experimentale.

[249]  G. Guyatt,et al.  Measurement of health status. Ascertaining the minimal clinically important difference. , 1989, Controlled clinical trials.

[250]  J. Tyson,et al.  Aid to the evaluation of therapeutic studies. , 1989, Pediatrics.

[251]  H. A. Kahn,et al.  Statistical Methods in Epidemiology , 1989 .

[252]  P. Sismondi,et al.  Is the published literature a reliable guide for deciding between alternative treatments for patients with early cervical cancer? , 1989, International journal of radiation oncology, biology, physics.

[253]  Gary James Jason,et al.  The Logic of Scientific Discovery , 1988 .

[254]  R. Bast,et al.  High-dose combination alkylating agents with bone marrow support as initial treatment for metastatic breast cancer. , 1988, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[255]  O. Miettinen,et al.  Theoretical Epidemiology: Principles of Occurrence Research in Medicine. , 1987 .

[256]  W. Baker,et al.  Failure of extracranial-intracranial arterial bypass to reduce the risk of ischemic stroke: The EC/IC Bypass Study Group. N Engl J Med 1985;313:1191–1200 , 1986 .

[257]  R. Simon,et al.  Confidence intervals for reporting results of clinical trials. , 1986, Annals of internal medicine.

[258]  R. Davidson Source of funding and outcome of clinical trials , 1986, Journal of general internal medicine.

[259]  R. Napodano Values in Medical Practice: A Statement of Philosophy for Physicians and a Model for Teaching a Healing Science , 1986 .

[260]  W. Kannel,et al.  Patterns of coronary heart disease morbidity and mortality in the sexes: a 26-year follow-up of the Framingham population. , 1986, American heart journal.

[261]  P. Weinstein,et al.  Results of extracranial-intracranial arterial bypass for intracranial internal carotid artery stenosis: review of 105 cases. , 1984, Neurosurgery.

[262]  D P Byar,et al.  Using observational data from registries to compare treatments: the fallacy of omnimetrics. , 1984, Statistics in medicine.

[263]  M. Gardner,et al.  Statistical guidelines for contributors to medical journals. , 1983, British medical journal.

[264]  M. Roland,et al.  A study of the natural history of back pain. Part I: development of a reliable and sensitive measure of disability in low-back pain. , 1983, Spine.

[265]  T C Chalmers,et al.  Randomized versus historical controls for clinical trials. , 1982, The American journal of medicine.

[266]  R Neutra,et al.  Control of confounding in the assessment of medical technology. , 1980, International journal of epidemiology.

[267]  A. Lilienfeld Foundations of Epidemiology , 1980 .

[268]  W. Eyler Uniform requirements for manuscripts submitted to biomedical journals. , 1980, Canadian Medical Association journal.

[269]  L. Dales,et al.  An improper use of statistical significance testing in studying covariables. , 1978, International journal of epidemiology.

[270]  T C Chalmers,et al.  The importance of beta, the type II error and sample size in the design and interpretation of the randomized control trial. Survey of 71 "negative" trials. , 1978, The New England journal of medicine.

[271]  R. Doll,et al.  Mortality in relation to smoking , 1977 .

[272]  R. Melzack The McGill Pain Questionnaire: Major properties and scoring methods , 1975, PAIN.

[273]  D. Rubin INFERENCE AND MISSING DATA , 1975 .

[274]  N. Butler,et al.  Visual Acuity of a National Sample (1958 Cohort) at 7 years , 1971, Developmental medicine and child neurology.

[275]  M. Kendall,et al.  The Logic of Scientific Discovery. , 1959 .

[276]  D. Campbell Factors relevant to the validity of experiments in social settings. , 1957, Psychological bulletin.

[277]  M. S. Bartlett,et al.  Statistical methods and scientific inference. , 1957 .

[278]  J. Berkson Tests of significance considered as evidence , 1942 .

[279]  S. Datta,et al.  Systematic review of caudal epidural injections in the management of chronic low back pain. , 2009, Pain physician.

[280]  Salahadin Abdi,et al.  Lumbar interlaminar epidural injections in managing chronic low back and lower extremity pain: a systematic review. , 2009, Pain physician.

[281]  L. Manchikanti,et al.  Systematic review of the effectiveness of thermal annular procedures in treating discogenic low back pain. , 2009, Pain physician.

[282]  V. Singh,et al.  Systematic Review of the Effectiveness of Cervical Epidurals in the Management of Chronic Neck Pain , 2010 .

[283]  S. Datta,et al.  Systematic review of diagnostic utility and therapeutic effectiveness of thoracic facet joint interventions. , 2008, Pain physician.

[284]  Hyun Ja Lim,et al.  Observational study design. , 2007, Methods in molecular biology.

[285]  S. Greenland,et al.  Types of Epidemiologic Studies , 2007 .

[286]  Steven P. Cohen,et al.  Sacroiliac joint interventions: a systematic review. , 2007, Pain physician.

[287]  Salahadin Abdi,et al.  Epidural steroids in the management of chronic spinal pain: a systematic review. , 2007, Pain physician.

[288]  N. Sehgal,et al.  A systematic review of therapeutic facet joint interventions in chronic spinal pain. , 2007, Pain physician.

[289]  S. Datta,et al.  Systematic review of effectiveness and complications of adhesiolysis in the management of chronic spinal pain: an update. , 2007, Pain physician.

[290]  Douglas G Altman,et al.  Reporting of noninferiority and equivalence randomized trials: an extension of the CONSORT statement. , 2006, JAMA.

[291]  P. Hartge,et al.  Reporting participation in epidemiologic studies: a survey of practice. , 2006, American journal of epidemiology.

[292]  A. Dobson,et al.  Quality of reporting of observational longitudinal research. , 2005, American journal of epidemiology.

[293]  V. Pampati,et al.  A double-blind, controlled evaluation of the value of sarapin in neural blockade. , 2004, Pain physician.

[294]  K. Bush,et al.  Outcome of cervical radiculopathy treated with periradicular/epidural corticosteroid injections: a prospective study with independent clinical review , 2004, European Spine Journal.

[295]  L. Manchikanti,et al.  Methods for evidence synthesis in interventional pain management. , 2003, Pain physician.

[296]  V. Budach,et al.  The comparability of quality of life scores. a multitrait multimethod analysis of the EORTC QLQ-C30, SF-36 and FLIC questionnaires. , 2002, European journal of cancer.

[297]  L. Manchikanti,et al.  Effectiveness of caudal epidural injections in discogram positive and negative chronic low back pain. , 2002, Pain physician.

[298]  R. Melzack,et al.  The measurement of pain and the assessment of people experiencing pain. , 2001 .

[299]  O. Tervonen,et al.  Cost Effectiveness of Periradicular Infiltration for Sciatica , 2001 .

[300]  M. Pincus Intention-to-treat analysis and the goals of clinical trials. , 2000, Clinical pharmacology and therapeutics.

[301]  P. Briss,et al.  Data collection instrument and procedure for systematic reviews in the Guide to Community Preventive Services. Task Force on Community Preventive Services. , 2000, American journal of preventive medicine.

[302]  P. Shekelle,et al.  Prevention and management of urinary tract infections in paralyzed persons. , 1999, Evidence report/technology assessment.

[303]  P. Villari,et al.  Residential exposure to electromagnetic fields and childhood leukaemia: a meta-analysis. , 1999, Bulletin of the World Health Organization.

[304]  R. Harden,et al.  Clinical practice guidelines for chronic non-malignant pain syndrome patients II: An evidence-based approach , 1999 .

[305]  T. Shakespeare,et al.  Observational Studies , 2003 .

[306]  C. Weinberg,et al.  Use and misuse of population attributable fractions. , 1998, American journal of public health.

[307]  A. Rigby,et al.  Statistical methods in epidemiology. II: A commonsense approach to sample size estimation. , 1998, Disability and rehabilitation.

[308]  L W Chambers,et al.  Critical appraisal of the health research literature: prevalence or incidence of a health problem. , 1998, Chronic diseases in Canada.

[309]  C. Perry,et al.  Closed fractures of the tibial shaft. A meta-analysis of three methods of treatment. , 1998, The Journal of bone and joint surgery. American volume.

[310]  S. Duffy,et al.  Development of a scoring system to judge the scientific quality of information from case-control and cohort studies of nutrition and disease. , 1995, Nutrition and cancer.

[311]  W. Thompson Statistical analysis of case-control studies. , 1994, Epidemiologic reviews.

[312]  J. Ward,et al.  Randomized, controlled trials in surgery , 1994, Surgery.

[313]  R H DuRant,et al.  Checklist for the evaluation of research articles. , 1994, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[314]  P Sasieni,et al.  A note on the presentation of matched case-control data. , 1992, Statistics in medicine.

[315]  H. Becher,et al.  The concept of residual confounding in regression models and some applications. , 1992, Statistics in medicine.

[316]  Paul Karoly,et al.  Self-report scales and procedures for assessing pain in adults , 1992 .

[317]  B. Teicher,et al.  A phase II study of high-dose cyclophosphamide, thiotepa, and carboplatin with autologous marrow support in women with measurable advanced breast cancer responding to standard-dose therapy. , 1992, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[318]  T Heeren,et al.  Robustness of the two independent samples t-test when applied to ordinal scaled data. , 1987, Statistics in medicine.

[319]  M. Crossley,et al.  Observational Research Methods , 1987 .

[320]  R. Rothman,et al.  The use of epidural steroids in the treatment of lumbar radicular pain. A prospective, randomized, double-blind study. , 1985, The Journal of bone and joint surgery. American volume.

[321]  Guidelines for documentation of epidemiologic studies. Epidemiology Work Group of the Interagency Regulatory Liaison Group. , 1981, American journal of epidemiology.

[322]  A. Feinstein,et al.  The application of therapeutic-trial principles to improve the design of epidemiologic research: a case-control study suggesting that anticoagulants reduce mortality in patients with myocardial infarction. , 1981, Journal of chronic diseases.

[323]  B. Macmahon,et al.  Epidemiology: Principles and Methods , 1970 .

[324]  C. Hempel Philosophy of Natural Science , 1966 .