Is Quality and Completeness of Reporting of Systematic Reviews and Meta-Analyses Published in High Impact Radiology Journals Associated with Citation Rates?

Purpose The purpose of this study is to determine whether study quality and completeness of reporting of systematic reviews (SR) and meta-analyses (MA) published in high impact factor (IF) radiology journals is associated with citation rates. Methods All SR and MA published in English between Jan 2007–Dec 2011, in radiology journals with an IF >2.75, were identified on Ovid MEDLINE. The Assessing the Methodologic Quality of Systematic Reviews (AMSTAR) checklist for study quality, and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist for study completeness, was applied to each SR & MA. Each SR & MA was then searched in Google Scholar to yield a citation rate. Spearman correlation coefficients were used to assess the relationship between AMSTAR and PRISMA results with citation rate. Multivariate analyses were performed to account for the effect of journal IF and journal 5-year IF on correlation with citation rate. Values were reported as medians with interquartile range (IQR) provided. Results 129 studies from 11 journals were included (50 SR and 79 MA). Median AMSTAR result was 8.0/11 (IQR: 5–9) and median PRISMA result was 23.0/27 (IQR: 21–25). The median citation rate for SR & MA was 0.73 citations/month post-publication (IQR: 0.40–1.17). There was a positive correlation between both AMSTAR and PRISMA results and SR & MA citation rate; ρ=0.323 (P=0.0002) and ρ=0.327 (P=0.0002) respectively. Positive correlation persisted for AMSTAR and PRISMA results after journal IF was partialed out; ρ=0.243 (P=0.006) and ρ=0.256 (P=0.004), and after journal 5-year IF was partialed out; ρ=0.235 (P=0.008) and ρ=0.243 (P=0.006) respectively. Conclusion There is a positive correlation between the quality and the completeness of a reported SR or MA with citation rate which persists when adjusted for journal IF and journal 5-year IF.

[1]  N. Laird,et al.  Meta-analysis in clinical trials. , 1986, Controlled clinical trials.

[2]  Fiona J Gilbert,et al.  Surveillance mammography for detecting ipsilateral breast tumour recurrence and metachronous contralateral breast cancer: a systematic review , 2011, European Radiology.

[3]  Jan Menke,et al.  Diagnostic accuracy of multidetector CT in acute mesenteric ischemia: systematic review and meta-analysis. , 2010, Radiology.

[4]  E. Jesudason,et al.  How useful is the lung‐to‐head ratio in predicting outcome in the fetus with congenital diaphragmatic hernia? A systematic review and meta‐analysis , 2007, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[5]  Y. C. Chang,et al.  Outcome of antenatally diagnosed cardiac rhabdomyoma: case series and a meta‐analysis , 2008, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[6]  B. Mol,et al.  Cervical Length Measurement for the Prediction of Preterm Birth in Multiple Pregnancies: A Systematic Review and Bivariate Meta-Analysis , 2011 .

[7]  F. Oesch,et al.  Polymorphisms of N-acetyltransferases, glutathione S-transferases, microsomal epoxide hydrolase and sulfotransferases: influence on cancer susceptibility. , 1998, Recent results in cancer research. Fortschritte der Krebsforschung. Progres dans les recherches sur le cancer.

[8]  Jeremy Grimshaw,et al.  AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews. , 2009, Journal of clinical epidemiology.

[9]  I. Olkin,et al.  Meta-analysis of observational studies in epidemiology - A proposal for reporting , 2000 .

[10]  Kirby P. Lee,et al.  Association of journal quality indicators with methodological quality of clinical research articles. , 2002, JAMA.

[11]  Ruth C Carlos,et al.  Solitary pulmonary nodules: meta-analytic comparison of cross-sectional imaging modalities for diagnosis of malignancy. , 2008, Radiology.

[12]  J. Ferlay,et al.  Global Cancer Statistics, 2002 , 2005, CA: a cancer journal for clinicians.

[13]  J. Geleijns,et al.  Meta-analysis of 40- and 64-MDCT angiography for assessing coronary artery stenosis. , 2008, AJR. American journal of roentgenology.

[14]  T. Becske,et al.  Safety and Efficacy of Adjunctive Balloon Remodeling during Endovascular Treatment of Intracranial Aneurysms: A Literature Review , 2008, American Journal of Neuroradiology.

[15]  S. Bernstein,et al.  Solitary pulmonary nodules and masses: a meta-analysis of the diagnostic utility of alternative imaging tests , 2008, European Radiology.

[16]  M. L. R. D. Christenson,et al.  Abandoning Daily Routine Chest Radiography in the Intensive Care Unit: Meta-Analysis , 2011 .

[17]  E GARFIELD,et al.  Citation indexes for science; a new dimension in documentation through association of ideas. , 2006, Science.

[18]  S. Papatheodorou,et al.  Transvaginal cervical length measurement for prediction of preterm birth in women with threatened preterm labor: a meta‐analysis , 2010, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[19]  N. Theocharopoulos,et al.  Performance of computed tomographic urography in diagnosis of upper urinary tract urothelial carcinoma, in patients presenting with hematuria: Systematic review and meta-analysis. , 2010, European journal of radiology.

[20]  Udo Hoffmann,et al.  A systematic review on diagnostic accuracy of CT-based detection of significant coronary artery disease. , 2008, European journal of radiology.

[21]  T. Autti,et al.  Decreased T2 signal in the thalami may be a sign of lysosomal storage disease , 2007, Neuroradiology.

[22]  S. Tyring,et al.  Polymorphisms for chemical metabolizing genes and risk for cervical neoplasia , 2003, Environmental and molecular mutagenesis.

[23]  R. Warren,et al.  Technical aspects of breast MRI—do they affect outcomes? , 2009, European Radiology.

[24]  Zhonghua Sun,et al.  Diagnostic accuracy of 64 multislice CT angiography in the assessment of coronary in-stent restenosis: a meta-analysis. , 2010, European journal of radiology.

[25]  J. Eastwood,et al.  Does Diffusion-Weighted Imaging Represent the Ischemic Core? An Evidence-Based Systematic Review , 2009, American Journal of Neuroradiology.

[26]  Martin Schumacher,et al.  The relationship between quality of research and citation frequency , 2006, BMC medical research methodology.

[27]  H. Mohrenweiser,et al.  Genetic variability in susceptibility and response to toxicants. , 2001, Toxicology letters.

[28]  Tao Liu,et al.  Usefulness of 18F-FDG PET, combined FDG-PET/CT and EUS in diagnosing primary pancreatic carcinoma: a meta-analysis. , 2011, European journal of radiology.

[29]  J. Kleijnen,et al.  Fetal umbilical artery Doppler to predict compromise of fetal/neonatal wellbeing in a high risk population: systematic review and bivariate meta-analysis , 2010, Archives of Disease in Childhood: Fetal and Neonatal Edition.

[30]  Health technology assessment on the use of magnetic resonance imaging (MRI) and computed tomography (CT) in the diagnosis of multiple sclerosis (MS) and clinically isolated syndromes (CIS). , 2008, European journal of radiology.

[31]  Jaap Stoker,et al.  Magnetic resonance imaging for evaluation of disease activity in Crohn’s disease: a systematic review , 2009, European Radiology.

[32]  J. Stoker,et al.  Magnetic resonance (MR) colonography in the detection of colorectal lesions: a systematic review of prospective studies , 2009, European Radiology.

[33]  Ngianga-Bakwin Kandala,et al.  Bibliometrics of systematic reviews: analysis of citation rates and journal impact factors , 2013, Systematic Reviews.

[34]  A. Pradhan,et al.  Impact factor of a scientific journal: Is it a measure of quality of research? , 2013, Journal of medical physics.

[35]  W. Given.  Carcinoma of the cervix. , 1947, American journal of obstetrics and gynecology.

[36]  J. Barentsz,et al.  Contrast-enhanced versus systematic transrectal ultrasound-guided prostate cancer detection: an overview of techniques and a systematic review. , 2007, European journal of radiology.

[37]  J. Hur,et al.  How well does CT predict the need for laparotomy in hemodynamically stable patients with penetrating abdominal injury? A review and meta-analysis. , 2009, AJR. American journal of roentgenology.

[38]  Marta Sales-Pardo,et al.  Statistical validation of a global model for the distribution of the ultimate number of citations accrued by papers published in a scientific journal , 2010 .

[39]  Sarah Vinnicombe,et al.  Full-field digital versus screen-film mammography: comparison within the UK breast screening program and systematic review of published data. , 2009, Radiology.

[40]  J. Stoker,et al.  Diagnostic imaging of colorectal liver metastases with CT, MR imaging, FDG PET, and/or FDG PET/CT: a meta-analysis of prospective studies including patients who have not previously undergone treatment. , 2010, Radiology.

[41]  D. Altman,et al.  Evidence-based practice in radiology: steps 3 and 4--appraise and apply systematic reviews and meta-analyses. , 2007, Radiology.

[42]  Jagadeesh Bayry,et al.  Metrics: journal's impact factor skewed by a single paper , 2010, Nature.

[43]  Thomas C. Kwee,et al.  Combined FDG-PET/CT for the detection of unknown primary tumors: systematic review and meta-analysis , 2008, European Radiology.

[44]  R J Cook,et al.  Users' guides to the medical literature. IX. A method for grading health care recommendations. Evidence-Based Medicine Working Group. , 1995, JAMA.

[45]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement , 2009, BMJ.

[46]  K. Salvesen.  Ultrasound in pregnancy and non‐right handedness: meta‐analysis of randomized trials , 2011, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[47]  N. Raine-Fenning,et al.  Reproductive outcomes in women with congenital uterine anomalies: a systematic review , 2011, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[48]  A. Giuliano,et al.  Clearance of oncogenic human papillomavirus (HPV) infection: effect of smoking (United States) , 2002, Cancer Causes & Control.

[49]  F. Gao,et al.  Diagnostic performance of USPIO-enhanced MRI for lymph-node metastases in different body regions: a meta-analysis. , 2011, European journal of radiology.

[50]  E. Garfield.  Journal impact factor: a brief review. , 1999, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[51]  Zhonghua Sun,et al.  Multi-detector row CT angiography in the assessment of coronary in-stent restenosis: a systematic review. , 2009, European journal of radiology.

[52]  K. Muir,et al.  Do Iodinated Contrast Agents Impair Fibrinolysis in Acute Stroke? A Systematic Review , 2010, American Journal of Neuroradiology.

[53]  J. Provenzale,et al.  Comparison of test performance characteristics of MRI, MR angiography, and CT angiography in the diagnosis of carotid and vertebral artery dissection: a review of the medical literature. , 2009, AJR. American journal of roentgenology.

[54]  M. Barchitta,et al.  Distribution of p53, GST, and MTHFR Polymorphisms and Risk of Cervical Intraepithelial Lesions in Sicily , 2009, International Journal of Gynecologic Cancer.

[55]  M. Greuter,et al.  Exposure to low-dose radiation and the risk of breast cancer among women with a familial or genetic predisposition: a meta-analysis , 2010, European Radiology.

[56]  S. Waggoner,et al.  Identification of Tobacco- Specific Carcinogen in the Cervical Mucus of Smokers and Nonsmokers , 1997 .

[57]  R. M. Kwee.  Prediction of tumor response to neoadjuvant therapy in patients with esophageal cancer with use of 18F FDG PET: a systematic review. , 2010, Radiology.

[58]  J K McLaughlin,et al.  Selection of controls in case-control studies. II. Types of controls. , 1992, American journal of epidemiology.

[59]  E. Escott,et al.  Pineocytoma Mimicking a Pineal Cyst on Imaging: True Diagnostic Dilemma or a Case of Incomplete Imaging? , 2008, American Journal of Neuroradiology.

[60]  Jan Menke,et al.  Diagnostic accuracy of contrast-enhanced MR angiography in severe carotid stenosis: meta-analysis with metaregression of different techniques , 2009, European Radiology.

[61]  Anne-Wil Harzing,et al.  A preliminary test of Google Scholar as a source for citation data: a longitudinal study of Nobel prize winners , 2013, Scientometrics.

[62]  A. Kulkarni,et al.  Comparisons of citations in Web of Science, Scopus, and Google Scholar for articles published in general medical journals. , 2009, JAMA.

[63]  Rémy Morello,et al.  Coronary arteries: diagnostic performance of 16- versus 64-section spiral CT compared with invasive coronary angiography--meta-analysis. , 2007, Radiology.

[64]  K. A. McKibbon,et al.  Prediction of citation counts for clinical articles at two years using data available within three weeks of publication: retrospective cohort study , 2008, BMJ : British Medical Journal.

[65]  William G. Jacoby.  Loess: a nonparametric, graphical tool for depicting relationships between variables , 2000 .

[66]  Matthijs Oudkerk,et al.  Computer-aided detection in breast MRI: a systematic review and meta-analysis , 2011, European Radiology.

[67]  Susan Mallett,et al.  QUADAS-2: A Revised Tool for the Quality Assessment of Diagnostic Accuracy Studies , 2011, Annals of Internal Medicine.

[68]  Daniel Pauly,et al.  Equivalence of results from two citation analyses: Thomson ISI's Citation Index and Google's Scholar service , 2005 .

[69]  Wolfhard Semmler,et al.  Effects of static magnetic fields on cognition, vital signs, and sensory perception: A meta‐analysis , 2011, Journal of magnetic resonance imaging : JMRI.

[70]  T. Kwee,et al.  MR angiography in the follow-up of intracranial aneurysms treated with Guglielmi detachable coils: systematic review and meta-analysis , 2007, Neuroradiology.

[71]  E. Garfield,et al.  Citation indexes for science. , 1956, Science.

[72]  J. Neilson,et al.  Interventions for twin–twin transfusion syndrome: a Cochrane review , 2008, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[73]  Jian-jun Wu,et al.  Value of diffusion‐weighted magnetic resonance images for discrimination of focal benign and malignant hepatic lesions: A meta‐analysis , 2010, Journal of magnetic resonance imaging : JMRI.

[74]  Jan P Vandenbroucke,et al.  STREGA, STROBE, STARD, SQUIRE, MOOSE, PRISMA, GNOSIS, TREND, ORION, COREQ, QUOROM, REMARK... and CONSORT: for whom does the guideline toll? , 2009, Journal of clinical epidemiology.

[75]  Karel G M Moons,et al.  Meta-analysis of MR imaging in the diagnosis of breast lesions. , 2008, Radiology.

[76]  W. Qiu,et al.  Sodium bicarbonate for the prevention of contrast induced nephropathy: a meta-analysis of published clinical trials. , 2011, European journal of radiology.

[77]  J. S. Lameris,et al.  The value of postmortem computed tomography as an alternative for autopsy in trauma victims: a systematic review , 2009, European Radiology.

[78]  O. Naggara,et al.  In Vivo Experimental Intracranial Aneurysm Models: A Systematic Review , 2010, American Journal of Neuroradiology.

[79]  M. Kalra,et al.  Characterization of adrenal masses by using FDG PET: a systematic review and meta-analysis of diagnostic test performance. , 2011, Radiology.

[80]  R. Sobti,et al.  Interaction of passive smoking with GST (GSTM1, GSTT1, and GSTP1) genotypes in the risk of cervical cancer in India. , 2006, Cancer genetics and cytogenetics.

[81]  E. Garfield.  Citation indexes for science. A new dimension in documentation through association of ideas. 1955. , 1955, International journal of epidemiology.

[82]  Marc Dewey,et al.  Comparison of multislice computed tomography with intravascular ultrasound for detection and characterization of coronary artery plaques: a systematic review. , 2009, European journal of radiology.

[83]  R. Wears,et al.  Journal prestige, publication bias, and other characteristics associated with citation of published studies in peer-reviewed journals. , 2002, JAMA.

[84]  J. Dillner,et al.  Smoking, diet, pregnancy and oral contraceptive use as risk factors for cervical intra-epithelial neoplasia in relation to human papillomavirus infection , 2000, British Journal of Cancer.

[85]  Q. Shah,et al.  Clinical and radiological outcomes of acute ischemic stroke patients without angiographic occlusion on digital subtraction angiogram. A pooled analysis of case series , 2008, Neuroradiology.

[86]  Martin Schumacher,et al.  Statistically significant papers in psychiatry were cited more often than others. , 2007, Journal of clinical epidemiology.

[87]  J. V. van Engelshoven,et al.  Detection of lymph node metastases in head and neck cancer: a meta-analysis comparing US, USgFNAC, CT and MR imaging. , 2007, European journal of radiology.

[88]  Yong Xu,et al.  Diagnosis of bone metastases: a meta-analysis comparing 18FDG PET, CT, MRI and bone scintigraphy , 2011, European Radiology.

[89]  J. Mulliken,et al.  Klippel-Trenaunay Syndrome and Spinal Arteriovenous Malformations: An Erroneous Association , 2010, American Journal of Neuroradiology.

[90]  M. Hamon,et al.  Diagnostic accuracy of in-stent coronary restenosis detection with multislice spiral computed tomography: a meta-analysis , 2008, European Radiology.

[91]  M. A. Bosch,et al.  Yttrium-90 microsphere radioembolization for the treatment of liver malignancies: a structured meta-analysis , 2009, European Radiology.

[92]  Mary Rickard,et al.  A review of methods of clinical image quality evaluation in mammography. , 2010, European journal of radiology.

[93]  R. Verma,et al.  Incremental value of CT venography combined with pulmonary CT angiography for the detection of thromboembolic disease: systematic review and meta-analysis. , 2011, AJR. American journal of roentgenology.

[94]  T. French,et al.  Cigarette smoking and exposure to passive smoke are risk factors for cervical cancer. , 1989, JAMA.

[95]  B. Mittal,et al.  Association of GSTM1, GSTT1, and GSTM3 gene polymorphisms and susceptibility to cervical cancer in a North Indian population. , 2008, American journal of obstetrics and gynecology.

[96]  J. Wilhjelm,et al.  Articular Cartilage Thickness Measured with US is Not as Easy as It Appears: A Systematic Review of Measurement Techniques and Image Interpretation , 2010, Ultraschall in der Medizin - European Journal of Ultrasound.

[97]  Jaap Stoker,et al.  Diagnostic value of CT-colonography as compared to colonoscopy in an asymptomatic screening population: a meta-analysis , 2011, European Radiology.

[98]  D. Gaitini,et al.  Do we need a cancer screening in patients with idiopathic deep vein thrombosis? , 2009, Ultraschall in der Medizin.

[99]  Koenraad Verstraete,et al.  Learning from diagnostic errors: a good way to improve education in radiology. , 2011, European journal of radiology.

[100]  W. Huda,et al.  Imaging strategies to reduce the risk of radiation in CT studies, including selective substitution with MRI , 2007, Journal of magnetic resonance imaging : JMRI.

[101]  David Moher,et al.  Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. Standards for Reporting of Diagnostic Accuracy. , 2003, Clinical chemistry.

[102]  Y. Liu,et al.  Meta-analysis of association between GSTM1 gene polymorphism and cervical cancer. , 2012, Asian Pacific journal of tropical medicine.

[103]  Stuart A. Taylor,et al.  CT colonography: a systematic review of standard of reporting for studies of computer-aided detection. , 2008, Radiology.

[104]  M. Boermeester,et al.  Graded compression ultrasonography and computed tomography in acute colonic diverticulitis: Meta-analysis of test accuracy , 2008, European Radiology.

[105]  E. Miller,et al.  Evidence-based outcomes of studies addressing diagnostic accuracy of MRI of juvenile idiopathic arthritis. , 2009, AJR. American journal of roentgenology.

[106]  M. McInnes,et al.  Percutaneous image-guided biopsy of the spleen: systematic review and meta-analysis of the complication rate and diagnostic accuracy. , 2011, Radiology.

[107]  Y. Oba,et al.  Abandoning daily routine chest radiography in the intensive care unit: meta-analysis. , 2010, Radiology.

[108]  P. Schlattmann,et al.  Influence of coronary artery disease prevalence on predictive values of coronary CT angiography: a meta-regression analysis , 2011, European Radiology.

[109]  A. Casadevall,et al.  Causes for the Persistence of Impact Factor Mania , 2014, mBio.

[110]  A. Toms,et al.  Regional migratory osteoporosis. , 2008, European journal of radiology.

[111]  A. Grosu,et al.  Glioblastoma research 2006–2010: Pattern of citation and systematic review of highly cited articles , 2012, Clinical Neurology and Neurosurgery.

[112]  Carl E. Johnson,et al.  Diagnostic Accuracy of CT Angiography and CT Perfusion for Cerebral Vasospasm: A Meta-Analysis , 2010, American Journal of Neuroradiology.

[113]  C. Hing,et al.  The diagnostic accuracy of acetabular labral tears using magnetic resonance imaging and magnetic resonance arthrography: a meta-analysis , 2011, European Radiology.

[114]  M. Merialdi,et al.  Safety of ultrasonography in pregnancy: WHO systematic review of the literature and meta‐analysis , 2008, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[115]  M. Pillai,et al.  Germline genetic polymorphisms of CYP1A1, GSTM1 and GSTT1 genes in Indian cervical cancer: associations with tumor progression, age and human papillomavirus infection. , 2006, Gynecologic oncology.

[116]  Andrea J. Frangos,et al.  Accuracy of MRI, MR arthrography, and ultrasound in the diagnosis of rotator cuff tears: a meta-analysis. , 2009, AJR. American journal of roentgenology.

[117]  C. Sirlin,et al.  Nephrogenic systemic fibrosis in liver disease: A systematic review , 2009, Journal of magnetic resonance imaging : JMRI.

[118]  M. Oudkerk,et al.  Intracranial aneurysms in patients with subarachnoid hemorrhage: CT angiography as a primary examination tool for diagnosis--systematic review and meta-analysis. , 2011, Radiology.

[119]  F. Chiappelli,et al.  From Systematic Reviews to Clinical Recommendations for Evidence-Based Health Care: Validation of Revised Assessment of Multiple Systematic Reviews (R-AMSTAR) for Grading of Clinical Relevance , 2010, The open dentistry journal.

[120]  M. Bhandari,et al.  Level of evidence and conflict of interest disclosure associated with higher citation rates in orthopedics. , 2011, Journal of clinical epidemiology.

[121]  L. Marchand,et al.  CYP1A1, GSTM1, and GSTT1 polymorphisms and the risk of cervical squamous intraepithelial lesions in a multiethnic population. , 2001, Gynecologic oncology.

[122]  Steve Halligan,et al.  Colorectal cancer: CT colonography and colonoscopy for detection--systematic review and meta-analysis. , 2011, Radiology.

[123]  Otto S. Hoekstra,et al.  Attenuation-Corrected vs. Nonattenuation-Corrected 2-Deoxy-2-[F-18]fluoro-d-glucose-Positron Emission Tomography in Oncology, A Systematic Review , 2007, Molecular Imaging and Biology.

[124]  N. Sebire,et al.  Diagnostic accuracy of post-mortem magnetic resonance imaging in fetuses, children and adults: a systematic review. , 2010, European journal of radiology.

[125]  J. Stoker,et al.  The diagnostic accuracy of US, CT, MRI and 1H-MRS for the evaluation of hepatic steatosis compared with liver biopsy: a meta-analysis , 2010, European Radiology.

[126]  A. Roos,et al.  MRI for the evaluation of gastric physiology , 2010, European Radiology.

[127]  J. Ioannidis,et al.  Prosthesis infection: diagnosis after total joint arthroplasty with antigranulocyte scintigraphy with 99mTc-labeled monoclonal antibodies--a meta-analysis. , 2007, Radiology.

[128]  A. Kulkarni,et al.  Characteristics Associated with Citation Rate of the Medical Literature , 2007, PloS one.

[129]  D. Kallmes,et al.  Stent-Assisted Coiling in Acutely Ruptured Intracranial Aneurysms: A Qualitative, Systematic Review of the Literature , 2011, American Journal of Neuroradiology.

[130]  Gang Huang,et al.  Comparison of virtual cystoscopy and ultrasonography for bladder cancer detection: a meta-analysis. , 2011, European journal of radiology.

[131]  H. Lai,et al.  Genetic Polymorphisms of Phase I and Phase II Xenobiotic Enzymes in Human Papillomavirus Related Lesion and Cancer of the Uterine Cervix , 2006 .

[132]  M. Wiesmann,et al.  Stent-protected angioplasty versus carotid endarterectomy in patients with carotid artery stenosis: meta-analysis of randomized trial data , 2008, European Radiology.

[133]  A. Alberg,et al.  Active and Passive Cigarette Smoking and the Risk of Cervical Neoplasia , 2005, Obstetrics and gynecology.

[134]  J. Cnossen,et al.  Ultrasound factors to predict the outcome of external cephalic version: a meta‐analysis , 2009, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[135]  G. Bongartz,et al.  Diagnostic performance of low-dose CT for the detection of urolithiasis: a meta-analysis. , 2008, AJR. American journal of roentgenology.

[136]  Kaisra Esmail,et al.  Association of study quality with completeness of reporting: have completeness of reporting and quality of systematic reviews and meta-analyses in major radiology journals changed since publication of the PRISMA statement? , 2013, Radiology.

[137]  M. Falagas,et al.  ORIGINAL ARTICLE: Comparison of the distribution of citations received by articles published in high, moderate, and low impact factor journals in clinical medicine , 2010, Internal medicine journal.

[138]  Michael L Lipton,et al.  Note: This Copy Is for Your Personal, Non-commercial Use Only. to Order Presentation-ready Copies for Distribution to Your Colleagues or Clients, Contact Us at Www.rsna.org/rsnarights. Materials and Methods , 2022 .

[139]  P. D. de Jong,et al.  Does high-resolution CT has diagnostic value in patients presenting with respiratory symptoms after hematopoietic stem cell transplantation? , 2011, European journal of radiology.

[140]  S. Goergen,et al.  Systematic review of current guidelines, and their evidence base, on risk of lactic acidosis after administration of contrast medium for patients receiving metformin. , 2010, Radiology.

[141]  J. Hodler,et al.  On the relevance of the Impact Factor and other factors , 2012, Skeletal Radiology.

[142]  G. Bongartz,et al.  Transthoracic sonography for the detection of pulmonary embolism--a meta-analysis. , 2009, Ultraschall in der Medizin.

[143]  V. Torri,et al.  Performance of imaging modalities in diagnosis of liver metastases from colorectal cancer: A systematic review and meta‐analysis , 2010, Journal of magnetic resonance imaging : JMRI.

[144]  Masaya Sato,et al.  Mortality and complication rates of percutaneous ablative techniques for the treatment of liver tumors: a systematic review , 2011, European Radiology.

[145]  M. Kon,et al.  Diagnostic accuracy of transabdominal ultrasound in detecting prenatal cleft lip and palate: a systematic review , 2010, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[146]  M. Hunink,et al.  Lower extremity arterial disease: multidetector CT angiography meta-analysis. , 2007, Radiology.

[147]  C. J. da Silva,et al.  Dural metastases from prostate carcinoma: a systematic review of the literature apropos of six patients. , 2011, European journal of radiology.

[148]  M. Boermeester,et al.  Acute appendicitis: meta-analysis of diagnostic performance of CT and graded compression US related to prevalence of disease. , 2008, Radiology.

[149]  J. Hayes,et al.  The glutathione S-transferase supergene family: regulation of GST and the contribution of the isoenzymes to cancer chemoprotection and drug resistance. , 1995, Critical reviews in biochemistry and molecular biology.

[150]  Dimitrios G Goulis,et al.  Glutathione-S-transferase M1 and T1 and cytochrome P1A1 genetic polymorphisms and susceptibility to cervical intraepithelial neoplasia in Greek women , 2007, European journal of cancer prevention : the official journal of the European Cancer Prevention Organisation.

[151]  M. Dave,et al.  Primary sclerosing cholangitis: meta-analysis of diagnostic performance of MR cholangiopancreatography. , 2010, Radiology.

[152]  Rémy Morello,et al.  Diagnostic performance of 16- and 64-section spiral CT for coronary artery bypass graft assessment: meta-analysis. , 2008, Radiology.

[153]  Philipp Dahm,et al.  Predictors of citations in the urological literature , 2011, BJU international.

[154]  C. Moran,et al.  The impact factor of a journal is a poor measure of the clinical relevance of its papers. , 2014, The bone & joint journal.

[155]  Mark H Ebell,et al.  Simplifying the language of evidence to improve patient care: Strength of recommendation taxonomy (SORT): a patient-centered approach to grading evidence in medical literature. , 2004, The Journal of family practice.

[156]  D. Mullassery,et al.  Value of liver herniation in prediction of outcome in fetal congenital diaphragmatic hernia: a systematic review and meta‐analysis , 2010, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[157]  V. Berghella,et al.  Effectiveness of cerclage according to severity of cervical length shortening: a meta‐analysis , 2010, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[158]  Shao Shu-li.  Association of single nucleotide polymorphism in glutathione S-transferase-M1 with susceptibility to cervical cancer in Shanxi Province , 2008 .

[159]  O. Naggara,et al.  Endovascular treatment of intracranial unruptured aneurysms: systematic review and meta-analysis of the literature on safety and efficacy. , 2010, Radiology.

[160]  J. Ribalta,et al.  Polymorphisms of p53, GSTM1 and GSTT1, and HPV in uterine cervix adenocarcinoma. , 2008, European journal of gynaecological oncology.

[161]  L. Mariani,et al.  Interaction between glutathione-S-transferase polymorphisms, smoking habit, and HPV infection in cervical cancer risk , 2010, Journal of Cancer Research and Clinical Oncology.

[162]  K. Filion,et al.  Factors related to the frequency of citation of epidemiologic publications , 2008, Epidemiologic perspectives & innovations : EP+I.

[163]  Wei Zhang,et al.  Diagnostic value of whole‐body magnetic resonance imaging for bone metastases: a systematic review and meta‐analysis , 2011, Journal of magnetic resonance imaging : JMRI.

[164]  Byron Bernal,et al.  Role of functional MR in determining language dominance in epilepsy and nonepilepsy populations: a Bayesian analysis. , 2007, Radiology.

[165]  Lokman I. Meho,et al.  Impact of data sources on citation counts and rankings of LIS faculty: Web of science versus scopus and google scholar , 2007, J. Assoc. Inf. Sci. Technol..

[166]  S. Thangaratinam,et al.  Accuracy of first‐trimester ultrasound in the diagnosis of early embryonic demise: a systematic review , 2011, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[167]  M. Sales-Pardo,et al.  Effectiveness of Journal Ranking Schemes as a Tool for Locating Information , 2008, PloS one.

[168]  David Moher,et al.  Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews , 2007, BMC medical research methodology.

[169]  William Wijns,et al.  Diagnostic performance of multidetector CT angiography for assessment of coronary artery disease: meta-analysis. , 2007, Radiology.

[170]  J. Raymond,et al.  Endovascular Coiling of Cerebral Aneurysms Using “Bioactive” or Coated-Coil Technologies: A Systematic Review of the Literature , 2008, American Journal of Neuroradiology.

[171]  M. Kilby,et al.  Additional information from array comparative genomic hybridisation technology over conventional karyotyping in prenatal diagnosis–a systematic review and meta-analysis , 2010, Archives of Disease in Childhood: Fetal and Neonatal Edition.

[172]  F. Sampson,et al.  The accuracy of MRI in diagnosis of suspected deep vein thrombosis: systematic review and meta-analysis , 2006, European Radiology.

[173]  R. Ruano,et al.  Effectiveness of fetal cystoscopy as a diagnostic and therapeutic intervention for lower urinary tract obstruction: a systematic review , 2011, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[174]  G. Guyatt,et al.  Users' Guides to the Medical Literature: IX. A Method for Grading Health Care Recommendations , 1995 .

[175]  W. Bautz,et al.  Nephrotoxicity of iso-osmolar iodixanol compared with nonionic low-osmolar contrast media: meta-analysis of randomized controlled trials. , 2009, Radiology.

[176]  H. Kressel.  Beyond the impact factor: enhancing the impact of imaging research published in Radiology. , 2014, Radiology.

[177]  M. Lonneux,et al.  Role of PET in the initial staging of cutaneous malignant melanoma: systematic review. , 2008, Radiology.

[178]  Yu-feng Xu,et al.  Ultrasonography, computed tomography and magnetic resonance imaging for diagnosis of ovarian carcinoma. , 2007, European journal of radiology.

[179]  S. Thompson,et al.  Quantifying heterogeneity in a meta‐analysis , 2002, Statistics in medicine.

[180]  J. Giltay,et al.  Vesico‐ureteral reflux in children with prenatally detected hydronephrosis: a systematic review , 2007, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[181]  Y. Yuan,et al.  Fluorodeoxyglucose–Positron-Emission Tomography, Single-Photon Emission Tomography, and Structural MR Imaging for Prediction of Rapid Conversion to Alzheimer Disease in Patients with Mild Cognitive Impairment: A Meta-Analysis , 2008, American Journal of Neuroradiology.

[182]  Susanne Mikki,et al.  Comparing Google Scholar and ISI Web of Science for Earth Sciences , 2010, Scientometrics.

[183]  Y. Song,et al.  Genetic polymorphisms of GSTM1, p21, p53 and HPV infection with cervical cancer in Korean women. , 2004, Gynecologic Oncology.

[184]  Günther K. H. Zupanc.  Impact beyond the impact factor , 2013, Journal of Comparative Physiology A.

[185]  Roelof J Bennink,et al.  Magnetic resonance imaging in Crohn's disease , 2008 .

[186]  M. Sekine,et al.  Cigarette smoking and glutathione S‐transferase M1 polymorphism associated with risk for uterine cervical cancer , 2008, The journal of obstetrics and gynaecology research.

[187]  N. Hamajima,et al.  Association of the NAD(P)H: quinone oxidoreductase C609T polymorphism and the risk of cervical cancer in Japanese subjects. , 2005, Gynecologic oncology.

[188]  Ying Yuan,et al.  Accuracy of MRI in prediction of pathologic complete remission in breast cancer after preoperative therapy: a meta-analysis. , 2010, AJR. American journal of roentgenology.

[189]  A. Tinelli,et al.  Diagnostic accuracy of transvaginal ultrasound for non‐invasive diagnosis of bowel endometriosis: systematic review and meta‐analysis , 2011, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[190]  J. Craig,et al.  Comparative accuracy of renal duplex sonographic parameters in the diagnosis of renal artery stenosis: paired and unpaired analysis. , 2007, AJR. American journal of roentgenology.

[191]  Hajo Zeeb,et al.  Systematic review on physician's knowledge about radiation doses and radiation risks of computed tomography. , 2010, European journal of radiology.

[192]  J. Provenzale,et al.  Systematic Review of CT and MR Perfusion Imaging for Assessment of Acute Cerebrovascular Disease , 2008, American Journal of Neuroradiology.

[193]  P. Lavin,et al.  Critical analysis of the performance of double-contrast barium enema for detecting colorectal polyps > or = 6 mm in the era of CT colonography. , 2008, AJR. American journal of roentgenology.

[194]  M. Ebell,et al.  Strength of recommendation taxonomy (SORT): a patient-centered approach to grading evidence in the medical literature. , 2004, The Journal of the American Board of Family Practice.

[195]  M. Karkucak,et al.  GST (GSTM1, GSTT1, and GSTP1) polymorphisms in the genetic susceptibility of Turkish patients to cervical cancer. , 2010, Journal of gynecologic oncology.

[196]  C. H. Sierra-Torres,et al.  Exposure to wood smoke, HPV infection, and genetic susceptibility for cervical neoplasia among women in Colombia , 2006, Environmental and molecular mutagenesis.

[197]  Gang Huang,et al.  CA 125, PET alone, PET-CT, CT and MRI in diagnosing recurrent ovarian carcinoma: a systematic review and meta-analysis. , 2009, European journal of radiology.

[198]  Nader Ale Ebrahim,et al.  Equality of Google Scholar with Web of Science Citations: Case of Malaysian Engineering Highly Cited Papers , 2014, Modern Applied Science.

[199]  S. Namkoong,et al.  Combined analysis of germline polymorphisms of p53, GSTM1, GSTT1, CYP1a1, and CYP2e1 , 2000, Cancer.

[200]  Mike Clarke,et al.  Systematic review of reviews of risk factors for intracranial aneurysms , 2008, Neuroradiology.

[201]  J. Ioannidis,et al.  Osteomyelitis: antigranulocyte scintigraphy with 99mTC radiolabeled monoclonal antibodies for diagnosis-- meta-analysis. , 2007, Radiology.

[202]  J. Bosch,et al.  Ruptured abdominal aortic aneurysms: endovascular repair versus open surgery--systematic review. , 2007, Radiology.

[203]  T. Ishida,et al.  Glutathione S-transferase (GSTM1 and GSTT1) polymorphisms in cervical cancer in Northeastern Thailand. , 2009, Asian Pacific journal of cancer prevention : APJCP.

[204]  S. Noda,et al.  Germline polymorphism of cancer susceptibility genes in gynecologic cancer , 2008, Human Cell.

[205]  N. S. Murthy,et al.  Polymorphisms at GSTM1 and GSTT1 gene loci and susceptibility to cervical cancer in Indian population. , 2004, Neoplasma.

[206]  Shu-ye Yang,et al.  A meta-analysis of the value of fluorodeoxyglucose-PET/PET-CT in the evaluation of fever of unknown origin. , 2011, European journal of radiology.

[207]  J. Crane,et al.  Transvaginal sonographic measurement of cervical length to predict preterm birth in asymptomatic women at increased risk: a systematic review , 2008, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[208]  P. Seror.  Sonography and electrodiagnosis in carpal tunnel syndrome diagnosis, an analysis of the literature. , 2008, European journal of radiology.

[209]  Declining impact factor of radiologic journals: a matter for debate. , 2013, AJR. American journal of roentgenology.

[210]  Zhonghua Sun,et al.  Diagnostic value of 64-slice CT angiography in coronary artery disease: a systematic review. , 2008, European journal of radiology.

[211]  M. Hamon,et al.  Meta-analysis of the diagnostic performance of stress perfusion cardiovascular magnetic resonance for detection of coronary artery disease , 2010, Journal of cardiovascular magnetic resonance : official journal of the Society for Cardiovascular Magnetic Resonance.

[212]  M. Kilby,et al.  Additional information from array comparative genomic hybridization technology over conventional karyotyping in prenatal diagnosis: a systematic review and meta‐analysis , 2011, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[213]  S. Ciatto,et al.  Ductal carcinoma in situ at core-needle biopsy: meta-analysis of underestimation and predictors of invasive breast cancer. , 2011, Radiology.

[214]  Michael N. Mavros,et al.  The Impact of Article Length on the Number of Future Citations: A Bibliometric Analysis of General Medicine Journals , 2013, PloS one.