The Quality of Methods Reporting in Parasitology Experiments

There is a growing concern both inside and outside the scientific community over the lack of reproducibility of experiments. The depth and detail of reported methods are critical to the reproducibility of findings, but also for making it possible to compare and integrate data from different studies. In this study, we evaluated in detail the methods reporting in a comprehensive set of trypanosomiasis experiments that should enable valid reproduction, integration and comparison of research findings. We evaluated a subset of other parasitic (Leishmania, Toxoplasma, Plasmodium, Trichuris and Schistosoma) and non-parasitic (Mycobacterium) experimental infections in order to compare the quality of method reporting more generally. A systematic review using PubMed (2000–2012) of all publications describing gene expression in cells and animals infected with Trypanosoma spp was undertaken based on PRISMA guidelines; 23 papers were identified and included. We defined a checklist of essential parameters that should be reported and have scored the number of those parameters that are reported for each publication. Bibliometric parameters (impact factor, citations and h-index) were used to look for association between Journal and Author status and the quality of method reporting. Trichuriasis experiments achieved the highest scores and included the only paper to score 100% in all criteria. The mean of scores achieved by Trypanosoma articles through the checklist was 65.5% (range 32–90%). Bibliometric parameters were not correlated with the quality of method reporting (Spearman's rank correlation coefficient <−0.5; p>0.05). Our results indicate that the quality of methods reporting in experimental parasitology is a cause for concern and it has not improved over time, despite there being evidence that most of the assessed parameters do influence the results. We propose that our set of parameters be used as guidelines to improve the quality of the reporting of experimental infection models as a pre-requisite for integrating and comparing sets of data.

[1]  D. Mccormick.  Sequence the Human Genome , 1986, Bio/Technology.

[2]  Angelo Martino,et al.  Gene expression profiling of human macrophages at late time of infection with Mycobacterium tuberculosis , 2006, Immunology.

[3]  C. Auriault,et al.  HLA Class II Polymorphism Influences Onset and Severity of Pathology in Schistosoma mansoni-Infected Transgenic Mice , 2001, Infection and Immunity.

[4]  A. Casadevall,et al.  Reproducible Science , 2010, Infection and Immunity.

[5]  M. Lisanti,et al.  Microarray analysis of the mammalian thromboxane receptor-Trypanosoma cruzi interaction , 2011, Cell cycle.

[6]  Y. Belkaid,et al.  Antigen Requirements for Efficient Priming of CD8+ T Cells by Leishmania major-Infected Dendritic Cells , 2005, Infection and Immunity.

[7]  M. Hepworth,et al.  The role of sex hormones in the development of Th2 immunity in a gender-biased model of Trichuris muris infection , 2009, European journal of immunology.

[8]  M. Ernandes,et al.  Effects of environmental lighting and tryptophan devoid diet on the rat vaginal cycle. , 1997, Archives of physiology and biochemistry.

[9]  Yong-Jun Kwon,et al.  Visual Genome-Wide RNAi Screening to Identify Human Host Factors Required for Trypanosoma cruzi Infection , 2011, PloS one.

[10]  K. Adeyeye,et al.  A comparative study on the susceptibility of male and female albino mice to Trypanosoma brucei brucei. , 2005, Journal of Vector Borne Diseases.

[11]  A. Benkahla,et al.  Simultaneous gene expression profiling in human macrophages infected with Leishmania major parasites using SAGE , 2008, BMC Genomics.

[12]  A. Johnson.  Strain-dependent, route of challenge-dependent, murine susceptibility to toxoplasmosis , 2004, Zeitschrift für Parasitenkunde.

[13]  J. Buer,et al.  Resistance and susceptibility to tuberculosis analysed at the transcriptome level: lessons from mouse macrophages. , 2004, Tuberculosis.

[14]  F. Falciani,et al.  Expression analysis of immune response genes of Müller cells infected with Toxoplasma gondii , 2006, Journal of Neuroimmunology.

[15]  K. Kristensson,et al.  Identification of stage biomarkers for human African trypanosomiasis. , 2010, The American journal of tropical medicine and hygiene.

[16]  R. Meier,et al.  Helminth products bypass the need for TSLP in Th2 immune responses by directly modulating dendritic cell function , 2009, Proceedings of the National Academy of Sciences.

[17]  International Human Genome Sequencing Consortium.  Initial sequencing and analysis of the human genome , 2001, Nature.

[18]  Karen P. Demick,et al.  Type I IFNs Play a Role in Early Resistance, but Subsequent Susceptibility, to the African Trypanosomes1 , 2008, The Journal of Immunology.

[19]  D. Spray,et al.  Gene expression changes associated with myocarditis and fibrosis in hearts of mice with chronic chagasic cardiomyopathy. , 2010, The Journal of infectious diseases.

[20]  H. Mollenkopf,et al.  Combination of host susceptibility and Mycobacterium tuberculosis virulence define gene expression profile in the host , 2009, European journal of immunology.

[21]  D. McManus,et al.  Differential Expression of Chemokine and Matrix Re-Modelling Genes Is Associated with Contrasting Schistosome-Induced Hepatopathology in Murine Models , 2011, PLoS neglected tropical diseases.

[22]  K. P. Singh,et al.  Differential expression of collagen, MMP, TIMP and fibrogenic-cytokine genes in the granulomatous colon of Schistosoma mansoni-infected mice , 2006, Annals of tropical medicine and parasitology.

[23]  S. Gombe,et al.  Trypanosome-induced ovarian dysfunction. Evidence of higher residual fertility in trypanotolerant small East African goats. , 1988, Acta Tropica.

[24]  R. Corrêa-Oliveira,et al.  Characterization of the presence of Foxp3(+) T cells from patients with different clinical forms of Chagas' disease. , 2011, Human pathology.

[25]  G. Buck,et al.  Trypanosoma cruzi Infection Induces a Global Host Cell Response in Cardiomyocytes , 2011, Infection and Immunity.

[26]  P. Das,et al.  Expression of IL‐10‐triggered STAT3‐dependent IL‐4Rα is required for induction of arginase 1 in visceral leishmaniasis , 2011, European journal of immunology.

[27]  C. Roberts,et al.  Sex-determined resistance to Toxoplasma gondii is associated with temporal differences in cytokine production , 1995, Infection and immunity.

[28]  M. Mack,et al.  CD4+ T‐cell localization to the large intestinal mucosa during Trichuris muris infection is mediated by Gαi‐coupled receptors but is CCR6‐ and CXCR3‐independent , 2010, Immunology.

[29]  E. Hill,et al.  Transcriptional profiling of cattle infected with Trypanosoma congolense highlights gene expression signatures underlying trypanotolerance and trypanosusceptibility , 2009, BMC Genomics.

[30]  C. Greenwood,et al.  Constitutive Differences in Gene Expression Profiles Parallel Genetic Patterns of Susceptibility to Tuberculosis in Mice , 2006, Infection and Immunity.

[31]  Z. Lun,et al.  Trypanosoma brucei brucei: A comparison of gene expression in the liver and spleen of infected mice utilizing cDNA microarray technology. , 2011, Experimental parasitology.

[32]  D. Rosenstreich,et al.  Trypanosoma rhodesiense infection in mice: sex dependence of resistance , 1984, Infection and immunity.

[33]  Y. Xu,et al.  Using a cDNA microarray to study cellular gene expression altered by Mycobacterium tuberculosis. , 2003, Chinese medical journal.

[34]  C. Tato,et al.  Inhibition of NF-κB Activity in T and NK Cells Results in Defective Effector Cell Expansion and Production of IFN-γ Required for Resistance to Toxoplasma gondii1 , 2003, The Journal of Immunology.

[35]  M. A. Basombrío,et al.  Trypanosoma cruzi: infectivity modulation of a clone after passages through different hosts. , 2006, Experimental parasitology.

[36]  C. Drummond.  Replicability is not Reproducibility:Nor is it Good Science , 2009 .

[37]  N. Garg,et al.  Gene expression analysis in mitochondria from chagasic mice: alterations in specific metabolic pathways. , 2004, The Biochemical journal.

[38]  D. Bout,et al.  Induction of protective immunity against toxoplasmosis in mice by DNA immunization with a plasmid encoding Toxoplasma gondii GRA4 gene. , 2000, Vaccine.

[39]  K. Else,et al.  Trichuris muris: CD4+ T cell-mediated protection in reconstituted SCID mice , 2000, Parasitology.

[40]  D. Krogstad,et al.  Transcriptome profiles of host gene expression in a monkey model of human malaria. , 2005, The Journal of infectious diseases.

[41]  Danna Zhou,et al.  Protective immune response in BALB/c mice induced by a suicidal DNA vaccine of the MIC3 gene of Toxoplasma gondii. , 2009, Veterinary parasitology.

[42]  T. Wirth,et al.  BOB.1/OBF.1 controls the balance of TH1 and TH2 immune responses , 2007, The EMBO journal.

[43]  J. Daily,et al.  Cytokine-dependent and–independent gene expression changes and cell cycle block revealed in Trypanosoma cruzi-infected host cells by comparative mRNA profiling , 2009, BMC Genomics.

[44]  Lennart Martens,et al.  The minimum information about a proteomics experiment (MIAPE) , 2007, Nature Biotechnology.

[45]  R. Grencis,et al.  The role of CD8+ cells in the establishment and maintenance of a Trichuris muris infection , 2004, Parasite immunology.

[46]  A. Jayakumar,et al.  Transcriptional Inhibition of Interleukin-12 Promoter Activity in Leishmania Spp.–Infected Macrophages , 2008, The Journal of parasitology.

[47]  U. Lopes,et al.  Human cutaneous leishmaniasis: interferon‐dependent expression of double‐stranded RNA‐dependent protein kinase (PKR) via TLR2 , 2011, FASEB journal : official publication of the Federation of American Societies for Experimental Biology.

[48]  P. Simarro,et al.  The Human African Trypanosomiasis Control and Surveillance Programme of the World Health Organization 2000–2009: The Way Forward , 2011, PLoS neglected tropical diseases.

[49]  D. Spray,et al.  Alterations in myocardial gene expression associated with experimental Trypanosoma cruzi infection. , 2008, Genomics.

[50]  R. Grencis,et al.  Changes in the mucosal barrier during acute and chronic Trichuris muris infection , 2011, Parasite immunology.

[51]  J. Odegaard,et al.  Transcriptional Profiling of the Bladder in Urogenital Schistosomiasis Reveals Pathways of Inflammatory Fibrosis and Urothelial Compromise , 2012, PLoS neglected tropical diseases.

[52]  J. Silva,et al.  IL-17 Produced during Trypanosoma cruzi Infection Plays a Central Role in Regulating Parasite-Induced Myocarditis , 2010, PLoS neglected tropical diseases.

[53]  X. Du,et al.  Toll‐like receptor (TLR) 2 and TLR4 deficiencies exert differential in vivo effects against Schistosoma japonicum , 2011, Parasite immunology.

[54]  U. Groß,et al.  Transcriptional profile of Toxoplasma gondii-infected human fibroblasts as revealed by gene-array hybridization , 2001, Molecular Genetics and Genomics.

[55]  R. Gazzinelli,et al.  Role of Cytokines and Major Histocompatibility Complex Restriction in Mouse Resistance to Infection with a Natural Recombinant Strain (Type I-III) of Toxoplasma gondii , 2003, Infection and Immunity.

[56]  F. Zou,et al.  Modulation of mouse macrophage proteome induced by Toxoplasma gondii tachyzoites in vivo , 2011, Parasitology Research.

[57]  H. Helmby,et al.  Lack of galectin‐3 involvement in murine intestinal nematode and schistosome infection , 2007, Parasite immunology.

[58]  S. G. Andrade,et al.  Oral transmission of Chagas disease: importance of Trypanosoma cruzi biodeme in the intragastric experimental infection. , 2002, Revista do Instituto de Medicina Tropical de Sao Paulo.

[59]  Z. Cucunubá,et al.  Molecular Epidemiology of Human Oral Chagas Disease Outbreaks in Colombia , 2013, PLoS neglected tropical diseases.

[60]  G. Schaub,et al.  Trypanosoma cruzi: the development of estrus cycle and parasitemia in female mice maintained with or without male pheromones , 2001, Parasitology Research.

[61]  A. Brass,et al.  Gene expression profiling in a mouse model for African trypanosomiasis , 2006, Genes and Immunity.

[62]  S. Allegretti,et al.  A Study of the Granulomatous Responses Induced by Different Strains of Schistosoma mansoni , 2012, Interdisciplinary perspectives on infectious diseases.

[63]  H. Fuchs,et al.  Mechanisms Controlling Anaemia in Trypanosoma congolense Infected Mice , 2009, PloS one.

[64]  O. Hanotte,et al.  Understanding bovine trypanosomiasis and trypanotolerance: the promise of functional genomics. , 2005, Veterinary immunology and immunopathology.

[65]  K. Else,et al.  The role of Th2 cytokines, chemokines and parasite products in eosinophil recruitment to the gastrointestinal mucosa during helminth infection , 2006, European journal of immunology.

[66]  C. Tato,et al.  Inhibition of NF-kappa B activity in T and NK cells results in defective effector cell expansion and production of IFN-gamma required for resistance to Toxoplasma gondii. , 2003, Journal of immunology.

[67]  Patricia M. Kristjanson,et al.  MEASURING THE COSTS OF AFRICAN ANIMAL TRYPANOSOMOSIS, THE POTENTIAL BENEFITS OF CONTROL AND RETURNS TO RESEARCH , 1999 .

[68]  A. R. De Lima,et al.  Cultivation of Trypanosoma cruzi epimastigotes in low glucose axenic media shifts its competence to differentiate at metacyclic trypomastigotes. , 2008, Experimental parasitology.

[69]  S. Klein,et al.  Immune cells have sex and so should journal articles. , 2012, Endocrinology.

[70]  A. Schuurs,et al.  Effects of gender and sex steroids on the immune response. , 1990, Journal of steroid biochemistry.

[71]  C. Leifer,et al.  Early Response of Mucosal Epithelial Cells during Toxoplasma gondii Infection , 2009, The Journal of Immunology.

[72]  D. A. Magee,et al.  Global Gene Expression and Systems Biology Analysis of Bovine Monocyte-Derived Macrophages in Response to In Vitro Challenge with Mycobacterium bovis , 2012, PloS one.

[73]  E. Hill,et al.  Divergent antimicrobial peptide (AMP) and acute phase protein (APP) responses to Trypanosoma congolense infection in trypanotolerant and trypanosusceptible cattle. , 2009, Molecular immunology.

[74]  Nigel W. Hardy,et al.  Promoting coherent minimum reporting guidelines for biological and biomedical investigations: the MIBBI project , 2008, Nature Biotechnology.

[75]  J. Byström,et al.  Interleukin‐5 does not influence differential transcription of transmembrane and soluble isoforms of IL‐5Rα in vivo , 2006, European journal of haematology.

[76]  P. Majiwa,et al.  Evidence for genetic diversity in Trypanosoma (Nannomonas) congolense , 1986, Parasitology.

[77]  K. Matthews,et al.  Isolates of Trichuris muris elicit different adaptive immune responses in their murine host , 2005, Parasite immunology.

[78]  Maria Elena Bottazzi,et al.  An Unfolding Tragedy of Chagas Disease in North America , 2013, PLoS neglected tropical diseases.

[79]  S. Howell,et al.  Changes in gene expression in macrophages infected with Mycobacterium tuberculosis: a combined transcriptomic and proteomic approach , 2001, Immunology.

[80]  S. Hajduk,et al.  The TgsGP Gene Is Essential for Resistance to Human Serum in Trypanosoma brucei gambiense , 2013, PLoS pathogens.

[81]  D. Foell,et al.  Keratinocytes Determine Th1 Immunity during Early Experimental Leishmaniasis , 2010, PLoS pathogens.

[82]  H. D. del Portillo,et al.  Expression of non-TLR pattern recognition receptors in the spleen of BALB/c mice infected with Plasmodium yoelii and Plasmodium chabaudi chabaudi AS. , 2012, Memorias do Instituto Oswaldo Cruz.

[83]  D. L. Guilbride,et al.  Malaria's deadly secret: a skin stage. , 2012, Trends in parasitology.

[84]  Cassidy R. Sugimoto,et al.  Bias in peer review , 2013, J. Assoc. Inf. Sci. Technol..

[85]  P. Scott,et al.  IL-12 Is Required to Maintain a Th1 Response During Leishmania major Infection1 , 2000, The Journal of Immunology.

[86]  Z. Yadón,et al.  Chagas disease: a Latin American health problem becoming a world health problem. , 2010, Acta tropica.

[87]  G. Schaub,et al.  Experimental Chagas disease: the influence of sex and psychoneuroimmunological factors , 2001, Parasitology Research.

[88]  M. Miles,et al.  DO RADICALLY DISSIMILAR TRYPANOSOMA CRUZI STRAINS (ZYMODEMES) CAUSE VENEZUELAN AND BRAZILIAN FORMS OF CHAGAS' DISEASE? , 1981, The Lancet.

[89]  F. Wunderlich,et al.  Hepatic miRNA expression reprogrammed by Plasmodium chabaudi malaria , 2011, Parasitology Research.

[90]  Ana Rodriguez,et al.  Transcriptome profile of dendritic cells during malaria: cAMP regulation of IL‐6 , 2007, Cellular microbiology.

[91]  Xinxia Peng,et al.  Host cell transcriptional profiling during malaria liver stage infection reveals a coordinated and sequential set of biological events , 2009, BMC Genomics.

[92]  C. Beattie,et al.  cDNA Microarray Analysis of Host-Pathogen Interactions in a Porcine In Vitro Model for Toxoplasma gondii Infection , 2006, Infection and Immunity.

[93]  F. Cunha,et al.  Nitric oxide is involved in control of Trypanosoma cruzi-induced parasitemia and directly kills the parasite in vitro , 1994, Infection and immunity.

[94]  T. Hughes,et al.  Simultaneous host and parasite expression profiling identifies tissue-specific transcriptional programs associated with susceptibility or resistance to experimental cerebral malaria , 2006, BMC Genomics.

[95]  A. Sher,et al.  Tpl2 kinase regulates T cell interferon-γ production and host resistance to Toxoplasma gondii , 2008, The Journal of experimental medicine.

[96]  Jason E. Stewart,et al.  Minimum information about a microarray experiment (MIAME)—toward standards for microarray data , 2001, Nature Genetics.

[97]  R. Tarleton,et al.  Inducible Nitric Oxide Synthase Is Not Essential for Control of Trypanosoma cruzi Infection in Mice , 2004, Infection and Immunity.

[98]  C. Potten,et al.  Accelerated Intestinal Epithelial Cell Turnover: A New Mechanism of Parasite Expulsion , 2005, Science.

[99]  M. Llewellyn,et al.  The revised Trypanosoma cruzi subspecific nomenclature: rationale, epidemiological relevance and research applications. , 2012, Infection, genetics and evolution : journal of molecular epidemiology and evolutionary genetics in infectious diseases.

[100]  黄亚明（整理）,et al.  ICMJE , 2012 .

[101]  Yuesheng Li,et al.  Co-ordinated Gene Expression in the Liver and Spleen during Schistosoma japonicum Infection Regulates Cell Migration , 2010, PLoS neglected tropical diseases.

[102]  L. Aravind,et al.  Experimental Cerebral Malaria in Mice That Are Associated with the Expression of Host Biomarkers and Biological Pathways Supplemental Material , 2008 .

[103]  J. Cazareth,et al.  Cd4 Ϩ T Cell Polarization in Mice Is Modulated by Strain- Specific Major Histocompatibility Complex–independent Differences within Dendritic Cells , 2003 .

[104]  Y. Iwakura,et al.  IL-17 Is Necessary for Host Protection against Acute-Phase Trypanosoma cruzi Infection , 2010, The Journal of Immunology.

[105]  I. Goodhead,et al.  A Comprehensive Genetic Analysis of Candidate Genes Regulating Response to Trypanosoma congolense Infection in Mice , 2010, PLoS neglected tropical diseases.

[106]  Anton Nekrutenko,et al.  Ten Simple Rules for Reproducible Computational Research , 2013, PLoS Comput. Biol..

[107]  W. Witola,et al.  Kinetics of regulatory dendritic cells in inflammatory responses during Trypanosoma evansi infection , 2012, Parasite immunology.

[108]  T. Aoki,et al.  Gene expression profiles in response to Fas stimulation in Trypanosoma cruzi-infected host cells. , 2005, International journal for parasitology.

[109]  H. Ball,et al.  Predominance of Interferon-Related Responses in the Brain during Murine Malaria, as Identified by Microarray Analysis , 2008, Infection and Immunity.

[110]  J. Boothroyd,et al.  Differences among the three major strains of Toxoplasma gondii and their specific interactions with the infected host. , 2005, Trends in parasitology.

[111]  D. Spray,et al.  Transcriptomic alterations in Trypanosoma cruzi-infected cardiac myocytes. , 2009, Microbes and infection.

[112]  S. Reid,et al.  Analysis of gene expression profiles in the liver and spleen of mice infected with Trypanosoma evansi by using a cDNA microarray , 2008, Parasitology Research.

[113]  Satoru Fukuyama,et al.  Loss of SOCS3 in T helper cells resulted in reduced immune responses and hyperproduction of interleukin 10 and transforming growth factor–β1 , 2006, The Journal of experimental medicine.

[114]  Denis Puthier,et al.  Gene expression analysis reveals early changes in several molecular pathways in cerebral malaria-susceptible mice versus cerebral malaria-resistant mice , 2007, BMC Genomics.

[115]  R. Einspanier,et al.  Integrated MicroRNA-mRNA-Analysis of Human Monocyte Derived Macrophages upon Mycobacterium avium subsp. hominissuis Infection , 2011, PloS one.

[116]  D. Spray,et al.  Microarray analysis of changes in gene expression in a murine model of chronic chagasic cardiomyopathy , 2003, Parasitology Research.

[117]  Michael P Barrett,et al.  The trypanosomiases , 2003, The Lancet.

[118]  R. Tarleton,et al.  Endogenous CD4+ CD25+ Regulatory T Cells Have a Limited Role in the Control of Trypanosoma cruzi Infection in Mice , 2006, Infection and Immunity.

[119]  A. Haque,et al.  Common Strategies To Prevent and Modulate Experimental Cerebral Malaria in Mouse Strains with Different Susceptibilities , 2008, Infection and Immunity.

[120]  J. Daily,et al.  Trypanosoma cruzi Triggers an Early Type I IFN Response In Vivo at the Site of Intradermal Infection1 , 2009, The Journal of Immunology.

[121]  J. Ioannidis,et al.  The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration , 2009, Annals of Internal Medicine [serial online].

[122]  I. Goodhead,et al.  Whole-Genome Sequencing of Trypanosoma brucei Reveals Introgression between Subspecies That Is Associated with Virulence , 2013, mBio.

[123]  M. Torrero,et al.  Induction of type 2 responses by schistosome worms during prepatent infection. , 2010, The Journal of infectious diseases.

[124]  Rohan Williams,et al.  Gene expression in HIV-1/Mycobacterium tuberculosis co-infected macrophages is dominated by M. tuberculosis. , 2009, Tuberculosis.

[125]  D. Spray,et al.  Reversion of gene expression alterations in hearts of mice with chronic chagasic cardiomyopathy after transplantation of bone marrow cells , 2011, Cell cycle.

[126]  S. Montenegro,et al.  Genetic susceptibility to chronic Chagas disease: an overview of single nucleotide polymorphisms of cytokine genes. , 2012, Cytokine.

[127]  M. Shikanai-Yasuda,et al.  Oral transmission of Chagas disease. , 2012, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[128]  K. Nocka,et al.  Human alveolar macrophage gene responses to Mycobacterium tuberculosis strains H37Ra and H37Rv. , 2009, American journal of respiratory cell and molecular biology.

[129]  H. McSorley,et al.  Migrating Schistosoma japonicum schistosomula induce an innate immune response and wound healing in the murine lung. , 2011, Molecular immunology.

[130]  B. Müller-Myhsok,et al.  Genes from Chagas Susceptibility Loci That Are Differentially Expressed in T. cruzi-Resistant Mice Are Candidates Accounting for Impaired Immunity , 2006, PloS one.

[131]  R. Manzano-Román,et al.  Proteomic identification of endothelial cell surface proteins isolated from the hepatic portal vein of mice infected with Schistosoma bovis. , 2012, Journal of proteomics.

[132]  C. Hunter,et al.  IL-27R deficiency delays the onset of colitis and protects from helminth-induced pathology in a model of chronic IBD. , 2008, International immunology.

[133]  J. Ioannidis.  Why Most Published Research Findings Are False , 2005, PLoS medicine.