Rigor and reproducibility in rodent behavioral research

Behavioral neuroscience research incorporates the identical high level of meticulous methodologies and exacting attention to detail as all other scientific disciplines. To achieve maximal rigor and reproducibility of findings, well-trained investigators employ a variety of established best practices. Here we explicate some of the requirements for rigorous experimental design and accurate data analysis in conducting mouse and rat behavioral tests. Novel object recognition is used as an example of a cognitive assay which has been conducted successfully with a range of methods, all based on common principles of appropriate procedures, controls, and statistics. Directors of Rodent Core facilities within Intellectual and Developmental Disabilities Research Centers contribute key aspects of their own novel object recognition protocols, offering insights into essential similarities and less-critical differences. Literature cited in this review article will lead the interested reader to source papers that provide step-by-step protocols which illustrate optimized methods for many standard rodent behavioral assays. Adhering to best practices in behavioral neuroscience will enhance the value of animal models for the multiple goals of understanding biological mechanisms, evaluating consequences of genetic mutations, and discovering efficacious therapeutics.

[1]  Sophie L. Dix,et al.  Extending the spontaneous preference test of recognition: evidence of object-location and object-context recognition , 1999, Behavioural Brain Research.

[2]  K. Beck,et al.  Food deprivation modulates chronic stress effects on object recognition in male rats: role of monoamines and amino acids , 1999, Brain Research.

[3]  M. Cook,et al.  Global Expression Profiling in Epileptogenesis: Does It Add to the Confusion? , 2009, Brain pathology.

[4]  Qingying Meng,et al.  Genetic coregulation of age of female sexual maturation and lifespan through circulating IGF1 among inbred mouse strains , 2012, Proceedings of the National Academy of Sciences.

[5]  L. Guo,et al.  Social isolation-induced epigenetic changes in midbrain of adult mice. , 2014, Journal of physiology and pharmacology : an official journal of the Polish Physiological Society.

[6]  Douglas Wahlsten,et al.  Different data from different labs: lessons from studies of gene-environment interaction. , 2003, Journal of neurobiology.

[7]  Monica Driscoll,et al.  A long journey to reproducible results , 2017, Nature.

[8]  D. Storm,et al.  Inhibition of Adult Neurogenesis by Inducible and Targeted Deletion of ERK5 Mitogen-Activated Protein Kinase Specifically in Adult Neurogenic Regions Impairs Contextual Fear Extinction and Remote Fear Memory , 2012, The Journal of Neuroscience.

[9]  Yali Chen,et al.  Learning, memory and synaptic plasticity in hippocampus in rats exposed to sevoflurane , 2016, International Journal of Developmental Neuroscience.

[10]  R. Araneda,et al.  Mice Lacking M1 and M3 Muscarinic Acetylcholine Receptors Have Impaired Odor Discrimination and Learning , 2017, Front. Synaptic Neurosci..

[11]  B. Everitt,et al.  In search of predictive endophenotypes in addiction: insights from preclinical research , 2016, Genes, brain, and behavior.

[12]  M. Stanton,et al.  Determinants of novel object and location recognition during development , 2013, Behavioural Brain Research.

[13]  Jörg B Schulz,et al.  The impact of fraudulent and irreproducible data to the translational research crisis – solutions and implementation , 2016, Journal of neurochemistry.

[14]  Marta Coelho Antunes,et al.  The novel object recognition memory: neurobiology, test procedure, and its modifications , 2011, Cognitive Processing.

[15]  M. Dierssen,et al.  Impaired Spatial Learning Strategies and Novel Object Recognition in Mice Haploinsufficient for the Dual Specificity Tyrosine-Regulated Kinase-1A (Dyrk1A) , 2008, PloS one.

[16]  A. Ennaceur One-trial object recognition in rats and mice: Methodological and theoretical issues , 2010, Behavioural Brain Research.

[17]  M. Geyer,et al.  Isolation rearing of mice induces deficits in prepulse inhibition of the startle response , 2006, Behavioural Brain Research.

[18]  G. Riedel,et al.  Comparison of automated home-cage monitoring systems: Emphasis on feeding behaviour, activity and spatial learning following pharmacological interventions , 2014, Journal of Neuroscience Methods.

[19]  T. Robbins,et al.  Cross‐species studies of cognition relevant to drug discovery: a translational approach , 2017, British journal of pharmacology.

[20]  M. Munafo,et al.  Incentivising reproducible research , 2014, Cortex.

[21]  K. Rutten,et al.  Automated scoring of novel object recognition in rats , 2008, Journal of Neuroscience Methods.

[22]  Jos Prickaerts,et al.  Object recognition testing: Statistical considerations , 2012, Behavioural Brain Research.

[23]  A. Lawrence,et al.  Hurdles in Basic Science Translation , 2017, Front. Pharmacol..

[24]  Iveta Simera,et al.  Helping editors, peer reviewers and authors improve the clarity, completeness and transparency of reporting health research , 2008, BMC medicine.

[25]  Tracy L Young-Pearse,et al.  Modeling developmental neuropsychiatric disorders with iPSC technology: challenges and opportunities , 2016, Current Opinion in Neurobiology.

[26]  Terence P. Speed,et al.  How data analysis affects power, reproducibility and biological insight of RNA-seq studies in complex datasets , 2015, Nucleic acids research.

[27]  Marcia McNutt,et al.  Journals unite for reproducibility , 2014, Science.

[28]  A. Palmeri,et al.  Behavioral assays with mouse models of Alzheimer's disease: practical considerations and guidelines. , 2014, Biochemical pharmacology.

[29]  J. Crawley,et al.  Behavioral Phenotyping Strategies for Mutant Mice , 2008, Neuron.

[30]  V. Vijayanathan,et al.  Persistent cognitive deficits, induced by intrathecal methotrexate, are associated with elevated CSF concentrations of excitotoxic glutamate analogs and can be reversed by an NMDA antagonist , 2011, Behavioural Brain Research.

[31]  Jack W. Tsao,et al.  What's wrong with my mouse: Behavioral phenotyping of transgenic and knockout mice, J. Crawley. Wiley-Interscience, Hoboken, NJ (2007), 523 pages, $99.95 , 2008 .

[32]  S. Dulawa,et al.  Infant maternal separation impairs adult cognitive performance in BALB/cJ mice , 2011, Psychopharmacology.

[33]  M. Bear,et al.  R-Baclofen Reverses Cognitive Deficits and Improves Social Interactions in Two Lines of 16p11.2 Deletion Mice , 2017, Neuropsychopharmacology.

[34]  T. Jover-Mengual,et al.  Acute and chronic estradiol treatments reduce memory deficits induced by transient global ischemia in female rats , 2006, Hormones and Behavior.

[35]  Anirvan Ghosh,et al.  Synapse dysfunction in autism: a molecular medicine approach to drug discovery in neurodevelopmental disorders. , 2012, Trends in pharmacological sciences.

[36]  I. Zucker,et al.  Males still dominate animal studies , 2010, Nature.

[37]  A. Neuringer,et al.  Reinforced variability enhances object exploration in shy and bold rats , 2012, Physiology & Behavior.

[38]  Loren J. Martin,et al.  Olfactory exposure to males, including men, causes stress and related analgesia in rodents , 2014, Nature Methods.

[39]  A. Blokland,et al.  Object recognition testing: Methodological considerations on exploration and discrimination measures , 2012, Behavioural Brain Research.

[40]  K. Hoffman,et al.  One-trial object recognition memory in the domestic rabbit (Oryctolagus cuniculus) is disrupted by NMDA receptor antagonists , 2013, Behavioural Brain Research.

[41]  L. Jacobs,et al.  Sex differences in object recognition are modulated by object similarity , 2012, Behavioural Brain Research.

[42]  D. Drucker,et al.  Never Waste a Good Crisis: Confronting Reproducibility in Translational Research. , 2016, Cell metabolism.

[43]  John F. Cryan,et al.  Model organisms: The ascent of mouse: advances in modelling human depression and anxiety , 2005, Nature Reviews Drug Discovery.

[44]  Ru Zhang,et al.  Novel object recognition as a facile behavior test for evaluating drug effects in AβPP/PS1 Alzheimer's disease mouse model. , 2012, Journal of Alzheimer's disease : JAD.

[45]  J. Crawley,et al.  Translational Mouse Models of Autism: Advancing Toward Pharmacological Therapeutics. , 2016, Current topics in behavioral neurosciences.

[46]  J. Crawley,et al.  AMPAKINE enhancement of social interaction in the BTBR mouse model of autism , 2013, Neuropharmacology.

[47]  J. Flier,et al.  Irreproducibility of published bioscience research: Diagnosis, pathogenesis and therapy , 2016, Molecular metabolism.

[48]  Francis S Collins,et al.  Policy: NIH to balance sex in cell and animal studies , 2014, Nature.

[49]  Jos Prickaerts,et al.  Performance of different mouse strains in an object recognition task , 2003, Behavioural Brain Research.

[50]  G. Lynch,et al.  The likelihood of cognitive enhancement , 2011, Pharmacology Biochemistry and Behavior.

[51]  Tapan P. Patel,et al.  An open-source toolbox for automated phenotyping of mice in behavioral tasks , 2014, Front. Behav. Neurosci..

[52]  Ryan P. Adams,et al.  Mapping Sub-Second Structure in Mouse Behavior , 2015, Neuron.

[53]  David J. Anderson,et al.  Automated measurement of mouse social behaviors using depth sensing, video tracking, and machine learning , 2015, Proceedings of the National Academy of Sciences.

[54]  David P Wolfer,et al.  Similar reliability and equivalent performance of female and male mice in the open field and water‐maze place navigation task , 2017, American journal of medical genetics. Part C, Seminars in medical genetics.

[55]  S. Lazic,et al.  A call for transparent reporting to optimize the predictive value of preclinical research , 2012, Nature.

[56]  Z. Csaba,et al.  Differences in the onset of puberty in selected inbred mouse strains , 2007 .

[57]  Michael Williams,et al.  Irreproducibility in Preclinical Biomedical Research: Perceptions, Uncertainties, and Knowledge Gaps. , 2016, Trends in pharmacological sciences.

[58]  P. Gean,et al.  Social isolation‐induced increase in NMDA receptors in the hippocampus exacerbates emotional dysregulation in mice , 2015, Hippocampus.

[59]  Jacqueline N. Crawley,et al.  A Proposed Test Battery and Constellations of Specific Behavioral Paradigms to Investigate the Behavioral Phenotypes of Transgenic and Knockout Mice , 1997, Hormones and Behavior.

[60]  Ushma S. Neill,et al.  Stop misbehaving! , 2006, The Journal of clinical investigation.

[61]  J. M. Silvers,et al.  Automation of the novel object recognition task for use in adolescent rats , 2007, Journal of Neuroscience Methods.

[62]  Michael C. Frank,et al.  Estimating the reproducibility of psychological science , 2015, Science.

[63]  C. Sánchez,et al.  Reversal of age-associated cognitive deficits is accompanied by increased plasticity-related gene expression after chronic antidepressant administration in middle-aged mice , 2015, Pharmacology Biochemistry and Behavior.

[64]  S. Cabib,et al.  Selective improvement of strain-dependent performances of cognitive tasks by food restriction , 2004, Neurobiology of Learning and Memory.

[65]  K. Tsuritani,et al.  Social isolation rearing‐induced impairment of the hippocampal neurogenesis is associated with deficits in spatial memory and emotion‐related behaviors in juvenile mice , 2008, Journal of neurochemistry.

[66]  G. Biggio,et al.  Isolation Rearing Reduces Neuronal Excitability in Dentate Gyrus Granule Cells of Adolescent C57BL/6J Mice: Role of GABAergic Tonic Currents and Neurosteroids , 2016, Front. Cell. Neurosci..

[67]  M. Sarter Preclinical research into cognition enhancers. , 2006, Trends in pharmacological sciences.

[68]  T. Tamura,et al.  Impact of Preoperative Environmental Enrichment on Prevention of Development of Cognitive Impairment following Abdominal Surgery in a Rat Model , 2015, Anesthesiology.

[69]  Michel Boulouard,et al.  Object recognition test in mice , 2013, Nature Protocols.

[70]  M. Scattoni,et al.  Neurobiology of autism , 2013, Behavioural Brain Research.

[71]  Annie Vogel-Ciernia,et al.  Examining Object Location and Object Recognition Memory in Mice , 2014, Current protocols in neuroscience.

[72]  S. Kwak,et al.  Central limit theorem: the cornerstone of modern statistics , 2017, Korean journal of anesthesiology.

[73]  Erik W. Moody,et al.  Effects of Ontogeny on Performance of Rats in a Novel Object-Recognition Task , 2004, Psychological reports.

[74]  Remco C. Veltkamp,et al.  Learning to recognize rat social behavior: Novel dataset and cross-dataset application , 2017, Journal of Neuroscience Methods.

[75]  F. Collins,et al.  Policy: NIH plans to enhance reproducibility , 2014, Nature.

[76]  C. Lajonchere,et al.  Assessing behavioural and cognitive domains of autism spectrum disorders in rodents: current status and future perspectives , 2013, Psychopharmacology.

[77]  D. Faber,et al.  Validation of a 2-day water maze protocol in mice , 2009, Behavioural Brain Research.

[78]  Effect of post-weaning isolation on anxiety- and depressive-like behaviors of C57BL/6J mice , 2017, Experimental Brain Research.

[79]  Maxime W. C. Rousseaux,et al.  Disruption of the ATXN1–CIC complex causes a spectrum of neurobehavioral phenotypes in mice and humans , 2017, Nature Genetics.

[80]  Rick A Bevins,et al.  Object recognition in rats and mice: a one-trial non-matching-to-sample learning task to study 'recognition memory' , 2006, Nature Protocols.

[81]  J. Delacour,et al.  Spatial but not object recognition is impaired by aging in rats , 1993, Physiology & Behavior.

[82]  J. Feldon,et al.  The postweaning social isolation in C57BL/6 mice: preferential vulnerability in the male sex , 2008, Psychopharmacology.

[83]  B. Cheng,et al.  Contrasting mechanisms by which social isolation and restraint impair healing in male mice , 2014, Stress.

[84]  R. Palmiter,et al.  Conditional deletion of Ndufs4 in dopaminergic neurons promotes Parkinson’s disease-like non-motor symptoms without loss of dopamine neurons , 2017, Scientific Reports.

[85]  D. Spray,et al.  Persistent cognitive and motor deficits after successful antimalarial treatment in murine cerebral malaria. , 2010, Microbes and infection.

[86]  N. Ohashi,et al.  Social isolation stress induces hepatic hypertrophy in C57BL/6J mice. , 2012, The Journal of toxicological sciences.

[87]  S. Smith,et al.  Sex differences in anxiety, sensorimotor gating and expression of the α4 subunit of the GABAA receptor in the amygdala after progesterone withdrawal , 2003, The European journal of neuroscience.

[88]  J. Raber,et al.  Sex-differences in age-related cognitive decline in C57BL/6J mice associated with increased brain microtubule-associated protein 2 and synaptophysin immunoreactivity , 2006, Neuroscience.

[89]  Rodney C. Samaco,et al.  Genetic rodent models of brain disorders: Perspectives on experimental approaches and therapeutic strategies , 2017, American journal of medical genetics. Part C, Seminars in medical genetics.

[90]  Michele T. Diaz,et al.  Progress toward openness, transparency, and reproducibility in cognitive neuroscience , 2017, Annals of the New York Academy of Sciences.

[91]  Leonid Churilov,et al.  Risk of Bias in Reports of In Vivo Research: A Focus for Improvement , 2015, PLoS biology.

[92]  M. Geyer,et al.  Developing translational animal models for symptoms of schizophrenia or bipolar mania , 2008, Neurotoxicity Research.

[93]  S. M. Stahl,et al.  Innovative solutions to novel drug development in mental health , 2013, Neuroscience & Biobehavioral Reviews.

[94]  R. Palmiter,et al.  Genetic Activation of ERK5 MAP Kinase Enhances Adult Neurogenesis and Extends Hippocampus-Dependent Long-Term Memory , 2014, The Journal of Neuroscience.

[95]  Matthias M. Müller,et al.  A cross-laboratory study of event-related gamma activity in a standard object recognition paradigm , 2006, NeuroImage.

[96]  L. Saksida,et al.  New translational assays for preclinical modelling of cognition in schizophrenia: The touchscreen testing method for mice and rats , 2012, Neuropharmacology.

[97]  J. Aggleton,et al.  New behavioral protocols to extend our knowledge of rodent object recognition memory. , 2010, Learning & memory.

[98]  D. Spray,et al.  Focal Inflammation Causes Carbenoxolone-Sensitive Tactile Hypersensitivity in Mice. , 2010, The open pain journal.

[99]  V. Vijayanathan,et al.  Intrathecal methotrexate induces focal cognitive deficits and increases cerebrospinal fluid homocysteine , 2010, Pharmacology Biochemistry and Behavior.

[100]  I. Kola,et al.  Can the pharmaceutical industry reduce attrition rates? , 2004, Nature Reviews Drug Discovery.

[101]  G. T. Jones ‘Surely You're Joking, Mr Feynman!’ Adventures of a Curious Character , 1985 .

[102]  L. Spear,et al.  Novel-object place conditioning in adolescent and adult male and female rats: effects of social isolation , 2003, Physiology & Behavior.

[103]  F. Gil-Bea,et al.  Long-lasting behavioral effects and recognition memory deficit induced by chronic mild stress in mice: effect of antidepressant treatment , 2008, Psychopharmacology.

[104]  Bernhard Voelkl,et al.  Reproducibility Crisis: Are We Ignoring Reaction Norms? , 2016, Trends in pharmacological sciences.

[105]  J. Crawley,et al.  16p11.2 Deletion mice display cognitive deficits in touchscreen learning and novelty recognition tasks , 2015, Learning & memory.

[106]  Heather A. Mitchell,et al.  Increased expression of AT-1/SLC33A1 causes an autistic-like phenotype in mice by affecting dendritic branching and spine formation , 2016, The Journal of experimental medicine.

[107]  K Safi,et al.  Consistent behavioral phenotype differences between inbred mouse strains in the IntelliCage , 2010, Genes, brain, and behavior.

[108]  D. Dickel,et al.  Germline Chd8 haploinsufficiency alters brain development in mouse , 2017, Nature Neuroscience.

[109]  Monya Baker,et al.  Reproducibility: Check your chemistry , 2017, Nature.

[110]  Novel image–novel location object recognition task sensitive to age-related cognitive decline in nondemented elderly , 2011, AGE.

[111]  V. Sohal,et al.  Of Mice, Men, and Microbial Opsins: How Optogenetics Can Help Hone Mouse Models of Mental Illness , 2016, Biological Psychiatry.

[112]  Y. Ichitani,et al.  Long-term object location memory in rats: Effects of sample phase and delay length in spontaneous place recognition test , 2011, Neuroscience Letters.

[113]  J. Delacour,et al.  A new one-trial test for neurobiological studies of memory in rats. 1: Behavioral data , 1988, Behavioural Brain Research.

[114]  Yen-Yu Chang,et al.  Long-term social isolation exacerbates the impairment of spatial working memory in APP/PS1 transgenic mice , 2011, Brain Research.

[115]  V. Moser Functional Assays for Neurotoxicity Testing , 2011, Toxicologic pathology.

[116]  I. Gaisler-Salomon,et al.  Differential effects of social isolation in adolescent and adult mice on behavior and cortical gene expression , 2017, Behavioural Brain Research.

[117]  T. Kishimoto,et al.  Social isolation impairs remyelination in mice through modulation of IL‐6 , 2016, FASEB journal : official publication of the Federation of American Societies for Experimental Biology.

[118]  E. Tanenbaum,et al.  Memantine Protects Rats Treated with Intrathecal Methotrexate from Developing Spatial Memory Deficits , 2013, Clinical Cancer Research.

[119]  A. Blokland,et al.  Object recognition testing: Rodent species, strains, housing conditions, and estrous cycle , 2012, Behavioural Brain Research.

[120]  J. Wharton,et al.  Why drugs fail in clinical trials in pulmonary arterial hypertension, and strategies to succeed in the future. , 2016, Pharmacology & therapeutics.

[121]  J. Crabbe,et al.  Genetics of mouse behavior: interactions with laboratory environment. , 1999, Science.

[122]  Jacqueline N. Crawley,et al.  Negative Allosteric Modulation of the mGluR5 Receptor Reduces Repetitive Behaviors and Rescues Social Deficits in Mouse Models of Autism , 2012, Science Translational Medicine.

[123]  C. Ferretti,et al.  Sex Differences in Memory Performance in the Object Recognition Test. Possible Role of Histamine Receptors , 1999, Pharmacology Biochemistry and Behavior.

[124]  F. Artigas,et al.  Vortioxetine, a novel antidepressant with multimodal activity: review of preclinical and clinical data. , 2015, Pharmacology & therapeutics.

[125]  J. Crawley,et al.  Behavioral phenotypes of genetic mouse models of autism , 2016, Genes, brain, and behavior.

[126]  Sue-Hyun Lee,et al.  Social Isolation Selectively Increases Anxiety in Mice without Affecting Depression-like Behavior. , 2009, The Korean journal of physiology & pharmacology : official journal of the Korean Physiological Society and the Korean Society of Pharmacology.

[127]  Sl McLean,et al.  Isolation rearing impairs novel object recognition and attentional set shifting performance in female rats , 2010, Journal of psychopharmacology.

[128]  D. Weinert,et al.  Novel object recognition of Djungarian hamsters depends on circadian time and rhythmic phenotype , 2015, Chronobiology international.

[129]  T. Abel,et al.  Post-training reversible inactivation of the hippocampus enhances novel object recognition memory. , 2010, Learning & memory.

[130]  C. Branch,et al.  Phenotypic characterization of a Csf1r haploinsufficient mouse model of adult-onset leukodystrophy with axonal spheroids and pigmented glia (ALSP) , 2015, Neurobiology of Disease.

[131]  Guang Yang,et al.  Long-lasting behavioral effects in neonatal mice with multiple exposures to ketamine-xylazine anesthesia. , 2017, Neurotoxicology and teratology.

[132]  Carla H. Lagorio,et al.  Psychology , 1929, Nature.

[133]  A. Ennaceur,et al.  A new one-trial test for neurobiological studies of memory in rats. III. Spatial vs. non-spatial working memory , 1992, Behavioural Brain Research.

[134]  Simon H. Ridley,et al.  Guidelines to improve animal study design and reproducibility for Alzheimer's disease and related dementias: For funders and researchers , 2016, Alzheimer's & Dementia.

[135]  R. Sapolsky,et al.  Spatial Memory and Long-Term Object Recognition Are Impaired by Circadian Arrhythmia and Restored by the GABAAAntagonist Pentylenetetrazole , 2013, PloS one.

[136]  C. Begley,et al.  Drug development: Raise standards for preclinical cancer research , 2012, Nature.

[137]  J. Delacour,et al.  A new one-trial test for neurobiological studies of memory in rats. II: Effects of piracetam and pramiracetam , 1989, Behavioural Brain Research.

[138]  K. Sawa,et al.  The diurnal variation of performance of the novel location recognition task in male rats , 2013, Behavioural Brain Research.

[139]  Y. Chida,et al.  Social isolation stress exacerbates autoimmune disease in MRL/lpr mice , 2005, Journal of Neuroimmunology.

[140]  V. Bertaina-Anglade,et al.  The object recognition task in rats and mice: a simple and rapid model in safety pharmacology to detect amnesic properties of a new chemical entity. , 2006, Journal of pharmacological and toxicological methods.

[141]  S. Hewitt,et al.  Reproducibility , 2019, Encyclopedia of Social Network Analysis and Mining. 2nd Ed..

[142]  J. Crabbe,et al.  The Complexity of Alcohol Drinking: Studies in Rodent Genetic Models , 2010, Behavior genetics.