Valid statistical approaches for analyzing sholl data: Mixed effects versus simple linear models

BACKGROUND The Sholl technique is widely used to quantify dendritic morphology. Data from such studies, which typically sample multiple neurons per animal, are often analyzed using simple linear models. However, simple linear models fail to account for intra-class correlation that occurs with clustered data, which can lead to faulty inferences. NEW METHOD Mixed effects models account for intra-class correlation that occurs with clustered data; thus, these models more accurately estimate the standard deviation of the parameter estimate, which produces more accurate p-values. While mixed models are not new, their use in neuroscience has lagged behind their use in other disciplines. RESULTS A review of the published literature illustrates common mistakes in analyses of Sholl data. Analysis of Sholl data collected from Golgi-stained pyramidal neurons in the hippocampus of male and female mice using both simple linear and mixed effects models demonstrates that the p-values and standard deviations obtained using the simple linear models are biased downwards and lead to erroneous rejection of the null hypothesis in some analyses. COMPARISON WITH EXISTING METHODS The mixed effects approach more accurately models the true variability in the data set, which leads to correct inference. CONCLUSIONS Mixed effects models avoid faulty inference in Sholl analysis of data sampled from multiple neurons per animal by accounting for intra-class correlation. Given the widespread practice in neuroscience of obtaining multiple measurements per subject, there is a critical need to apply mixed effects models more widely.

[1]  E. Roberson,et al.  The dendritic hypothesis for Alzheimer's disease pathophysiology , 2014, Brain Research Bulletin.

[2]  Somnath Datta,et al.  Rank-Sum Tests for Clustered Data , 2005 .

[3]  J. Walsh Concerning the Effect of Intraclass Correlation on Certain Significance Tests , 1947 .

[4]  Arne V. Blackman,et al.  Neuronal morphometry directly from bitmap images , 2014, Nature Methods.

[5]  Phillip G. Popovich,et al.  Semi-automated Sholl analysis for quantifying changes in growth and differentiation of neurons and glia , 2010, Journal of Neuroscience Methods.

[6]  Sholl Da Dendritic organization in the neurons of the visual and motor cortices of the cat. , 1953 .

[7]  Christos Hatzis,et al.  Reproducibility of research and preclinical validation: problems and solutions , 2013, Nature Reviews Clinical Oncology.

[8]  Pamela J. Lein,et al.  Ontogenetic Alterations in Molecular and Structural Correlates of Dendritic Growth after Developmental Exposure to Polychlorinated Biphenyls , 2007, Environmental health perspectives.

[9]  S. Lazic,et al.  A call for transparent reporting to optimize the predictive value of preclinical research , 2012, Nature.

[10]  T. Ichikawa,et al.  Delayed maturation of neuronal architecture and synaptogenesis in cerebral cortex of Mecp2-deficient mice. , 2005, Journal of neuropathology and experimental neurology.

[11]  Liqun Luo,et al.  How do dendrites take their shape? , 2001, Nature Neuroscience.

[12]  Kaustubh Supekar,et al.  Brain hyperconnectivity in children with autism and its links to social deficits. , 2013, Cell reports.

[13]  Thomas Bourgeron,et al.  A synaptic trek to autism , 2009, Current Opinion in Neurobiology.

[14]  Sally Galbraith,et al.  A Study of Clustered Data and Approaches to Its Analysis , 2010, The Journal of Neuroscience.

[15]  R. Wood,et al.  Anabolic-androgenic steroids decrease dendritic spine density in the nucleus accumbens of male rats , 2016, Neuroscience.

[16]  Matthijs Verhage,et al.  A solution to dependency: using multilevel analysis to accommodate nested data , 2014, Nature Neuroscience.

[17]  M. Boisgontier,et al.  The anova to mixed model transition , 2016, Neuroscience & Biobehavioral Reviews.

[18]  F. Saravia,et al.  Environmental enrichment prevents astroglial pathological changes in the hippocampus of APP transgenic mice, model of Alzheimer's disease , 2013, Experimental Neurology.

[19]  H. Steinbusch,et al.  Pregnancy or stress decrease complexity of CA3 pyramidal neurons in the hippocampus of adult female rats , 2012, Neuroscience.

[20]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[21]  Frederic Libersat,et al.  Mechanisms of dendritic maturation , 2004, Molecular Neurobiology.

[22]  C. Keown,et al.  Local functional overconnectivity in posterior brain regions is associated with symptom severity in autism spectrum disorders. , 2013, Cell reports.

[23]  S. Gupton,et al.  Building Blocks of Functioning Brain: Cytoskeletal Dynamics in Neuronal Development. , 2016, International review of cell and molecular biology.

[24]  Helen Brown,et al.  Applied Mixed Models in Medicine , 2000, Technometrics.

[25]  L. Garey When cortical development goes wrong: schizophrenia as a neurodevelopmental disease of microcircuits , 2010, Journal of anatomy.

[26]  Michael H. Kutner Applied Linear Statistical Models , 1974 .

[27]  R. Wolfinger,et al.  SAS for Mixed Models , 2018 .

[28]  F. Collins,et al.  Policy: NIH plans to enhance reproducibility , 2014, Nature.

[29]  S Senn,et al.  Some controversies in planning and analysing multi-centre trials. , 1998, Statistics in medicine.

[30]  J. Ioannidis Why Most Published Research Findings Are False , 2005, PLoS medicine.