Mantel test in population genetics

The comparison of genetic divergence or genetic distances, estimated by pairwise FST and related statistics, with geographical distances by Mantel test is one of the most popular approaches to evaluate spatial processes driving population structure. There have been, however, recent criticisms and discussions on the statistical performance of the Mantel test. Simultaneously, alternative frameworks for data analyses are being proposed. Here, we review the Mantel test and its variations, including Mantel correlograms and partial correlations and regressions. For illustrative purposes, we studied spatial genetic divergence among 25 populations of Dipteryx alata (“Baru”), a tree species endemic to the Cerrado, the Brazilian savannas, based on 8 microsatellite loci. We also applied alternative methods to analyze spatial patterns in this dataset, especially a multivariate generalization of Spatial Eigenfunction Analysis based on redundancy analysis. The different approaches resulted in similar estimates of the magnitude of spatial structure in the genetic data. Furthermore, the results were expected based on previous knowledge of the ecological and evolutionary processes underlying genetic variation in this species. Our review shows that a careful application and interpretation of Mantel tests, especially Mantel correlograms, can overcome some potential statistical problems and provide a simple and useful tool for multivariate analysis of spatial patterns of genetic divergence.

[1]  P. Meirmans,et al.  The trouble with isolation by distance , 2012, Molecular ecology.

[2]  J. Diniz‐Filho,et al.  Geographical patterns of turnover and nestedness-resultant components of allelic diversity among populations , 2012, Genetica.

[3]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[4]  Pierre Legendre,et al.  Is the Mantel correlogram powerful enough to be useful in ecological analysis? A simulation study. , 2012, Ecology.

[5]  Victor Lemes Landeiro,et al.  The Geometry of Spatial Analyses: Implications for Conservation Biologists , 2011 .

[6]  S. Castellano,et al.  IS THE PARTIAL MANTEL TEST INADEQUATE? , 2002, Evolution; international journal of organic evolution.

[7]  Raymond J. Dezzani,et al.  Statistical approaches in landscape genetics: an evaluation of methods for linking landscape and genetic data , 2009 .

[8]  Sarah C. Goslee,et al.  The ecodist Package for Dissimilarity-based Analysis of Ecological Data , 2007 .

[9]  R R Sokal,et al.  Using distance matrices to choose between competing theories and an application to the origin of modern humans. , 1997, Journal of human evolution.

[10]  R. Eckhardt.  Statistics of natural selection , 1987 .

[11]  Pierre Legendre,et al.  Estimating and controlling for spatial structure in the study of ecological communities , 2010 .

[12]  J V Neel,et al.  The genetic structure of a tribal population, the Yanomama Indians. XV. Patterns inferred by autocorrelation analysis. , 1986, Genetics.

[13]  Robert R. Sokal,et al.  Spatial autocorrelation in biology: 2. Some biological implications and four applications of evolutionary and ecological interest , 1978 .

[14]  J. L. Parra,et al.  Very high resolution interpolated climate surfaces for global land areas , 2005 .

[15]  P. Mielke,et al.  Clarification and Appropriate Inferences for Mantel and Valand's Nonparametric Multivariate Analysis Technique , 1978 .

[16]  Pierre Legendre,et al.  Comparison of permutation methods for the partial correlation and partial mantel tests , 2000 .

[17]  Jeremy W. Lichstein,et al.  Multiple regression on distance matrices: a multivariate spatial analysis tool , 2007, Plant Ecology.

[18]  L. Harmon,et al.  POOR STATISTICAL PERFORMANCE OF THE MANTEL TEST IN PHYLOGENETIC COMPARATIVE ANALYSES , 2010, Evolution; international journal of organic evolution.

[19]  Gilles Guillot,et al.  Dismantling the Mantel tests , 2011, 1112.0651.

[20]  F. Rousset,et al.  ARE PARTIAL MANTEL TESTS ADEQUATE? , 2001, Evolution; international journal of organic evolution.

[21]  J. Neel.  The genetic structure of a tribal population, the Yanomama Indians , 1972, American journal of human genetics.

[22]  Robert R. Sokal,et al.  Directional Autocorrelation: An Extension of Spatial Correlograms to Two Dimensions , 1986 .

[23]  K. Holsinger,et al.  Genetics in geographically structured populations: defining, estimating and interpreting FST , 2009, Nature Reviews Genetics.

[24]  O. Hardy,et al.  New insights from fine‐scale spatial genetic structure analyses in plant populations , 2004, Molecular ecology.

[25]  P. Clifford,et al.  Modifying the t test for assessing the correlation between two spatial processes , 1993 .

[26]  T. Soares,et al.  Development of microsatellite markers for the neotropical tree species Dipteryx alata (Fabaceae). , 2012, American journal of botany.

[27]  Daniel A Griffith,et al.  Spatial modeling in ecology: the flexibility of eigenfunction spatial analyses. , 2006, Ecology.

[28]  Stéphanie Manel,et al.  Ten years of landscape genetics. , 2013, Trends in ecology & evolution.

[29]  R. Sokal,et al.  Genetic differences among language families in Europe. , 1989, American journal of physical anthropology.

[30]  Robert R. Sokal,et al.  Testing Statistical Significance of Geographic Variation Patterns , 1979 .

[31]  Enrique P. Lessa,et al.  MULTIDIMENSIONAL ANALYSIS OF GEOGRAPHIC GENETIC STRUCTURE , 1990 .

[32]  Richard Field,et al.  Coefficient shifts in geographical ecology: an empirical evaluation of spatial and non-spatial regression , 2009 .

[33]  R. Dennis Cook,et al.  The Statistics of Natural Selection. , 1987 .

[34]  J. Diniz‐Filho,et al.  Thirty‐five years of spatial autocorrelation analysis in population genetics: an essay in honour of Robert Sokal (1926–2012) , 2012 .

[35]  J. Diniz‐Filho,et al.  Planning for optimal conservation of geographical genetic variability within species , 2012, Conservation Genetics.

[36]  R. Sokal,et al.  Spatial Autocorrelation Analysis of Trend Residuals in Biological Data , 1989 .

[37]  J. A. D. Filho,et al.  Optimization procedures for establishing reserve networks for biodiversity conservation taking into account population genetic structure , 2006 .

[38]  P. Legendre,et al.  Common factors drive adaptive genetic variation at different spatial scales in Arabis alpina , 2010, Molecular ecology.

[39]  R. Sokal,et al.  Spatial autocorrelation in biology: 1. Methodology , 1978 .

[40]  R R Sokal,et al.  A Test of Spatial Autocorrelation Analysis Using an Isolation-by-Distance Model. , 1983, Genetics.

[41]  R. Sokal,et al.  Multiple regression and correlation extensions of the mantel test of matrix correspondence , 1986 .

[42]  Marie-Josée Fortin,et al.  A conceptual framework for the spatial analysis of landscape genetic data , 2013, Conservation Genetics.

[43]  N. Mantel.  The detection of disease clustering and a generalized regression approach. , 1967, Cancer research.

[44]  Daniel Wartenberg,et al.  Canonical Trend Surface Analysis: A Method for Describing Geographic Patterns , 1985 .

[45]  AURÉLIE COULON,et al.  Statistical methods in spatial genetics , 2009, Molecular ecology.

[46]  M. Rodrigues,et al.  Phylogeography and species limits in the Gymnodactylus darwinii complex (Gekkonidae, Squamata): genetic structure coincides with river systems in the Brazilian Atlantic Forest , 2005 .

[47]  R. G. Davies,et al.  Methods to account for spatial autocorrelation in the analysis of species distributional data : a review , 2007 .

[48]  Alternatives to the partial Mantel test in the study of environmental factors shaping human morphological variation. , 2010, Journal of human evolution.

[49]  Robert R. Sokal,et al.  An investigation of three-matrix permutation tests , 1992 .

[50]  M. Slatkin,et al.  Spatial Autocorrelation Methods in Population Genetics , 1991, The American Naturalist.

[51]  Luis Mauricio Bini,et al.  Spatial autocorrelation analysis allows disentangling the balance between neutral and niche processes in metacommunities , 2012 .

[52]  F. Rousset.  Genetic differentiation and estimation of gene flow from F-statistics under isolation by distance. , 1997, Genetics.

[53]  S. Cushman,et al.  Spurious correlations and inference in landscape genetics , 2010, Molecular ecology.

[54]  M. Fortin,et al.  Comparison of the Mantel test and alternative approaches for detecting complex multivariate relationships in the spatial analysis of genetic data , 2010, Molecular ecology resources.

[55]  P. Taberlet,et al.  Tracking genes of ecological relevance using a genome scan in two independent regional population samples of Arabis alpina , 2010, Molecular ecology.

[56]  P. Legendre,et al.  ANALYZING BETA DIVERSITY: PARTITIONING THE SPATIAL VARIATION OF COMMUNITY COMPOSITION DATA , 2005 .

[57]  J. Diniz‐Filho,et al.  Spatial Autocorrelation Analysis and the Identification of Operational Units for Conservation in Continuous Populations , 2002 .

[58]  P. Legendre,et al.  Forward selection of explanatory variables. , 2008, Ecology.

[59]  B. Manly.  Randomization, Bootstrap and Monte Carlo Methods in Biology , 2018 .

[60]  José Alexandre Felizola Diniz-Filho,et al.  A review of techniques for spatial modeling in geographical, conservation and landscape genetics , 2009, Genetics and molecular biology.

[61]  Xavier Vekemans,et al.  Isolation by distance in a continuous population: reconciliation between spatial autocorrelation analysis and population genetics models , 1999, Heredity.

[62]  P. Legendre,et al.  vegan : Community Ecology Package. R package version 1.8-5 , 2007 .