Inferring species interactions from co-occurrence data with Markov networks.

Inferring species interactions from co-occurrence data is one of the most controversial tasks in community ecology. One difficulty is that a single pairwise interaction can ripple through an ecological network and produce surprising indirect consequences. For example, the negative correlation between two competing species can be reversed in the presence of a third species that outcompetes both of them. Here, I apply models from statistical physics, called Markov networks or Markov random fields, that can predict the direct and indirect consequences of any possible species interaction matrix. Interactions in these models can be estimated from observed co-occurrence rates via maximum likelihood, controlling for indirect effects. Using simulated landscapes with known interactions, I evaluated Markov networks and six existing approaches. Markov networks consistently outperformed the other methods, correctly isolating direct interactions between species pairs even when indirect interactions or abiotic factors largely overpowered them. Two computationally efficient approximations, which controlled for indirect effects with partial correlations or generalized linear models, also performed well. Null models showed no evidence of being able to control for indirect effects, and reliably yielded incorrect inferences when such effects were present.

[1]  N. Gotelli,et al.  Spatial and temporal niche partitioning in grassland ants , 2017, Oecologia.

[2]  David J. Harris Generating realistic assemblages with a joint species distribution model , 2015 .

[3]  Trevor Hastie,et al.  Learning the Structure of Mixed Graphical Models , 2015, Journal of computational and graphical statistics : a joint publication of American Statistical Association, Institute of Mathematical Statistics, Interface Foundation of North America.

[4]  E. White,et al.  A Strong Test of the Maximum Entropy Theory of Ecology , 2013, The American Naturalist.

[5]  Laura J. Pollock,et al.  Understanding co‐occurrence by modelling species simultaneously with a Joint Species Distribution Model (JSDM) , 2014 .

[6]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[7]  Daniel Simberloff,et al.  The checkered history of checkerboard distributions. , 2013, Ecology.

[8]  Joseph A. Veech,et al.  A probabilistic model for analysing species co-occurrence , 2013 .

[9]  Tuo Zhao,et al.  Sparse Inverse Covariance Estimation with Calibration , 2013, NIPS.

[10]  Po-Ling Loh,et al.  Structure estimation for discrete graphical models: Generalized covariance matrices and their inverses , 2012, NIPS.

[11]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[12]  Trevor J. Hastie,et al.  Learning Mixed Graphical Models , 2012, ArXiv.

[13]  Kevin G. Smith,et al.  Occupancy Is Nine-Tenths of the Law: Occupancy Rates Determine the Homogenizing and Differentiating Effects of Exotic Species , 2011, The American Naturalist.

[14]  Dirk Husmeier,et al.  Inferring species interaction networks from species abundance data: A comparative evaluation of various statistical and machine learning methods , 2010, Ecol. Informatics.

[15]  R. Muneepeerakul,et al.  Inferring plant ecosystem organization from species occurrences. , 2010, Journal of theoretical biology.

[16]  Werner Ulrich,et al.  The empirical Bayes approach as a tool to identify non-random species associations , 2010, Oecologia.

[17]  Mark W. Schmidt,et al.  Modeling Discrete Interventional Data using Directed Cyclic Graphical Models , 2009, UAI.

[18]  M. G. Pittau,et al.  A weakly informative default prior distribution for logistic and other regression models , 2008, 0901.4011.

[19]  R. Tibshirani,et al.  Sparse inverse covariance estimation with the graphical lasso. , 2008, Biostatistics.

[20]  A. Gelfand,et al.  Modelling species diversity through species level hierarchical modelling , 2005 .

[21]  Michael E. Gilpin,et al.  Factors contributing to non-randomness in species Co-occurrences on Islands , 2004, Oecologia.

[22]  J. Bruno,et al.  Inclusion of facilitation into ecological theory , 2003 .

[23]  Håkon Tjelmeland,et al.  Markov Random Fields with Higher‐order Interactions , 1998 .

[24]  B. Cipra An introduction to the Ising model , 1987 .

[25]  Daniel Simberloff,et al.  Ecological Communities: Conceptual Issues and the Evidence , 1984 .

[26]  Jonathan Roughgarden,et al.  Competition and Theory in Community Ecology , 1983, The American Naturalist.

[27]  R Lewin,et al.  Santa Rosalia Was a Goat: Ecologists have for two decades made assumptions about the importance of competition in community organization; that idea is now under vigorous attack. , 1983, Science.

[28]  D. Culver 6 Species Interactions and Community Structure , 1982 .

[29]  Thomas S. Whittam,et al.  Species Interactions and Community Structure in Alaskan Seabird Colonies , 1981 .

[30]  Stephen H. Levine,et al.  Competitive Interactions in Ecosystems , 1976, The American Naturalist.

[31]  Jared M. Diamond,et al.  THE ISLAND DILEMMA: LESSONS OF MODERN BIOGEOGRAPHIC STUDIES FOR THE DESIGN OF NATURAL RESERVES , 1975 .

[32]  T. E. Harris Contact Interactions on a Lattice , 1974 .

[33]  R. Macarthur,et al.  Population Ecology of Some Warblers of Northeastern Coniferous Forests , 1958 .

[34]  G. D,et al.  American Naturalist , 1867, Nature.