Kullback-Leibler information as a basis for strong inference in ecological studies

We describe an information-theoretic paradigm for analysis of ecological data, based on Kullback–Leibler information, that is an extension of likelihood theory and avoids the pitfalls of null hypothesis testing. Information-theoretic approaches emphasise a deliberate focus on the a priori science in developing a set of multiple working hypotheses or models. Simple methods then allow these hypotheses (models) to be ranked from best to worst and scaled to reflect a strength of evidence using the likelihood of each model (gi), given the data and the models in the set (i.e. L(gi | data)). In addition, a variance component due to model-selection uncertainty is included in estimates of precision. There are many cases where formal inference can be based on all the models in the a priori set and this multi-model inference represents a powerful, new approach to valid inference. Finally, we strongly recommend inferences based on a priori considerations be carefully separated from those resulting from some form of data dredging. An example is given for questions related to age- and sex-dependent rates of tag loss in elephant seals (Mirounga leonina).

[1]  David R. Anderson,et al.  Model selection and multimodel inference : a practical information-theoretic approach , 2003 .

[2]  Malcolm R. Forster,et al.  Simplicity, Inference and Modelling: The new science of simplicity , 2002 .

[3]  Kenneth P. Burnham,et al.  ADVANCED FEATURES OF PROGRAM MARK , 2002 .

[4]  David R. Anderson,et al.  Kullback-Leibler information in resolving natural resource conflicts when definitive data exist , 2001 .

[5]  David R. Anderson,et al.  Null Hypothesis Testing: Problems, Prevalence, and an Alternative , 2000 .

[6]  M. Bester,et al.  Evaluation of age- and sex-dependent rates of tag loss in southern elephant seals , 2000 .

[7]  Zucchini,et al.  An Introduction to Model Selection. , 2000, Journal of mathematical psychology.

[8]  M. Forster,et al.  Key Concepts in Model Selection: Performance and Generalizability. , 2000, Journal of mathematical psychology.

[9]  David R. Anderson,et al.  Model Selection and Inference: A Practical Information-Theoretic Approach , 2001 .

[10]  Adrian E. Raftery,et al.  Bayesian model averaging: a tutorial (with comments by M. Clyde, David Draper and E. I. George, and a rejoinder by the authors , 1999 .

[11]  Douglas H. Johnson The Insignificance of Statistical Significance Testing , 1999 .

[12]  Stefan Letott,et al.  Statistical Inference Based on the Likelihood , 1999, Technometrics.

[13]  David R. Anderson,et al.  A protocol for conflict resolution in analyzing empirical data related to natural resource controversies , 1999 .

[14]  David R. Anderson,et al.  General strategies for the analysis of ringing data , 1999 .

[15]  V. Vieland,et al.  Statistical Evidence: A Likelihood Paradigm , 1998 .

[16]  A. McQuarrie,et al.  Regression and Time Series Model Selection , 1998 .

[17]  Genshiro Kitagawa,et al.  Selected papers of Hirotugu Akaike , 1998 .

[18]  Steve Cherry,et al.  STATISTICAL TESTS IN PUBLICATIONS OF THE WILDLIFE SOCIETY , 1998 .

[19]  K. Burnham,et al.  Model selection: An integral part of inference , 1997 .

[20]  Huaiyu Zhu On Information and Sufficiency , 1997 .

[21]  Marks R. Nester,et al.  An Applied Statistician's Creed , 1996 .

[22]  Aaron M. Ellison,et al.  AN INTRODUCTION TO BAYESIAN INFERENCE FOR ECOLOGICAL RESEARCH AND ENVIRONMENTAL , 1996 .

[23]  Brian Dennis,et al.  Discussion: Should Ecologists Become Bayesians? , 1996 .

[24]  Malcolm R. Forster,et al.  Bayes and Bust: Simplicity as a Problem for a Probabilist's Approach to Confirmation1 , 1995, The British Journal for the Philosophy of Science.

[25]  Clifford M. Hurvich,et al.  Model selection for extended quasi-likelihood models in small samples. , 1995, Biometrics.

[26]  Malcolm R. Forster,et al.  How to Tell When Simpler, More Unified, or Less Ad Hoc Theories will Provide More Accurate Predictions , 1994, The British Journal for the Philosophy of Science.

[27]  Henry F. Inman Karl Pearson and R. A. Fisher on Statistical Tests: A 1935 Exchange from Nature , 1994 .

[28]  Hirotugu Akaike,et al.  Implications of Informational Point of View on the Development of Statistical Science , 1994 .

[29]  David R. Anderson,et al.  Distance Sampling: Estimating Abundance of Biological Populations , 1995 .

[30]  L. Breiman The Little Bootstrap and other Methods for Dimensionality Selection in Regression: X-Fixed Prediction Error , 1992 .

[31]  J. Deleeuw,et al.  Introduction to Akaike (1973) Information Theory and an Extension of the Maximum Likelihood Principle , 1992 .

[32]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[33]  Clifford M. Hurvich,et al.  Regression and time series model selection in small samples , 1989 .

[34]  David R. Anderson,et al.  Design and Analysis Methods for Fish Survival Experiments Based on Release-Recapture. , 1988 .

[35]  J. Berger Statistical Decision Theory and Bayesian Analysis , 1988 .

[36]  H. Akaike Prediction and Entropy , 1985 .

[37]  Hirotugu Akaike,et al.  Statistical Inference and Measurement of Entropy , 1983 .

[38]  H. Akaike Likelihood of a model and information criteria , 1981 .

[39]  H. Charles Romesburg,et al.  WILDLIFE SCIENCE: GAINING RELIABLE KNOWLEDGE , 1981 .

[40]  M. Stone An Asymptotic Equivalence of Choice of Model by Cross‐Validation and Akaike's Criterion , 1977 .

[41]  Hirotugu Akaike,et al.  On entropy maximization principle , 1977 .

[42]  M. Stone,et al.  Cross‐Validatory Choice and Assessment of Statistical Predictions , 1976 .

[43]  R. W. Wedderburn Quasi-likelihood functions, generalized linear models, and the Gauss-Newton method , 1974 .

[44]  H. Akaike A new look at the statistical model identification , 1974 .

[45]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[46]  T. C. Chamberlin The Method of Multiple Working Hypotheses: With this method the dangers of parental affection for a favorite theory can be circumvented. , 1965, Science.

[47]  E. Jaynes Information Theory and Statistical Mechanics , 1957 .

[48]  T. C. Chamberlin The Method of Multiple Working Hypotheses , 1931, The Journal of Geology.