Invited review: Integrating quantitative findings from multiple studies using mixed model methodology.

In animal agriculture, the need to understand complex biological, environmental, and management relationships is increasing. In addition, as knowledge increases and profit margins shrink, our ability and desire to predict responses to various management decisions also increases. Therefore, the purpose of this review is to help show how improved mathematical and statistical tools and computer technology can help us gain more accurate information from published studies and improve future research. Researchers, in several recent reviews, have gathered data from multiple published studies and attempted to formulate a quantitative model that best explains the observations. In statistics, this process has been labeled meta-analysis. Generally, there are large differences between studies: e. g., different physiological status of the experimental units, different experimental design, different measurement methods, and laboratory technicians. From a statistical standpoint, studies are blocks and their effects must be considered random because the inference being sought is to future, unknown studies. Meta-analyses in the animal sciences have generally ignored the Study effect. Because data gathered across studies are unbalanced with respect to predictor variables, ignoring the Study effect has as a consequence that the estimation of parameters (slopes and intercept) of regression models can be severely biased. Additionally, variance estimates are biased upward, resulting in large type II errors when testing the effect of independent variables. Historically, the Study effect has been considered a fixed effect not because of a strong argument that such effect is indeed fixed but because of our prior inability to efficiently solve even modest-sized mixed models (those containing both fixed and random effects). Modern statistical software has, however, overcome this limitation. Consequently, meta-analyses should now incorporate the Study effect and its interaction effects as random components of a mixed model. This would result in better prediction equations of biological systems and a more accurate description of their prediction errors.

[1]  R. Bechhofer A Single-Sample Multiple Decision Procedure for Ranking Means of Normal Populations with known Variances , 1954 .

[2]  B. Bushman,et al.  Effects of alcohol on human aggression: an integrative research review. , 1990, Psychological bulletin.

[3]  Norman R. Draper,et al.  Applied regression analysis (2. ed.) , 1981, Wiley series in probability and mathematical statistics.

[4]  N. Draper,et al.  Applied Regression Analysis , 1966 .

[5]  N. St-Pierre,et al.  Modeling ruminal digestibility of carbohydrates and microbial protein flow to the duodenum. , 1998, Journal of dairy science.

[6]  Robert Rosenthal WRITING META-ANALYTIC REVIEWS , 1995 .

[7]  Larry V. Hedges,et al.  Testing the Null Hypothesis in Meta-Analysis: A Comparison of Combined Probability and Confidence Interval Procedures , 1992 .

[8]  G. S. Fishman Principles of Discrete Event Simulation , 1978 .

[9]  G. Broderick,et al.  A statistical evaluation of animal and nutritional factors influencing concentrations of milk urea nitrogen. , 1997, Journal of dairy science.

[10]  G. W. Snedecor Statistical Methods , 1964 .

[11]  L. Hedges,et al.  Statistical Methods for Meta-Analysis , 1987 .

[12]  N. St-Pierre,et al.  Estimation of microbial nitrogen flow to the duodenum of cattle based on dry matter intake and diet composition. , 1999, Journal of dairy science.

[13]  R. Littell SAS System for Mixed Models , 1996 .

[14]  J. Russell,et al.  Protein and Energy as an Integrated System. Relationship of Ruminal Protein and Carbohydrate Availability to Microbial Synthesis and Milk Production , 1988 .

[15]  N R St-Pierre,et al.  Interpretation and design of nonregulatory on-farm feeding trials. , 1999, Journal of animal science.

[16]  G. Glass Primary, Secondary, and Meta-Analysis of Research1 , 1976 .

[17]  N. St-Pierre,et al.  Effects of grain variability and processing on starch utilization by lactating dairy cattle , 2001 .

[18]  Robert L. Bangert-Drowns,et al.  Review of developments in meta-analytic method. , 1986 .