Graphical methods for multivariate linear models in psychological research: An R tutorial

This paper is designed as a tutorial to highlight some recent developments for visualizing the relationships among response and predictor variables in multivariate linear models (MLMs), and implemented in convenient packages for R. These models include multivariate multiple regression analysis (MMRA), multivariate analysis of variance (MANOVA) and multivariate analysis of covariance (MANCOVA). The methods we describe go well beyond what can be understood and explained from simple univariate graphical methods for the separate response variables. We describe extensions of these methods for the case of more than just a few response variables, where the important relationships can be readily seen in the low-dimensional (2D) space that accounts for most of the relevant information. As befits the tutorial nature of this paper, we analyze some sample psychological research studies utilizing these multivariate designs, showing examples in R. In the process, we also take up several practical problems related to the assumptions of MLMs, and how these can be dealt with using graphical methods. Finally, we provide guidelines to aid researchers in conducting multivariate research, pertaining to the analysis, visualization, and reporting of such designs. The graphical and statistical methods described here are all freely available and implemented in the R packages candisc, car, heplots, andmvinfluence.

[1]  R. Heinrichs,et al.  The continuing story of schizophrenia and schizoaffective disorder: One condition or two? , 2019, Schizophrenia Research: Cognition.

[2]  R. Heinrichs,et al.  Neurocognitive normality in schizophrenia revisited , 2015, Schizophrenia Research: Cognition.

[3]  Glenn Gamst,et al.  Applied Multivariate Research: Design and Interpretation , 2005 .

[4]  G. Box,et al.  A general distribution theory for a class of likelihood criteria. , 1949, Biometrika.

[5]  M. Healy,et al.  Multivariate Normal Plotting , 1968 .

[6]  Ashley A. Miles,et al.  Are schizophrenia and schizoaffective disorder neuropsychologically distinguishable? , 2008, Schizophrenia Research.

[7]  Daniel J. Denis,et al.  The early origins and development of the scatterplot. , 2005, Journal of the history of the behavioral sciences.

[8]  J. Fox,et al.  Elliptical Insights: Understanding Statistical Methods through Elliptical Geometry , 2013, 1302.4881.

[9]  M. Friendly,et al.  Recent Advances in Visualizing Multivariate Linear Models , 2014 .

[10]  Peter J. Rousseeuw,et al.  Robust Regression and Outlier Detection , 2005, Wiley Series in Probability and Statistics.

[11]  J. Fox.  Effect Displays in R for Generalised Linear Models , 2003 .

[12]  Michael F. Green,et al.  The MATRICS Consensus Cognitive Battery, part 1: test selection, reliability, and validity. , 2008, The American journal of psychiatry.

[13]  Katrien van Driessen,et al.  A Fast Algorithm for the Minimum Covariance Determinant Estimator , 1999, Technometrics.

[14]  David J. Hand,et al.  Multivariate Analysis Of Variance And Repeated Measures , 1987 .

[15]  Andrew Gelman,et al.  Let's Practice What We Preach , 2002 .

[16]  K. Mardia.  Measures of multivariate skewness and kurtosis with applications , 1970 .

[17]  N. H. Timm.  2 Multivariate analysis of variance of repeated measurements , 1980 .

[18]  J. Fox,et al.  Visualizing Generalized Canonical Discriminant and CanonicalCorrelation Analysis , 2015 .

[19]  Sanford Weisberg,et al.  An R Companion to Applied Regression , 2010 .

[20]  A. Zeileis,et al.  Discrete Data Analysis with R: Visualization and Modeling Techniques for Categorical and Count Data , 2015 .

[21]  G. Duncan,et al.  Multivariate Analysis: With Applications in Education and Psychology. , 1977 .

[22]  William M. Shyu,et al.  Local Regression Models , 2017 .

[23]  M K Kaiser,et al.  MANOVA method for analyzing repeated measures designs: an extensive primer. , 1985, Psychological bulletin.

[24]  Michael Friendly,et al.  HE Plots for Repeated Measures Designs , 2010 .

[25]  Michael Friendly,et al.  HE Plots for Multivariate Linear Models , 2007 .

[26]  Jason Wittenberg,et al.  Clarify: Software for Interpreting and Presenting Statistical Results , 2003 .

[27]  Michael Friendly,et al.  Visualizing Hypothesis Tests in Multivariate Linear Models , 2015 .

[28]  Leland Wilkinson,et al.  TRANSMUTING' WOMEN INTO MEN: GALTON'S FAMILY DATA ON HUMAN STATURE , 2005 .

[29]  H. Levene.  Robust tests for equality of variances , 1961 .

[30]  Morton B. Brown,et al.  Robust Tests for the Equality of Variances , 1974 .

[31]  D. Cox,et al.  Notes on Some Aspects of Regression Analysis , 1968 .