Preliminary Statistical Tests.

Applied researchers frequently precede analyses of interest with one or more preliminary tests, used to help researchers determine which variables to examine more closely, or whether there are anomalies in the data set. These texts can be classified into three categories: omnibus tests, tests for model fit, and exploratory tests. Fifty-four applied journal articles, 31 statistical textbooks, and the statistical literature are reviewed to discuss some limitations associated with uses of some preliminary tests. The focus is on the following topics: (1) the omnibus F-test in analysis of variance; (2) tests for variance equality; (3) tests for equality of regression slopes in analysis of covariance; and (4) tests for sphericity in repeated measures designs. In general, it is concluded that many preliminary statistical tests are not useful. In many contexts, omnibus tests do not answer questions of substantive interest. Preliminary analyses in tests for model fit are unnecessary because alternative less restrictive models can be used, and because many tests for violations of data assumptions lack adequate statistical power, or are overly sensitive to another assumption violation. More focused analyses are advocated, using less restrictive analytical models, and an increased use of exploratory analyses is recommended. One table illustrates the discussion. Lists of the journal articles and textbooks reviewed are appended. (Contains 43 references.) (SLD) *********************************************************************** Reproductions supplied by EDRS are the best that can be made * from the original document. * *********************************************************************** U.S. DEPARTMENT OF EDUCATION Othce of Eductionai Research and improvement EDUCATIONAL RESOURCES INFORMATION CENTER (ERIC) r/his docLment has been reproduced as received from the person or organization mgmMingit o Minor changes have been made to improve reproduction Quality Points of view or opimons stated m this (loco. ment do not necessarily represent official OE RI positron or policy "PERMISSION TO REPRODUCE THIS MATERIAL HAS BEEN GRANTED BY -57-6P41670 546 TO THE EDUCATIONAL RESOURCES INFORMATION CENTER (ERIC)." Preliminary Statistical Tests Stephen Olejnik Carl J Huberty University of Georgia Paper presented at the annual meeting of the American Educational Research Association, Atlanta, GA April 1993.

[1]  Jianmin Li.  Multiple Testing with Modified Bonferroni Methods. , 1992 .

[2]  L. Toothaker.  Multiple Comparisons for Researchers , 1991 .

[3]  W. Rogers,et al.  Verification of a Model of Test-Taking Behavior of High School Seniors , 1991 .

[4]  Clifton A. Casteel.  Answer Changing on Multiple-Choice Test Items among Eighth-Grade Readers. , 1991 .

[5]  F. J. A. Ranzijn.  The number of video examples and the dispersion of examples as instructional design variables in tea , 1991 .

[6]  B. Weiner,et al.  A Test of Dweck’s Model of Achievement Goals as Related to Perceptions of Ability , 1991 .

[7]  F. W. Wicker,et al.  Student Expectations About Affective Correlates of Academic Goal Setting , 1991 .

[8]  J. Tukey.  The Philosophy of Multiple Comparisons , 1991 .

[9]  G. Johnson.  Directional Biases in Children's Perception of Spatial Order , 1990 .

[10]  William Y. Lan,et al.  Academic Risk Taking, Development, and External Constraint , 1990 .

[11]  R. N. Marso,et al.  A Longitudinal Assessment of the Affective Impact of Preservice Training on Prospective Teachers , 1990 .

[12]  Terry A. Ackerman,et al.  Statistics for Behavioral Sciences , 1990 .

[13]  Joan Hart,et al.  Cognitive Mapping and Word Processing: Aids to Story Revision. , 1990 .

[14]  D. Saville.  Multiple Comparison Procedures: The Practical Solution , 1990 .

[15]  Meredith D. Gall,et al.  The Effects of Expository and Narrative Prose on Student Achievement and Attitudes Toward Textbooks , 1990 .

[16]  S. Peterson,et al.  Declarative, Conceptual, and Procedural Knowledge in the Understanding of Fractions and Acquisition of Ruler Measurement Skills , 1990 .

[17]  S. Erinosho.  The Effect of Two Remediation Methods in High School Physics Classes in Nigeria. , 1990 .

[18]  Robert B. Ruddell,et al.  A study of cognitive mapping as a means to improve summarization and comprehension of expository text , 1989 .

[19]  B. Feldman,et al.  Teachers’ Beliefs About Administrators and Parents of Handicapped and Nonhandicapped Students , 1989 .

[20]  Roberta D. Evans,et al.  Cognitive Mechanisms in Learning from Metaphors , 1989 .

[21]  Timothy V. Rasinski,et al.  Adult Readers’ Sensitivity to Phrase Boundaries in Texts , 1989 .

[22]  L. A. Marascuilo,et al.  Statistical Methods for the Social and Behavioral Sciences. , 1989 .

[23]  Harold J. Fletcher,et al.  Controlling Multiple F Test Errors with an Overall F Test , 1989 .

[24]  L. L. Johnson,et al.  Effects of Underlining Textbook Sentences on Passage and Sentence Retention. , 1988 .

[25]  Andrew C. Porter,et al.  Analysis of Covariance: Its Model and Use in Psychological Research. , 1987 .

[26]  R. R. Robey,et al.  Sphericity Tests and Repeated Measures Data. , 1987 .

[27]  Jay Blanchard,et al.  Underlining Performance Outcomes in Expository Text. , 1987 .

[28]  A. Hayter.  The Maximum Familywise Error Rate of Fisher's Least Significant Difference Test , 1986 .

[29]  Andrew F. Siegel,et al.  Modern data analysis , 1983 .

[30]  Donald F. Dansereau,et al.  Learning Strategies Training: Effects of Sequencing. , 1983 .

[31]  Esther Geva,et al.  Facilitating Reading Comprehension through Flowcharting. , 1983 .

[32]  R. Garner.  Efficient Text Summarization Costs and Benefits , 1982 .

[33]  C. Dunnett.  Pairwise Multiple Comparisons in the Unequal Variance Case , 1980 .

[34]  Scott E. Maxwell,et al.  Pairwise Multiple Comparisons in Repeated Measures Designs , 1980 .

[35]  J. H. Steiger.  Tests for comparing elements of a correlation matrix. , 1980 .

[36]  James D. Riley,et al.  An Analysis of Three Study Skills: Notetaking, Summarizing, and Rereading1 , 1979 .

[37]  Juliet Popper Shaffer,et al.  Comparison of Means: An F Test Followed by a Modified Multiple Range Procedure , 1979 .

[38]  S. Siegel,et al.  Nonparametric Statistics for the Behavioral Sciences , 2022, The SAGE Encyclopedia of Research Design.

[39]  S. Olejnik,et al.  Power of Pairwise Multiple Comparisons in the Unequal Variance Case. , 1994 .

[40]  Charles D. Johnson,et al.  Facilitating Reading Comprehension Through Spatial Skills Training , 1991 .

[41]  L. J. Stricker.  Fundamental Statistics for Behavioral Sciences (5th ed.). , 1991 .

[42]  P. Hastie,et al.  Effects of Class Size and Equipment Availability on Student Involvement in Physical Education , 1991 .

[43]  M. McMinn,et al.  Teaching Nonsexist Language to College Students , 1991 .

[44]  J. Das,et al.  Relation Between Memory Span, Naming Time, Speech Rate, and Reading Competence , 1991 .

[45]  Larry G. Daniel,et al.  Basic Statistical Analysis, 3rd Edition , 1990 .

[46]  R. W. Kulhavy,et al.  Spontaneous and Imposed Study Tactics in Learning Prose , 1990 .

[47]  T. Andre.  Type of Inserted Question and the Study-Posttest Delay. , 1990 .

[48]  C. Beal,et al.  Talking on Paper: Dialogue as a Writing Task for Sixth Graders. , 1990 .

[49]  E. Ghatala,et al.  Exploring Teachers' Knowledge of Strategic Study Activity. , 1990 .

[50]  Scott E. Maxwell,et al.  Designing Experiments and Analyzing Data: A Model Comparison Perspective , 1990 .

[51]  Tina Jacobowitz,et al.  AIM: A Metacognitive Strategy for Constructing the Main Idea of Text. , 1990 .

[52]  M. Simpson.  PORPE: A Research Validation. , 1989 .

[53]  Stephen Warwick Looney,et al.  Exploratory Repeated Measures Analysis for Two or More Groups: Review and Update , 1989 .

[54]  W. Hays.  Statistics, 4th ed. , 1988 .

[55]  L. Christensen,et al.  Introduction to Statistics for the Social and Behavioral Sciences , 1986 .

[56]  Roderick P. McDonald,et al.  Factor Analysis and Related Methods , 1985 .

[57]  Michael A. Martin.  STUDENTS' APPLICATIONS OF SELF‐QUESTIONING STUDY TECHNIQUES: AN INVESTIGATION OF THEIR EFFICACY , 1985 .