On the Science of Rorschach Research

I describe problems in an article by Wood, Nezworski, Stejskal, Garven, and West (1999b). These include (a) claims that researchers found or said things they did not, (b) an assertion that my data did not support the incremental validity of the Rorschach over the MMPI-2 when the opposite was true, (c) complications with their recommended incremental validity procedures, (d) unwarranted criticism of Burns and Viglione's (1996) statistical analyses, (e) oversimplifying issues associated with extreme groups research, (f) misleading criticisms of composite measures, and (g) faulty criticisms of Burns and Viglione's composite scale that overlooked relevant evidence. Wood et al. also asserted that Burns and Viglione's primary Rorschach variable was faulty and created a formula that seemed to show how Burns and Viglione's scores were "incompatible" and "not ... even very close" to those obtained from the proper formula. These criticisms were made even though Wood et al. had been told that their formula was incorrect and shown that it was almost perfectly correlated with the proper formula in 8 large samples (rs > .998). Sound criticism of Rorschach research will advance science and practice, but the Wood et al. article did not provide sufficient guidance.

[1]  G. Meyer.  Incremental Validity of the Rorschach Prognostic Rating Scale Over the MMPI Ego Strength Scale and IQ , 2000, Journal of personality assessment.

[2]  P. Bossuyt,et al.  Empirical evidence of design-related bias in studies of diagnostic tests. , 1999, JAMA.

[3]  G. Meyer,et al.  Introduction to the final special section in the special series on the utility of the Rorschach for clinical assessment. , 2001, Psychological assessment.

[4]  D. Viglione.  A review of recent research addressing the utility of the Rorschach. , 1999 .

[5]  J. Hunsley,et al.  The clinical utility of the Rorschach: Unfulfilled promises and an uncertain future , 1999 .

[6]  Leland Wilkinson,et al.  Statistical Methods in Psychology Journals Guidelines and Explanations , 2005 .

[7]  S. West,et al.  Methodological Issues in Evaluating Rorschach Validity: A Comment on Burns and Viglion (1996), Weiner (1996), and Ganellen (1996) , 1999, Assessment.

[8]  T. Little,et al.  On selecting indicators for multivariate measurement and modeling with latent variables: When "good" indicators are bad and "bad" indicators are good. , 1999 .

[9]  G. Meyer.  Simple Procedures to Estimate Chance Agreement and Kappa for the Interrater Reliability of Response Segments Using the Rorschach Comprehensive System , 1999 .

[10]  Y. Ben-Porath,et al.  Incremental Validity of the MMPI-2 Content Scales in an Outpatient Mental Health Setting , 1999 .

[11]  G. Meyer,et al.  The convergent validity of MMPI and Rorschach scales: an extension using profile scores to define response and character styles on both methods and a reexamination of simple Rorschach response frequency. , 1999, Journal of personality assessment.

[12]  J. M. Cortina,et al.  Determining relative importance of predictors with the observational design. , 1998 .

[13]  A. Khadivi,et al.  The Use of the MMPI-2 for the Assessment of Depressive and Psychotic Disorders , 1998, Assessment.

[14]  R. L. Greene,et al.  Effects of psychopathology and demographic characteristics on MMPI-2 scale scores. , 1998, Journal of personality assessment.

[15]  Sampo V. Paunonen,et al.  Hierarchical Organization of Personality and Prediction of Behavior , 1998 .

[16]  J. Mccann.  Defending the Rorschach in Court: An Analysis of Admissibility Using Legal and Professional Standards , 1998 .

[17]  R. Archer,et al.  MMPI-A and Rorschach indices related to depression and conduct disorder: an evaluation of the incremental validity hypothesis. , 1997, Journal of personality assessment.

[18]  P. H. Munley,et al.  MMPI-2 findings in Schizophrenia and depression , 1997 .

[19]  J. M. Wood,et al.  The reliability of the comprehensive system for the Rorschach: A comment on Meyer (1997) , 1997 .

[20]  G. Meyer,et al.  The ability of the Rorschach to predict subsequent outcome : A meta-analysis of the Rorschach Prognostic Rating Scale , 1997 .

[21]  R. Archer,et al.  The Incremental Validity of MMPI-2 Supplementary Scales , 1997 .

[22]  M. Hilsenroth,et al.  Narcissism in the Rorschach Revisited: Some Reflections on Empirical Data , 1997 .

[23]  G. Meyer.  On the integration of personality assessment methods: the Rorschach and MMPI. , 1997, Journal of personality assessment.

[24]  Patrick E. Shrout,et al.  Should Significance Tests be Banned? Introduction to a Special Section Exploring the Pros and Cons , 1997 .

[25]  R. Ganellen.  Integrating the Rorschach and MMPI-2: Adding Apples and Oranges?: Introduction , 1996 .

[26]  R. Gorsuch,et al.  Effects of under- and overextraction on principal axis factor analysis with varimax rotation. , 1996 .

[27]  G. Meyer.  Construct validation of scales derived from the Rorschach method: a review of issues and introduction to the Rorschach rating scale. , 1996, Journal of personality assessment.

[28]  R. Archer.  MMPI-Rorschach interrelationships: proposed criteria for evaluating explanatory models. , 1996, Journal of personality assessment.

[29]  R. Ganellen,et al.  Comparing the diagnostic efficiency of the MMPI, MCMI-II, and Rorschach: a review. , 1996, Journal of personality assessment.

[30]  A. Tellegen,et al.  Evaluating the similarity of MMPI-2 and MMPI profiles: reply to Dahlstrom and Humphrey. , 1996, Journal of personality assessment.

[31]  Dahlstrom Wg,et al.  Comparability of MMPI and MMPI-2 profile patterns: Ben-Porath and Tellegen's inappropriate invocation of Mahalanobis's D2 function. , 1996 .

[32]  D. Viglione,et al.  The Rorschach Human Experience Variable, interpersonal relatedness, and object representation in nonpatients. , 1996 .

[33]  R. Archer,et al.  Incremental Validity of the MMPI-2 Content Scales in a Psychiatric Sample , 1996 .

[34]  M. Nezworski,et al.  The Comprehensive System for the Rorschach: A Critical Examination , 1996 .

[35]  J. M. Wood,et al.  Thinking Critically About the Comprehensive System for the Rorschach: A Reply to Exner , 1996 .

[36]  D. Watson,et al.  Constructing validity: Basic issues in objective scale development , 1995 .

[37]  J. M. Wood,et al.  Narcissism in the Comprehensive System for the Rorschach , 1995 .

[38]  Y. Ben-Porath,et al.  The Personality Psychopathology Five (PSY-5): Constructs and MMPI-2 Scales. , 1995 .

[39]  Jacob Cohen.  The earth is round (p < .05) , 1994 .

[40]  R. V. Rogers,et al.  Improving computational efficiency in autonomous agent, asynchronous discrete-event simulation , 1994, Proceedings of IEEE International Conference on Systems, Man and Cybernetics.

[41]  R. Salekin,et al.  A Meta-Analysis of Malingering on the MMPI-2 , 1994 .

[42]  W P Whitely,et al.  The scientific community's response to evidence of fraudulent publication. The Robert Slutsky case. , 1994, JAMA.

[43]  Y. Ben-Porath,et al.  Incremental validity of the MMPI-2 Content Scales in the assessment of personality and psychopathology by self-report. , 1993, Journal of personality assessment.

[44]  J. Koehler.  The Influence of Prior Beliefs on Scientific Judgments of Evidence Quality , 1993 .

[45]  Gwenn W. Gröndal,et al.  Meta-analytic procedures for social research , 1993 .

[46]  G. Meyer,et al.  The impact of response frequency on the Rorschach constellation indices and on their validity with diagnostic and MMPI-2 criteria. , 1993, Journal of personality assessment.

[47]  A. Tellegen,et al.  The new uniform T scores for the MMPI-2 : rationale, derivation, and appraisal , 1992 .

[48]  P. Costa,et al.  Normal Personality Assessment in Clinical Practice: The NEO Personality Inventory. , 1992 .

[49]  Niels G. Waller,et al.  "Normal" Personality Inventories in Clinical Assessment: General Requirements and the Potential for Using the NEO Personality Inventory , 1992 .

[50]  J. D. Ball,et al.  Rorschach Depression indices with children and adolescents: concurrent validity findings. , 1991, Journal of personality assessment.

[51]  Y. Ben-Porath,et al.  Contribution of the MMPI-2 content scales to the differential diagnosis of schizophrenia and major depression , 1991 .

[52]  D. Hosmer,et al.  Applied Logistic Regression , 1991 .

[53]  W. Perry,et al.  The Ego Impairment Index as a predictor of outcome in melancholic depressed patients treated with tricyclic antidepressants. , 1991, Journal of personality assessment.

[54]  Dusan Hadzi-Pavlovic,et al.  The psychometric differentiation of dementia from normal aging: A meta-analysis. , 1991 .

[55]  J. Persons.  The advantages of studying psychological phenomena rather than psychiatric diagnoses. , 1986, The American psychologist.

[56]  S Epstein,et al.  Does aggregation produce spuriously high estimates of behavior stability? , 1986, Journal of personality and social psychology.

[57]  Donald B. Rubin,et al.  Meta-Analytic Procedures for Combining Studies With Multiple Effect Sizes , 1986 .

[58]  Seymour Epstein,et al.  Aggregation and beyond: Some basic issues on the prediction of behavior. , 1983, Journal of personality.

[59]  J. P. Rushton,et al.  Behavioral Development and Construct Validity: The Principle of Aggregation , 1983 .

[60]  Jacob Cohen,et al.  Applied multiple regression/correlation analysis for the behavioral sciences , 1979 .

[61]  L. Ross,et al.  Biased Assimilation and Attitude Polarization: The Effects of Prior Theories on Subsequently Considered Evidence , 1979 .

[62]  Daryl J. Bem,et al.  Template matching: A proposal for probing the ecological validity of experimental settings in social psychology. , 1979 .

[63]  J..  Thinking Clearly About Reliability: More Critical Corrections Regarding the Rorschach Comprehensive System , 2001 .

[64]  G. Meyer.  Assessing Reliability : Critical Corrections for a Critical Examination of the Rorschach Comprehensive System , 2001 .

[65]  I. Weiner.  Some observations on the validity of the Rorschach Inkblot method , 1996 .

[66]  W. Dahlstrom,et al.  Comparability of MMPI and MMPI-2 profile patterns: Ben-Porath and Tellegen's inappropriate invocation of Mahalanobis's D2 function. , 1996, Journal of personality assessment.

[67]  R. Baer,et al.  Detection of underreporting of psychopathology on the MMPI: A meta-analysis , 1992 .

[68]  Y. Ben-Porath,et al.  "Normal" Personality Inventories in Clinical Assessment , 1992 .

[69]  M. J. Harris,et al.  Detection of malingering on the MMPI: A meta-analysis , 1991 .

[70]  D. Berger,et al.  Averaging Multiple Judges to Improve Validity: Aid to Planning Cost-Effective Clinical Research , 1990 .

[71]  R. Archer,et al.  MMPI and Rorschach indices of schizophrenic and depressive diagnoses among adolescent inpatients. , 1988, Journal of personality assessment.

[72]  R. Rosenthal.  Meta-analytic procedures for social research , 1984 .

[73]  R. L. Greene.  The MMPI-2/MMPI: An Interpretive Manual , 1980 .

[74]  G. Sivanich,et al.  Psychological assessment. , 1965, Progress in neurology and psychiatry.