On comparing a single case with a control sample: An alternative perspective

Corballis [Corballis, M. C. (2009). Comparing a single case with a control sample: Refinements and extensions. Neuropsychologia] offers an interesting position paper on statistical inference in single-case studies. The following points arise: (1) Testing whether we can reject the null hypothesis that a patient's score is an observation from the population of control scores can be a legitimate aim for single-case researchers, not just clinicians. (2) Counter to the claim made by Corballis [Corballis, M. C. (2009). Comparing a single case with a control sample: Refinements and extensions. Neuropsychologia], Crawford and Howell's [Crawford, J. R., & Howell, D. C. (1998). Comparing an individual's test score against norms derived from small samples. The Clinical Neuropsychologist, 12, 482-486] method does test whether we can reject the above null hypothesis. (3) In all but the most unusual of circumstances Crawford and Howell's method can also safely be used to test whether the mean of a notional patient population is lower than that of a control population, should neuropsychologists wish to construe the test in this way. (4) In contrast, the method proposed by Corballis is not legitimate for either of these purposes because it fails to allow for uncertainty over the control mean (as a result Type I errors will not be under control). (5) The use of a mixed ANOVA design to compare a case to controls (with or without the adjustment proposed by Corballis) is beset with problems but these can be overcome using alternative methods.

[1]  E. Capitani,et al.  How can we evaluate interference in attentional tests? A study based on bi-variate non-parametric tolerance limits. , 1999, Journal of Clinical and Experimental Neuropsychology.

[2]  A. Caramazza.  On drawing inferences about the structure of normal cognitive systems from the analysis of patterns of impaired performance: The case for single-patient studies , 1986, Brain and Cognition.

[3]  P. Garthwaite,et al.  Investigation of the single case in neuropsychology: confidence limits on the abnormality of test scores and test score differences , 2002, Neuropsychologia.

[4]  A. Caramazza,et al.  The case for single-patient studies , 1988 .

[5]  P. Garthwaite,et al.  On the “Optimal” Size for Normative Samples in Neuropsychology: Capturing the Uncertainty When Normative Data Are Used to Quantify the Standing of a Neuropsychological Test Score , 2008, Child neuropsychology : a journal on normal and abnormal development in childhood and adolescence.

[6]  Janice Kay,et al.  An evaluation of statistical procedures for comparing an individual's performance with that of a group of controls , 2002, Cognitive neuropsychology.

[7]  Paul H. Garthwaite,et al.  Methods of testing for a deficit in single-case studies: Evaluation of statistical power by Monte Carlo simulation , 2006, Cognitive neuropsychology.

[8]  Paul H Garthwaite,et al.  Comparison of a single case to a control or normative sample in neuropsychology: Development of a Bayesian approach , 2007, Cognitive neuropsychology.

[9]  M. Coltheart.  Assumptions and methods in cognitive neuropsychology. , 2001 .

[10]  P. Garthwaite,et al.  The distribution of the difference between two t-variates and application to a test for dissociations , 2004 .

[11]  Jordan Grafman,et al.  Handbook of Neuropsychology , 1991 .

[12]  Michael McCloskey,et al.  Theory and evidence in cognitive neuropsychology: A "radical" response to Robertson, Knight, Rafal, and Shimamura (1993). , 1993 .

[13]  M. Corballis.  Comparing a single case with a control sample: Refinements and extensions , 2009, Neuropsychologia.

[14]  D. C. Howell,et al.  Comparing an Individual's Test Score Against Norms Derived from Small Samples , 1998 .

[15]  Paul H. Garthwaite,et al.  Wanted: Fully Operational Definitions of Dissociations in Single-Case Studies , 2003, Cortex.

[16]  Richard J. Brown.  Neuropsychology Mental Structure , 1989 .

[17]  Ana J. Bridges,et al.  How Many is Enough? Determining Optimal Sample Sizes for Normative Studies in Pediatric Neuropsychology , 2007, Child neuropsychology : a journal on normal and abnormal development in childhood and adolescence.

[18]  P. Garthwaite,et al.  Inferential methods for comparing a single case with a control sample: modified t‐tests versus mycroft et al.'s (2002) modified anova , 2004, Cognitive neuropsychology.

[19]  Paul H Garthwaite,et al.  Testing for suspected impairments and dissociations in single-case studies in neuropsychology: evaluation of alternatives using monte carlo simulations and revised tests for dissociations. , 2005, Neuropsychology.