Addressing problems with traditional crime linking methods using receiver operating characteristic analysis

Purpose. Through an examination of serial rape data, the current article presents arguments supporting the use of receiver operating characteristic (ROC) analysis over traditional methods in addressing challenges that arise when attempting to link serial crimes. Primarily, these arguments centre on the fact that traditional linking methods do not take into account how linking accuracy will vary as a function of the threshold used for determining when two crimes are similar enough to be considered linked. Methods. Considered for analysis were 27 crime scene behaviours exhibited in 126 rapes, which were committed by 42 perpetrators. Similarity scores were derived for every possible crime pair in the sample. These measures of similarity were then subjected to ROC analysis in order to (1) determine threshold-independent measures of linking accuracy and (2) set appropriate decision thresholds for linking purposes. Results. By providing a measure of linking accuracy that is not biased by threshold placement, the analysis confirmed that it is possible to link crimes at a level that significantly exceeds chance (AUC = .75). The use of ROC analysis also allowed for the identification of decision thresholds that resulted in the desired balance between various linking outcomes (e.g. hits and false alarms). Conclusions. ROC analysis is exclusive in its ability to circumvent the limitations of threshold-specific results yielded from traditional approaches to linkage analysis. Moreover, results of the current analysis provide a basis for challenging common assumptions underlying the linking task.

[1]  Chris Brunsdon,et al.  Linking serious sexual assaults through behaviour , 2001 .

[2]  Ray Bull,et al.  The psychology of linking crimes: A review of the evidence , 2007 .

[3]  John A. Swets The science of choosing the right decision threshold in high-stakes diagnostics. , 1992 .

[4]  Edward J. Green,et al.  Cluster analysis of burglary M/Os. , 1976 .

[5]  C Bennell Behavioural consistency and discrimination in serial burglary. , 2002 .

[6]  John A. Swets,et al.  Signal Detection Theory and ROC Analysis in Psychology and Diagnostics: Collected Papers , 1996 .

[7]  Giles Oatley,et al.  Matching Crimes Using Burglars' Modus Operandi: A Test of Three Models , 2005 .

[8]  Craig Bennell,et al.  Between a ROC and a hard place: a method for linking serial burglaries by modus operandi , 2005 .

[9]  Craig Bennell,et al.  Differentiating sex offences: a behaviorally based thematic classification of stranger rapes. , 2003, Behavioral sciences & the law.

[10]  R. Dawes,et al.  Heuristics and Biases: Clinical versus Actuarial Judgment , 2002 .

[11]  Brent Snook,et al.  Unobtrusive measurement: using police information for forensic research , 2001 .

[12]  C. Gabrielle Salfati,et al.  The Nature of Expressiveness and Instrumentality in Homicide , 2000 .

[13]  C. Bennell Improving police decision making: general principles and practical applications of receiver operating characteristic analysis , 2005 .

[14]  D V Canter,et al.  Linking commercial burglaries by modus operandi: tests using regression and ROC analysis. , 2002, Science & justice : journal of the Forensic Science Society.

[15]  Pekka Santtila,et al.  Linking arson incidents on the basis of crime scene behavior , 2004 .

[16]  P. Meehl,et al.  Comparative efficiency of informal (subjective, impressionistic) and formal (mechanical, algorithmic) prediction procedures: The clinical–statistical controversy. , 1996 .

[17]  Jessica Woodhams,et al.  AN EMPIRICAL TEST OF THE ASSUMPTIONS OF CASE LINKAGE AND OFFENDER PROFILING WITH SERIAL COMMERCIAL ROBBERIES , 2007 .

[18]  L. Alison,et al.  Vicious circles: accounts of stranger sexual assault reflect abusive variants of conventional interactions , 2003 .

[19]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[20]  J A Swets,et al.  Measuring the accuracy of diagnostic systems. , 1988, Science.

[21]  David V. Canter,et al.  Sexual Offenses Against Children as the Abusive Exploitation of Conventional Adult-Child Relationships , 2001 .

[22]  Pekka Santtila,et al.  Behavioural linking of stranger rapes , 2005 .

[23]  C. Salfati,et al.  Serial homicide: an investigation of behavioural consistency , 2005 .

[24]  Walter Mischel,et al.  Toward an integrative science of the person. , 2004, Annual review of psychology.

[25]  J A Swets,et al.  Psychological Science Can Improve Diagnostic Decisions , 2000, Psychological science in the public interest : a journal of the American Psychological Society.

[26]  Helinä Häkkänen,et al.  EXPERTISE AND DECISION‐MAKING IN THE LINKING OF CAR CRIME SERIES , 2004 .

[27]  Tim Grant,et al.  From marine ecology to crime analysis: Improving the detection of serial sexual offences using a taxonomic similarity measure , 2007 .

[28]  Alasdair M. Goodwill,et al.  The development of a filter model for prioritising suspects in burglary offences , 2006 .