Decision support in psychiatry – a comparison between the diagnostic outcomes using a computerized decision support system versus manual diagnosis

BackgroundCorrect diagnosis in psychiatry may be improved by novel diagnostic procedures. Computerized Decision Support Systems (CDSS) are suggested to be able to improve diagnostic procedures, but some studies indicate possible problems. Therefore, it could be important to investigate CDSS systems with regard to their feasibility to improve diagnostic procedures as well as to save time.MethodsThis study was undertaken to compare the traditional 'paper and pencil' diagnostic method SCID1 with the computer-aided diagnostic system CB-SCID1 to ascertain processing time and accuracy of diagnoses suggested. 63 clinicians volunteered to participate in the study and to solve two paper-based cases using either a CDSS or manually.ResultsNo major difference between paper and pencil and computer-supported diagnosis was found. Where a difference was found it was in favour of paper and pencil. For example, a significantly shorter time was found for paper and pencil for the difficult case, as compared to computer support. A significantly higher number of correct diagnoses were found in the diffilt case for the diagnosis 'Depression' using the paper and pencil method. Although a majority of the clinicians found the computer method supportive and easy to use, it took a longer time and yielded fewer correct diagnoses than with paper and pencil.ConclusionThis study could not detect any major difference in diagnostic outcome between traditional paper and pencil methods and computer support for psychiatric diagnosis.Where there were significant differences, traditional paper and pencil methods were better than the tested CDSS and thus we conclude that CDSS for diagnostic procedures may interfere with diagnosis accuracy. A limitation was that most clinicians had not previously used the CDSS system under study. The results of this study, however, confirm that CDSS development for diagnostic purposes in psychiatry has much to deal with before it can be used for routine clinical purposes.

[1]  P. Miller,et al.  Inpatient diagnostic assessments: 1. Accuracy of structured vs. unstructured interviews , 2001, Psychiatry Research.

[2]  Kathleen L. Mosier,et al.  Accountability and automation bias , 2000, Int. J. Hum. Comput. Stud..

[3]  G S Duckworth,et al.  Man or machine in psychiatric diagnosis. , 1978, The American journal of psychiatry.

[4]  R. Spitzer,et al.  Psychiatric diagnosis: are clinicians still necessary? , 1983, Comprehensive psychiatry.

[5]  Kathleen L. Mosier,et al.  Does automation bias decision-making? , 1999, Int. J. Hum. Comput. Stud..

[6]  Lars Bergman,et al.  Computer-aided DSM-IV-diagnostics – acceptance, use and perceived usefulness in relation to users' learning styles , 2005, BMC Medical Informatics Decis. Mak..

[7]  M. First,et al.  Structured clinical interview for DSM-IV axis I disorders : SCID-I: clinical version : administration booklet , 1996 .

[8]  A. Korten,et al.  Computerised diagnosis in acute psychiatry: validity of CIDI-Auto against routine clinical diagnosis. , 1997, Journal of psychiatric research.

[9]  Duckworth Gs,et al.  Man or machine in psychiatric diagnosis. , 1978 .

[10]  T. Brugha,et al.  SCAN. Schedules for Clinical Assessment in Neuropsychiatry. , 1990, Archives of general psychiatry.

[11]  H. Mcdonald,et al.  Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. , 2005, JAMA.

[12]  G Murray,et al.  A Comparison of the Composite International Diagnostic Interview (CIDI-Auto) with Clinical Assessment in Diagnosing Mood and Anxiety Disorders , 2001, The Australian and New Zealand journal of psychiatry.

[13]  R. Spitzer.  Dsm-IV Casebook: A Learning Companion to the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition , 1994 .

[14]  J. Endicott,et al.  DIAGNO. A computer program for psychiatric diagnosis utilizing the differential diagnostic procedure. , 1968, Archives of general psychiatry.