Radiology order decision support: examination-indication appropriateness assessed using 2 electronic systems.

PURPOSE The goal of the study was to determine the effects of guideline implementation strategy using 2 commercial radiology clinical decision support (CDS) systems. METHODS The appropriateness and insurance dispositions of MRI and CT orders were evaluated using the Medicalis SmartReq and Nuance RadPort CDS systems during 2 different 3-month periods. Logistic regression was used to compare these outcomes between the 2 systems, after adjusting for patient-mix differences. RESULTS Approximately 2,000 consecutive outpatient MRI and CT orders were evaluated over 2 periods of 3 months each. Medicalis scored 60% of exams as "indeterminate" (insufficient information) or "not validated" (no guidelines). Excluding these cases, Nuance scored significantly more exams as appropriate than did Medicalis (80% versus 51%, P < .001) and predicted insurance outcome significantly more often (76% versus 58%, P < .001). Only when the Medicalis "indeterminate" and "not validated" categories were combined with the high- or moderate-utility categories did the 2 CDS systems have similar performance. Overall, 19% of examinations with low-utility ratings were reimbursed. Conversely, 0.8% of examinations with high- or moderate-utility ratings were denied reimbursement. CONCLUSIONS The chief difference between the 2 CDS systems, and the strongest influence on outcomes, was how exams without relevant guidelines or with insufficient information were handled. Nuance augmented published guidelines with clinical best practice; Medicalis requested additional information utilizing pop-up windows. Thus, guideline implementation choices contributed to decision making and outcomes. User interface, specifically, the number of screens and completeness of indication choices, controlled CDS interactions and, coupled with guidance implementation, influenced willingness to use the CDS system.

[1]  James H Thrall,et al.  Radiology order entry with decision support: initial clinical experience. , 2006, Journal of the American College of Radiology : JACR.

[2]  S. Seltzer,et al.  Adoption and meaningful use of computerized physician order entry with an integrated clinical decision support system for radiology: ten-year analysis in an urban teaching hospital. , 2012, Journal of the American College of Radiology : JACR.

[3]  Ramin Khorasani,et al.  Effect of computerized clinical decision support on the use and yield of CT pulmonary angiography in the emergency department. , 2012, Radiology.

[4]  Bruce E Lehnert,et al.  Analysis of appropriateness of outpatient CT and MRI referred from primary care clinics at an academic medical center: how critical is the need for improved decision support? , 2010, Journal of the American College of Radiology : JACR.

[5]  W. Dixon,et al.  Clinical and epidemiological research , 2011 .

[6]  D. Miglioretti,et al.  Radiation dose associated with common computed tomography examinations and the associated lifetime attributable risk of cancer. , 2009, Archives of internal medicine.

[7]  H. Mcdonald,et al.  Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. , 2005, JAMA.

[8]  J. Fine,et al.  Effectiveness and acceptability of a computerized decision support system using modified Wells criteria for evaluation of suspected pulmonary embolism. , 2011, Annals of emergency medicine.

[9]  Gary S Kaplan,et al.  Effectiveness of clinical decision support in controlling inappropriate imaging. , 2011, Journal of the American College of Radiology : JACR.

[10]  M. Landre,et al.  Assessment of radiological referral practice and effect of computer-based guidelines on radiological requests in two emergency departments. , 2002, Clinical radiology.

[11]  Ramin Khorasani,et al.  Examining clinical decision support integrity: is clinician self-reported data entry accurate? , 2014, J. Am. Medical Informatics Assoc..

[12]  S. Forseen,et al.  Clinical decision support and acute low back pain: evidence-based order sets. , 2012, Journal of the American College of Radiology : JACR.

[13]  Richard D. White,et al.  ACC/AHA/ACR/ASE/ASNC/HRS/NASCI/RSNA/SAIP/SCAI/ SCCT/SCMR/SIR 2008 Key Data Elements and Definitions for Cardiac Imaging: A Report of the American College of Cardiology/American Heart Association Task Force on Clinical Data Standards (Writing Committee to Develop Clinical Data Standards for Cardiac I , 2009, Circulation.

[14]  Sheila Weinmann,et al.  Use of diagnostic imaging studies and associated radiation exposure for patients enrolled in large integrated health care systems, 1996-2010. , 2012, JAMA.

[15]  A. Rosenkrantz,et al.  Assessing the appropriateness of outpatient abdominopelvic CT and MRI examinations using the American College of Radiology Appropriateness Criteria. , 2015, Academic radiology.

[16]  C. Douglas Maynard,et al.  ACR Appropriateness Criteria , 2000 .

[17]  D. Brenner,et al.  Computed tomography--an increasing source of radiation exposure. , 2007, The New England journal of medicine.

[18]  Standards for Cardiac Imaging) on Clinical Data Standards (Writing Committee to Develop Clinical Data the American College of Cardiology/American Heart Association Task Force R 2008 Key Data Elements and Definitions for Cardiac Imaging: A Report of ACC/AHA/ACR/ASE/ASNC/HRS/NASCI/RSNA/SAIP/SCAI/SCCT/ , 2009 .

[19]  Thomas H. Payne,et al.  Review Paper: Medication-related Clinical Decision Support in Computerized Provider Order Entry Systems: A Review , 2007, J. Am. Medical Informatics Assoc..

[20]  Richard D. White,et al.  ACC/AHA/ACR/ASE/ASNC/HRS/NASCI/RSNA/SAIP/SCAI/SCCT/SCMR/SIR 2008 Key Data Elements and Definitions for Cardiac Imaging A Report of the American College of Cardiology/American Heart Association Task Force on Clinical Data Standards (Writing Committee to Develop Clinical Data Standards for Cardiac Ima , 2009, Journal of the American College of Cardiology.

[21]  Terry S. Field,et al.  Application of Information Technology: Costs Associated with Developing and Implementing a Computerized Clinical Decision Support System for Medication Dosing for Patients with Renal Insufficiency in the Long-term Care Setting , 2008, J. Am. Medical Informatics Assoc..

[22]  Richard D. White,et al.  2013 appropriate utilization of cardiovascular imaging: a methodology for the development of joint criteria for the appropriate utilization of cardiovascular imaging by the American College of Cardiology Foundation and American College of Radiology. , 2013, Journal of the American College of Cardiology.

[23]  Nancy A Obuchowski,et al.  Effect of computerized physician order entry on radiologic examination order indication quality. , 2011, Archives of internal medicine.

[24]  Lynn Curry,et al.  Electronic decision support for diagnostic imaging in a primary care setting , 2011, J. Am. Medical Informatics Assoc..

[25]  N. Powe,et al.  Clinical information technologies and inpatient outcomes: a multiple hospital study. , 2009, Archives of internal medicine.

[26]  L. Solberg,et al.  Effects of electronic decision support on high-tech diagnostic imaging orders and patients. , 2010, The American journal of managed care.

[27]  Andrew Georgiou,et al.  The impact of computerized provider order entry systems on medical-imaging services: a systematic review , 2011, J. Am. Medical Informatics Assoc..

[28]  C. Langlotz,et al.  Clinical decision support for imaging in the era of the Patient Protection and Affordable Care Act. , 2012, Journal of the American College of Radiology : JACR.

[29]  K. P. Kim,et al.  Radiation dose associated with common computed tomography examinations and the associated lifetime attributable risk of cancer. , 2009, Archives of internal medicine.

[30]  James H Thrall,et al.  Effect of computerized order entry with integrated decision support on the growth of outpatient procedure volumes: seven-year time series analysis. , 2009, Radiology.

[31]  Jeffrey B. Weilburg,et al.  Increasing the appropriateness of outpatient imaging: effects of a barrier to ordering low-yield examinations. , 2010, Radiology.

[32]  Richard D. White,et al.  2013 appropriate utilization of cardiovascular imaging: a methodology for the development of joint criteria for the appropriate utilization of cardiovascular imaging by the American College of Cardiology Foundation and American College of Radiology. , 2013, Journal of the American College of Radiology : JACR.

[33]  R. Khorasani,et al.  Computerized physician order entry and decision support: improving the quality of care. , 2001, Radiographics : a review publication of the Radiological Society of North America, Inc.

[34]  V. Hasselblad,et al.  Effect of Clinical Decision-Support Systems , 2012, Annals of Internal Medicine.

[35]  L. Solberg,et al.  A technology solution for the high-tech diagnostic imaging conundrum. , 2012, The American journal of managed care.

[36]  Ramin Khorasani,et al.  Impact of provider-led, technology-enabled radiology management program on imaging. , 2013, The American journal of medicine.

[37]  Roger Chou,et al.  Diagnostic Imaging for Low Back Pain: Advice for High-Value Health Care From the American College of Physicians , 2011, Annals of Internal Medicine.

[38]  Ramin Khorasani,et al.  Abdominal imaging utilization in the emergency department: trends over two decades , 2011, International journal of emergency medicine.

[39]  Richard Mendelson,et al.  Reducing inappropriate diagnostic practice through education and decision support. , 2010, International journal for quality in health care : journal of the International Society for Quality in Health Care.