Inter-radiologist agreement for CT scoring of pediatric splenic injuries and effect on an established clinical practice guideline

BackgroundThe American Pediatric Surgical Association (APSA) advocates for the use of a clinical practice guideline to direct management of hemodynamically stable pediatric spleen injuries. The clinical practice guideline is based on the CT score of the spleen injury according to the American Association for the Surgery of Trauma (AAST) CT scoring system.ObjectiveTo determine the potential effect of radiologist agreement for CT scoring of pediatric spleen injuries on an established APSA clinical practice guideline.Materials and methodsWe retrospectively analyzed blunt splenic injuries occurring in children from January 2007 to January 2012 at a single level 1 trauma center (n = 90). Abdominal CT exams performed at clinical presentation were reviewed by four radiologists who documented the following: (1) splenic injury grade (AAST system), (2) arterial extravasation and (3) pseudoaneurysm. Inter-rater agreement for AAST injury grade was assessed using the multi-rater Fleiss kappa and Kendall coefficient of concordance. Inter-rater agreement was assessed using weighted (AAST injury grade) or prevalence-adjusted bias-adjusted (binary measures) kappa statistics; 95% confidence intervals were calculated. We evaluated the hypothetical effect of radiologist disagreement on an established APSA clinical practice guideline.ResultsInter-rater agreement was good for absolute AAST injury grade (kappa: 0.64 [0.59–0.69]) and excellent for relative AAST injury grade (Kendall w: 0.90). All radiologists agreed on the AAST grade in 52% of cases. Based on an established clinical practice guideline, radiologist disagreement could have changed the decision for intensive care management in 11% (10/90) of children, changed the length of hospital stay in 44% (40/90), and changed the time to return to normal activity in 44% (40/90).ConclusionRadiologist agreement when assigning splenic AAST injury grades is less than perfect, and disagreements have the potential to change management in a substantial number of pediatric patients.

[1]  A. Feinstein,et al.  High agreement but low kappa: I. The problems of two paradoxes. , 1990, Journal of clinical epidemiology.

[2]  A. Peitzman,et al.  Blunt splenic injury in adults: clinical and CT criteria for management, with emphasis on active extravasation. , 1998, Radiology.

[3]  M. Nance,et al.  The significance of contrast blush on computed tomography in children with splenic injuries. , 2004, Journal of pediatric surgery.

[4]  J. Amorosa,et al.  Computed tomography is inaccurate in estimating the severity of adult splenic injury. , 1995, The Journal of trauma.

[5]  J. Boone,et al.  Size-Specific Dose Estimates (SSDE) in Pediatric and Adult Body CT Examinations , 2011 .

[6]  S. S. St. Peter,et al.  National trends in pediatric blunt spleen and liver injury management and potential benefits of an abbreviated bed rest protocol. , 2014, Journal of pediatric surgery.

[7]  M. Coburn,et al.  Nonoperative management of splenic and hepatic trauma in the multiply injured pediatric and adolescent patient. , 1995, Archives of surgery.

[8]  H. Champion,et al.  Organ injury scaling: spleen and liver (1994 revision). , 1995, The Journal of trauma.

[9]  S. Stylianos.  Compliance with evidence-based guidelines in children with isolated spleen or liver injury: a prospective study. , 2002, Journal of pediatric surgery.

[10]  M. Leinwand,et al.  Application of the APSA evidence-based guidelines for isolated liver or spleen injuries: a single institution experience. , 2004, Journal of pediatric surgery.

[11]  D. Clark,et al.  Is computed tomographic grading of splenic injury useful in the nonsurgical management of blunt trauma? , 1994, The Journal of trauma.

[12]  K. Guice,et al.  Variation in treatment of pediatric spleen injury at trauma centers versus nontrauma centers: a call for dissemination of American Pediatric Surgical Association benchmarks and guidelines. , 2006, Journal of the American College of Surgeons.

[13]  Corey Siebe.  Optimizing Trauma Multidetector CT Protocol for Blunt Splenic Injury: Need for Arterial and Portal Venous Phase Scans , 2013 .

[14]  S. Stylianos.  Evidence-based guidelines for resource utilization in children with isolated spleen or liver injury. The APSA Trauma Committee. , 2000, Journal of pediatric surgery.

[15]  H. Y. Kim,et al.  Radiation dose reduction and image quality in pediatric abdominal CT with kVp and mAs modulation and an iterative reconstruction technique. , 2014, Clinical imaging.

[16]  J. Carlin,et al.  Bias, prevalence and kappa. , 1993, Journal of clinical epidemiology.

[17]  S. Stylianos.  Evidence-based guidelines for resource utilization in children with isolated spleen or liver injury , 2000 .

[18]  A. Feinstein,et al.  High agreement but low kappa: II. Resolving the paradoxes. , 1990, Journal of clinical epidemiology.

[19]  T. Fabian,et al.  Management of blunt splenic trauma: computed tomographic contrast blush predicts failure of nonoperative management. , 1995, The Journal of trauma.

[20]  H. T. ten Duis,et al.  Only moderate intra- and inter-observer agreement between radiologists and surgeons when grading blunt paediatric hepatic injury on CT scan. , 2009, European journal of pediatric surgery : official journal of Austrian Association of Pediatric Surgery ... [et al] = Zeitschrift fur Kinderchirurgie.

[21]  Melvin T. Alexander,et al.  Optimization of selection for nonoperative management of blunt splenic injury: comparison of MDCT grading systems. , 2007, AJR. American journal of roentgenology.

[22]  P. Gassmann,et al.  Accuracy of the AAST organ injury scale for CT evaluation of traumatic liver and spleen injuries. , 2014, Chinese journal of traumatology = Zhonghua chuang shang za zhi.

[23]  W. Feuer,et al.  Inter- and intrarater reliability in computed axial tomographic grading of splenic injury: why so many grading scales? , 2004, The Journal of trauma.

[24]  C. Gotschall,et al.  Nonoperative management of blunt hepatic and splenic injury in children. , 1996, Annals of surgery.

[25]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[26]  D. Zurakowski,et al.  Clinical practice guidelines (CPGs) reduce costs in the management of isolated splenic injuries at pediatric trauma centers , 2013, Langenbeck's Archives of Surgery.

[27]  H. Champion,et al.  Organ injury scaling: spleen, liver, and kidney. , 1989, The Journal of trauma.