Breast imaging reporting and data system lexicon for US: interobserver agreement for assessment of breast masses.

PURPOSE To retrospectively evaluate the interobserver agreement of radiologists who used the Breast Imaging Reporting and Data System (BI-RADS) lexicon to characterize and categorize ultrasonographic (US) features of breast masses. MATERIALS AND METHODS No institutional review board approval or patient consent was required. Five breast radiologists retrospectively independently evaluated 267 breast masses (113 benign and 154 malignant masses in 267 patients) by using the BI-RADS US lexicon. Reviewers were blinded to mammographic images, medical history, and pathologic findings. Interobserver agreement was assessed with the Aickin revised kappa statistic. RESULTS Interobserver agreement varied from fair for evaluation of mass margins (kappa = 0.36) to moderate for evaluation of lesion boundary (kappa = 0.48), echo pattern (kappa = 0.58), and posterior acoustic features (kappa = 0.47) to substantial for evaluation of mass orientation (kappa = 0.70) and shape (kappa = 0.64). For small (< or =0.7 cm; n = 49) or malignant (n = 154) masses, low concordance was noted for margin descriptors (kappa = 0.30 and 0.28, respectively) and BI-RADS category (kappa = 0.21 and 0.26, respectively). Overall, only fair agreement was obtained for BI-RADS category (kappa = 0.30). Agreement for subdivisions 4a, 4b, and 4c of BI-RADS category 4 was fair (kappa = 0.33), fair (kappa = 0.32), and poor (kappa = 0.17), respectively. CONCLUSION Reproducibility of US BI-RADS terminology is good except for margin evaluation. A trend toward lower concordance was noted for the evaluation of small masses and malignant lesions. Classification into subdivisions 4a, 4b, and 4c was poorly reproducible.

[1]  Ki Keun Oh,et al.  Observer variability of Breast Imaging Reporting and Data System (BI-RADS) for breast ultrasound. , 2008, European journal of radiology.

[2]  Jean B. Cormack,et al.  Operator dependence of physician-performed whole-breast US: lesion detection and characterization. , 2006, Radiology.

[3]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[4]  Sung Hun Kim,et al.  Observer Agreement Using the ACR Breast Imaging Reporting and Data System (BI-RADS)-Ultrasound, First Edition (2003) , 2007, Korean journal of radiology.

[5]  W. Berg,et al.  Multicentric and multifocal cancer: whole-breast US in preoperative evaluation. , 2000, Radiology.

[6]  M. Aickin Maximum likelihood estimation of agreement in the constant predictive probability model, and its relation to Cohen's kappa. , 1990, Biometrics.

[7]  M S Soo,et al.  Sonography of solid breast lesions: observer variability of lesion description and assessment. , 1999, AJR. American journal of roentgenology.

[8]  Rebecca S Lewis,et al.  Does training in the Breast Imaging Reporting and Data System (BI-RADS) improve biopsy recommendations or feature analysis agreement with experienced breast imagers at mammography? , 2002, Radiology.

[9]  M. Mainiero,et al.  BI-RADS lexicon for US and mammography: interobserver variability and positive predictive value. , 2006, Radiology.

[10]  A. Stavros,et al.  Solid breast nodules: use of sonography to distinguish between benign and malignant lesions. , 1995, Radiology.

[11]  P. Skaane,et al.  Interobserver Variation in the Interpretation of Breast Imaging , 1997, Acta radiologica.

[12]  Alfons G H Kessels,et al.  The additional diagnostic value of ultrasonography in the diagnosis of breast cancer. , 2003, Archives of internal medicine.

[13]  P. Langenberg,et al.  Breast Imaging Reporting and Data System: inter- and intraobserver variability in feature analysis and final assessment. , 2000, AJR. American journal of roentgenology.

[14]  Lesion detection and characterization in a breast US phantom: results of the ACRIN 6666 Investigators. , 2006, Radiology.

[15]  C. Merritt,et al.  Toward a standardized breast ultrasound lexicon, BI-RADS: ultrasound. , 2001, Seminars in roentgenology.

[16]  J. Elmore,et al.  Variability in radiologists' interpretations of mammograms. , 1994, The New England journal of medicine.

[17]  P. Skaane The Additional Value of us to Mammography in the Diagnosis of Breast Cancer , 1999, Acta radiologica.

[18]  M. J. van de Vijver,et al.  Diagnosis of breast cancer: contribution of US as an adjunct to mammography. , 1999, Radiology.