Can a limited double reading/second opinion of initially recalled breast ultrasound screening examinations improve radiologists' performances?

Interpretations of breast ultrasound screening examinations result in high recall rates and large inter-radiologist variability, frequently leading to “conservative” recommendations. Double reading of all breast ultrasound screening examinations is cost prohibitive, but double reading of only “initially recalled” cases may prove efficacious. We assessed changes in recommendations, if any, by providing a consensus second opinion in a limited subset of examinations initially recommended for recall. We performed a retrospective reader study with 197 ultrasound examinations (97 not recalled and 100 recalled clinically). First, we generated a consensus “second opinion” consisting of the majority vote of three independent readings of each case by experienced ultrasound interpreters. During the reader study that followed, if the reader recommended a “recall” and the “consensus second opinion” did not, a message to that effect was displayed and the reader was asked to re-review the exam and re-assess if, knowing the second opinion, a re-rating of the case was warranted. We compared performance levels pre- and post- the second opinion. The second opinion resulted in “no recall” recommendations of 141 cases in the entire set, including four cancer cases missed by all three readers. On average, radiologists received “warning” messages in 30 cases (range 15-50), or in ~15% of cases. Rating changes (downgrades to no recall) occurred in 36 of these cases. These changes resulted in a possible recall rate reduction of 28% in prompted cases or 14% overall recall reduction, while increasing the false negative rate by only one case missed by 2 readers (~1%).