Quantifying lung ultrasound comets with a convolutional neural network: Initial clinical results

Lung ultrasound comets are "comet-tail" artifacts appearing in lung ultrasound images. They are particularly useful in detecting several lung pathologies and may indicate the amount of extravascular lung water. However, the comets are not always well defined and large variations in the counting results exist between observers. This study uses a convolutional neural network to quantify these lung ultrasound comets on a 4864-image clinical lung ultrasound dataset labeled by the authors. The neural network counted the number of comets correctly on 43.4% of the images and has an intraclass correlation (ICC) of 0.791 with respect to human counting on the test set. The ICC level indicates a higher correlation level than previously reported ICC between human observers. The neural network was then deployed and applied to a clinical 6272-image dataset. The correlation between the automated comet counts and the clinical parameters was examined. The comet counts correlate positively with the diastolic blood pressure (p = 0.047, r = 0.448), negatively with ejection fraction (p = 0.061, r = -0.513), and negatively with BMI (p = 0.009, r = -0.566). The neural network can be alternatively formulated as a diagnostic test for comet-positive images with 80.8% accuracy. The results could potentially be improved with a larger dataset and a refined approach to the neural networks used.

[1]  W. Wong,et al.  The calculation of posterior distributions by data augmentation , 1987 .

[2]  V. Noble,et al.  Automated B‐Line Scoring on Thoracic Sonography , 2013, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[3]  Fei-Fei Li,et al.  Large-Scale Video Classification with Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[5]  D. Lichtenstein,et al.  The comet-tail artifact. An ultrasound sign of alveolar-interstitial syndrome. , 1997, American journal of respiratory and critical care medicine.

[6]  D. Cicchetti Guidelines, Criteria, and Rules of Thumb for Evaluating Normed and Standardized Assessment Instruments in Psychology. , 1994 .

[7]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[8]  Kristoffer Lindskov Hansen,et al.  Novel automatic detection of pleura and B-lines (comet-tail artifacts) on in vivo lung ultrasound scans , 2016, SPIE Medical Imaging.

[9]  J. Donnelly,et al.  Interobserver agreement in the evaluation of B-lines using bedside ultrasound. , 2015, Journal of critical care.

[10]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[11]  Thomas L. Dean,et al.  Neural Networks and Neuroscience-Inspired Computer Vision , 2014, Current Biology.

[12]  David Bull,et al.  Line Detection as an Inverse Problem: Application to Lung Ultrasound Imaging , 2017, IEEE Transactions on Medical Imaging.

[13]  E. Picano,et al.  Prognostic value of extravascular lung water assessed with ultrasound lung comets by chest sonography in patients with dyspnea and/or chest pain. , 2007, Journal of cardiac failure.

[14]  E. Picano,et al.  Usefulness of ultrasound lung comets as a nonradiologic sign of extravascular lung water. , 2004, The American journal of cardiology.

[15]  Nicolas Pinto,et al.  Why is Real-World Visual Object Recognition Hard? , 2008, PLoS Comput. Biol..

[16]  E. Picano,et al.  Ultrasound lung comets: a clinically useful sign of extravascular lung water. , 2006, Journal of the American Society of Echocardiography : official publication of the American Society of Echocardiography.

[17]  C. Zoccali,et al.  Chest ultrasound and hidden lung congestion in peritoneal dialysis patients. , 2012, Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association.

[18]  J. Rubin,et al.  Quantitative Lung Ultrasound Comet Measurement: Method and Initial Clinical Results , 2015, Blood Purification.

[19]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[20]  C. Zoccali,et al.  Detection of pulmonary congestion by chest ultrasound in dialysis patients. , 2010, JACC. Cardiovascular imaging.

[21]  D. Lichtenstein,et al.  The comet-tail artifact: an ultrasound sign ruling out pneumothorax , 1999, Intensive Care Medicine.

[22]  C. Zoccali,et al.  Pulmonary congestion predicts cardiac events and mortality in ESRD. , 2013, Journal of the American Society of Nephrology : JASN.

[23]  G. Soldati,et al.  Can lung comets be counted as "objects"? , 2011, JACC. Cardiovascular imaging.

[24]  M. Gheorghiade,et al.  Ultrasound lung comets for the differential diagnosis of acute cardiogenic dyspnoea: A comparison with natriuretic peptides ☆ , 2008, European journal of heart failure.

[25]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..