Deep Learning Based Approach for Assessment of Primary Sjögren’s Syndrome from Salivary Gland Ultrasonography Images

Salivary gland ultrasonography (SGUS) has shown a good potential for diagnosing Primary Sjogren’s syndrome (pSS). However, existing scoring procedures (based on the manual analysis and grading of images) need further improvements before being established as standardized diagnostic tools. In this study we developed a deep learning based approach for fast and accurate segmentation of salivary glands extended with the scoring of pSS. Total 471 SGUS images were annotated in terms of semantic segmentation and de Vita scoring system. The dataset has been augmented using standard technique (rotation, flip, random crop) and used for training of a deep learning method for segmentation and classification. Our model achieved 0.935 intersection over union (IoU) for segmentation of salivary glands and 0.854 accuracy for classification of pSS stage on validation images. Here, we give an overview of these achievements and show the results.

[1]  A. Iagnocco,et al.  Ultrasonography of salivary glands in primary Sjögren's syndrome: a comparison with contrast sialography and scintigraphy. , 2008, Rheumatology.

[2]  Kai Chen,et al.  Hybrid Task Cascade for Instance Segmentation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  G. Rossi,et al.  Salivary gland echography in primary and secondary Sjögren's syndrome. , 1992, Clinical and experimental rheumatology.

[4]  Yongchao Gong,et al.  Mask Scoring R-CNN , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  John Rout,et al.  Salivary gland ultrasound abnormalities in primary Sjögren’s syndrome: consensual US-SG core items definition and reliability , 2017, RMD Open.

[6]  D. Caramella,et al.  Ultrasonography of major salivary glands: a highly specific tool for distinguishing primary Sjögren's syndrome from undifferentiated connective tissue diseases. , 2015, Rheumatology.

[7]  Yong Jae Lee,et al.  YOLACT: Real-Time Instance Segmentation , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[8]  Alejandro F. Frangi,et al.  Radiomics-Based Assessment of Primary Sjögren's Syndrome From Salivary Gland Ultrasonography Images , 2020, IEEE Journal of Biomedical and Health Informatics.

[9]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[10]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[11]  Xinlei Chen,et al.  TensorMask: A Foundation for Dense Object Segmentation , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[12]  Goran Radunovic,et al.  Diagnostic Value of Salivary Gland Ultrasonographic Scoring System in Primary Sjögren’s Syndrome: A Comparison with Scintigraphy and Biopsy , 2009, The Journal of Rheumatology.

[13]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  I. Boricic,et al.  Major salivary gland sonography in Sjögren's syndrome: diagnostic value of a novel ultrasonography score (0–12) for parenchymal inhomogeneity , 2010, Scandinavian journal of rheumatology.

[15]  T. Kveder,et al.  Ultrasonographic changes of major salivary glands in primary Sjogren's syndrome. Diagnostic value of a novel scoring system. , 2005, Rheumatology.

[16]  Trevor Darrell,et al.  Learning to Segment Every Thing , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[17]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.