Video clip assessment of a salivary gland ultrasound scoring system in Sjögren’s syndrome using consensual definitions: an OMERACT ultrasound working group reliability exercise

Objective To develop ultrasound (US) definitions and a US novel scoring system for major salivary gland (SG) lesions in patients with primary Sjögren’s syndrome (pSS) and to test their intrareader and inter-reader reliability using US video clips. Methods Twenty-five rheumatologists were subjected to a three-round, web-based Delphi process in order to agree on (1) definitions and scanning procedure of salivary gland ultrasonography (SGUS): parotid, submandibular and sublingual glands (PG, SMG and SLG); (2) definitions for the elementary SGUS lesions in patients with Sjögren’s syndrome; (3) scoring system for grading changes. The experts rated the statements on a 1–5 Likert scale. In the second step, SGUS video clips of patients with pSS and non-pSS sicca cases were collected containing various spectrums of disease severity followed by an intrareader and inter-reader reliability exercise. Each video clip was evaluated according to the agreed definitions. Results Consensual definitions were developed after three Delphi rounds. Among the three selected SGs, US assessment of PGs and SMGs was agreed on. Agreement was reached to score only greyscale lesions and to focus on anechoic/hypoechoic foci in a semiquantitative matter or, if not possible on a qualitatively (present/absent) evaluation of fatty or fibrous lesions. Intrareader reliability for detecting and scoring these lesions was excellent (Cohen’s kappa 0.81) and inter-reader reliability was good (Light’s kappa 0.66). Conclusion New definitions for developing a novel semiquantitative US score in patients with pSS were developed and tested on video clips. Inter-reader and intrareader reliabilities were good and excellent, respectively.

[1]  A. Katsumata,et al.  Usefulness of a deep learning system for diagnosing Sjögren's syndrome using ultrasonography images. , 2019, Dento maxillo facial radiology.

[2]  G. Herrero-Beaumont,et al.  Ultrasound salivary gland involvement in Sjogren’s syndrome vs. other connective tissue diseases: is it autoantibody and gland dependent? , 2019, Clinical Rheumatology.

[3]  L. Jung,et al.  Current status and recent advances on the use of ultrasonography in pediatric rheumatic diseases , 2019, World Journal of Pediatrics.

[4]  R. Moots,et al.  Effect of rituximab on a salivary gland ultrasound score in primary Sjögren’s syndrome: results of the TRACTISS randomised double-blind multicentre substudy , 2017, Annals of the rheumatic diseases.

[5]  A. Vissink,et al.  Scoring hypoechogenic areas in one parotid and one submandibular gland increases feasibility of ultrasound in primary Sjögren’s syndrome , 2017, Annals of the rheumatic diseases.

[6]  A. Vissink,et al.  Ultrasound of the Major Salivary Glands is a Reliable Imaging Technique in Patients with Clinically Suspected Primary Sjögren’s Syndrome , 2017, Ultraschall in der Medizin - European Journal of Ultrasound.

[7]  A. Vissink,et al.  Ultrasonography of major salivary glands compared with parotid and labial gland biopsy and classification criteria in patients with clinically suspected primary Sjögren’s syndrome , 2017, Annals of the rheumatic diseases.

[8]  John Rout,et al.  Salivary gland ultrasound abnormalities in primary Sjögren’s syndrome: consensual US-SG core items definition and reliability , 2017, RMD Open.

[9]  L. Criswell,et al.  2016 American College of Rheumatology/European League Against Rheumatism Classification Criteria for Primary Sjögren's Syndrome: A Consensus and Data‐Driven Methodology Involving Three International Patient Cohorts , 2017, Arthritis & rheumatology.

[10]  E. Naredo,et al.  Multiobserver Reliability of Ultrasound Assessment of Salivary Glands in Patients with Established Primary Sjögren Syndrome , 2016, The Journal of Rheumatology.

[11]  C. Baldini,et al.  Major Salivary Gland Ultrasonography in the Diagnosis of Sjögren's Syndrome: A Place in the Diagnostic Criteria? , 2016, Rheumatic diseases clinics of North America.

[12]  A. Vissink,et al.  Is salivary gland ultrasonography a useful tool in Sjögren's syndrome? A systematic review. , 2016, Rheumatology.

[13]  Xia Zhang,et al.  Ultrasonographic evaluation of major salivary glands in primary Sjögren's syndrome: comparison of two scoring systems. , 2015, Rheumatology.

[14]  J. Pers,et al.  Brief Report: Ultrasonographic Assessment of Salivary Gland Response to Rituximab in Primary Sjögren's Syndrome , 2015, Arthritis & rheumatology.

[15]  J. Pers,et al.  Salivary gland ultrasonography improves the diagnostic performance of the 2012 American College of Rheumatology classification criteria for Sjögren's syndrome. , 2014, Rheumatology.

[16]  E. Theander,et al.  Primary Sjögren's Syndrome: Diagnostic and Prognostic Value of Salivary Gland Ultrasonography Using a Simplified Scoring System , 2014, Arthritis care & research.

[17]  A. Iagnocco,et al.  Defining Enthesitis in Spondyloarthritis by Ultrasound: Results of a Delphi Process and of a Reliability Reading Exercise , 2014, Arthritis care & research.

[18]  H. Moutsopoulos,et al.  Characteristics of the minor salivary gland infiltrates in Sjögren's syndrome. , 2010, Journal of autoimmunity.

[19]  K. Eguchi,et al.  Salivary gland ultrasonography: can it be an alternative to sialography as an imaging modality for Sjögren's syndrome? , 2010, Annals of the rheumatic diseases.

[20]  I. Boricic,et al.  Major salivary gland sonography in Sjögren's syndrome: diagnostic value of a novel ultrasonography score (0–12) for parenchymal inhomogeneity , 2010, Scandinavian journal of rheumatology.

[21]  A. Iagnocco,et al.  Ultrasonography of salivary glands in primary Sjögren's syndrome: a comparison with contrast sialography and scintigraphy. , 2008, Rheumatology.

[22]  D. Wernicke,et al.  Ultrasonography of salivary glands -- a highly specific imaging procedure for diagnosis of Sjögren's syndrome. , 2008, The Journal of rheumatology.

[23]  M. Tomšič,et al.  Ultrasonographic changes of major salivary glands in primary Sjögren's syndrome. Evaluation of a novel scoring system. , 2007, European journal of radiology.

[24]  Chia-Chien Hsu,et al.  The Delphi Technique: Making Sense of Consensus , 2007 .

[25]  Louette R. Johnson Lutjens.  Research , 2006 .

[26]  T. Kveder,et al.  Ultrasonographic changes of major salivary glands in primary Sjogren's syndrome. Diagnostic value of a novel scoring system. , 2005, Rheumatology.

[27]  R. Jonsson,et al.  Classification criteria for Sjögren's syndrome: a revised version of the European criteria proposed by the American-European Consensus Group , 2002, Annals of the rheumatic diseases.

[28]  F. Salaffi,et al.  Salivary gland ultrasonography in the evaluation of primary Sjögren's syndrome. Comparison with minor salivary gland biopsy. , 2000, The Journal of rheumatology.

[29]  M. Izumi,et al.  Sublingual gland: MR features of normal and diseased states. , 1999, AJR. American journal of roentgenology.

[30]  K. Yoshiura,et al.  Reliability of ultrasonography and sialography in the diagnosis of Sjögren's syndrome. , 1997, Oral surgery, oral medicine, oral pathology, oral radiology, and endodontics.

[31]  B. Williams,et al.  Iliopsoas bursitis-an unusual presentation of metastatic bone disease. , 1996, British journal of rheumatology.

[32]  G. Rossi,et al.  Salivary gland echography in primary and secondary Sjögren's syndrome. , 1992, Clinical and experimental rheumatology.

[33]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[34]  A. Vissink,et al.  Toward new classification criteria for Sjögren's syndrome? , 2013, Arthritis and rheumatism.

[35]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[36]  F. Salaffi,et al.  Ultrasonography and Colour Doppler Sonography of Salivary Glands in Primary Sjo¨gren’s Syndrome , 2001, Clinical Rheumatology.

[37]  J. Fleiss.  Measuring nominal scale agreement among many raters. , 1971 .