Interobserver agreement in describing video capsule endoscopy findings: a multicentre prospective study.

BACKGROUND AND AIM Few studies have specifically addressed interobserver agreement in describing lesions identified during capsule endoscopy. The aim of our study is to evaluate interobserver agreement in the description of capsule endoscopy findings. MATERIALS AND METHODS Consecutive short segments of capsule endoscopy were prospectively observed by 8 investigators. Seventy-five videos were prepared by an external investigator (gold standard). The description of the findings was reported by the investigators using the same validated and standardized capsule endoscopy structured terminology. The agreement was assessed using Cohen's kappa statistic. RESULTS As concerns the ability to detect a lesion, the agreement with the gold standard was moderate (kappa 0.48), as well as the agreement relating to the final diagnosis (κ 0.45). The best agreement was observed in identifying the presence of active bleeding (κ 0.72), whereas the poorest agreement concerned the lesion size (κ 0.32). The agreement with the GS was significantly better in endoscopists with higher case/volume of capsule endoscopy per year. Diagnostic concordance was better in the presence of angiectasia than in the presence of polyps or ulcers/erosions. CONCLUSIONS Correct lesion identification and diagnosis seem more likely to occur in presence of angiectasia, and for readers with more experience in capsule endoscopy reading.

[1]  A. May,et al.  The First Prospective Controlled Trial Comparing Wireless Capsule Endoscopy with Push Enteroscopy in Chronic Gastrointestinal Bleeding , 2002, Endoscopy.

[2]  K. Sugano,et al.  New system of double-balloon enteroscopy for diagnosis and treatment of small intestinal disorders. , 2003, Gastroenterology.

[3]  J. Llach,et al.  Wireless capsule endoscopy in patients with obscure gastrointestinal bleeding: a comparative study with push enteroscopy , 2004, Alimentary pharmacology & therapeutics.

[4]  J. Fleiss Statistical methods for rates and proportions , 1974 .

[5]  B. Lashner Sensitivity–Specificity Trade-off for Capsule Endoscopy in IBD: Is It Worth It? , 2006, The American Journal of Gastroenterology.

[6]  G. Gay,et al.  Capsule endoscopy structured terminology (CEST): proposal of a standardized and structured terminology for reporting capsule endoscopy procedures. , 2005, Endoscopy.

[7]  T. Ponchon,et al.  Diagnostic value of endoscopic capsule in patients with obscure digestive bleeding: blinded comparison with video push-enteroscopy. , 2003, Endoscopy.

[8]  Jan-Willem Strijbos,et al.  Content analysis: What are they talking about? , 2006, Comput. Educ..

[9]  Shou-Jiang Tang,et al.  Given® Capsule Endoscopy in Celiac Disease: Evaluation of Diagnostic Accuracy and Interobserver Agreement , 2005, The American Journal of Gastroenterology.

[10]  J. Santisi,et al.  The accuracy of an endoscopy nurse in interpreting capsule endoscopy , 2003, American Journal of Gastroenterology.

[11]  R. Markert,et al.  Is in vivo measurement of size of polyps during colonoscopy accurate? , 1996, Gastrointestinal Endoscopy.

[12]  G. Costamagna,et al.  A prospective trial comparing small bowel radiographs and video capsule endoscopy for suspected small bowel disease. , 2002, Gastroenterology.

[13]  D. Heresbach,et al.  Wireless capsule endoscopy versus ileocolonoscopy for the diagnosis of postoperative recurrence of Crohn’s disease: a prospective study , 2006, Gut.

[14]  Catherine Klersy,et al.  Video capsule endoscopy and histology for small-bowel mucosa evaluation: a comparison performed by blinded observers. , 2006, Clinical gastroenterology and hepatology : the official clinical practice journal of the American Gastroenterological Association.

[15]  D. Chang,et al.  Inter-observer agreement on the interpretation of capsule endoscopy findings based on capsule endoscopy structured terminology: A multicenter study by the Korean Gut Image Study Group , 2010, Scandinavian Journal of Gastroenterology.

[16]  D. Faigel,et al.  ASGE guideline: guidelines for credentialing and granting privileges for capsule endoscopy. , 2005, Gastrointestinal endoscopy.

[17]  G. Meron The development of the swallowable video capsule (M2A). , 2000, Gastrointestinal endoscopy.

[18]  E. Rondonotti,et al.  Outcome of patients with obscure gastrointestinal bleeding after capsule endoscopy: report of 100 consecutive cases. , 2004, Gastroenterology.

[19]  Y. Niv,et al.  Capsule Endoscopy Examination—Preliminary Review by a Nurse , 2005, Digestive Diseases and Sciences.

[20]  R. Marmo,et al.  Meta‐analysis: capsule enteroscopy vs. conventional modalities in diagnosis of small bowel diseases , 2005, Alimentary pharmacology & therapeutics.

[21]  P. Swain,et al.  Wireless capsule endoscopy: a comparison with push enteroscopy in patients with gastroscopy and colonoscopy negative gastrointestinal bleeding , 2003, Gut.

[22]  T. Moriyama,et al.  Comparison of Capsule Endoscopy and Enteroscopy with the Double-Balloon Method in Patients with Obscure Bleeding and Polyposis , 2005, Endoscopy.

[23]  W. Leung,et al.  Inter-observer variations on interpretation of capsule endoscopies , 2006, European journal of gastroenterology & hepatology.

[24]  B. Petersen,et al.  ASGE Technology Status Evaluation Report: wireless capsule endoscopy. , 2006, Gastrointestinal endoscopy.

[25]  R. Jian,et al.  Video Capsule Endoscopy for Investigation of Obscure Gastrointestinal Bleeding: Feasibility, Results, and Interobserver Agreement , 2005, Endoscopy.

[26]  J. R. Landis,et al.  An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers. , 1977, Biometrics.

[27]  G. Gay,et al.  Structured terminology for capsule endoscopy: results of retrospective testing and validation in 766 small-bowel investigations. , 2005, Endoscopy.

[28]  Ian Arnott,et al.  Sensitivity and inter-observer variability for capsule endoscopy image analysis in a cohort of novice readers. , 2006, World journal of gastroenterology.

[29]  A Donner,et al.  A general goodness‐of‐fit approach for inference procedures concerning the kappa statistic , 2001, Statistics in medicine.

[30]  R. Sidhu,et al.  Is formal training necessary for capsule endoscopy? The largest gastroenterology trainee study with controls. , 2008, Digestive and liver disease : official journal of the Italian Society of Gastroenterology and the Italian Association for the Study of the Liver.

[31]  J. Kjeldsen,et al.  Inter-observer agreement for detection of small bowel Crohn's disease with capsule endoscopy , 2010, Scandinavian journal of gastroenterology.

[32]  R. Sampliner,et al.  Are endoscopic measurements of colonic polyps reliable? , 1993, The American journal of gastroenterology.

[33]  Dennis M. Jensen,et al.  Principles of training in gastrointestinal endoscopy , 1999 .

[34]  Marco Pennazio,et al.  Literature review and recommendations for clinical application of small-bowel capsule endoscopy, based on a panel discussion by international experts , 2007 .

[35]  M. Muñoz-Navas,et al.  Capsule endoscopy. , 2009, World journal of gastroenterology.

[36]  D. Martines,et al.  Small bowel exploration by wireless capsule endoscopy: results from 314 procedures. , 2006, The American journal of medicine.