Inter‐observer variation between general and specialist gastrointestinal pathologists when grading dysplasia in ulcerative colitis

Histological dysplasia is the cornerstone of colorectal cancer surveillance in ulcerative colitis (UC). Recently, pathologists have received unfavourable media attention concerning other cancer screening programmes. The aim of this study was to determine whether colonic biopsy specimens should be examined by gastrointestinal pathologists as opposed to generalists, by examining inter‐observer variation between the two groups. Fifty‐one coded slides showing varying degrees of dysplasia were mailed to seven gastrointestinal and six general histopathologists. Pathologists allocated each biopsy into one of four categories without the benefit of a clinical history or an opportunity to use the ‘indefinite’ category that is included in the Riddell classification. The responses were analysed using kappa statistics. The overall kappa statistic for gastrointestinal pathologists was 0.30 [95% confidence interval (CI)=0.26–0.34] and for general pathologists 0.28 (95% CI=0.23–0.32). Agreement was best for high‐grade dysplasia (kappa of 0.54 and 0.61 for GI and general pathologists, respectively). There was total concordance of the 13 pathologists in only four of the 51 slides (7.8%) (95% CI=0.4–15.2%). It is concluded from these results that gastrointestinal pathologists are no better than generalists when grading dysplasia in UC and that agreement is poor in both groups. There is therefore no evidence that there would be any benefit in having specialist histopathology centres concentrating specifically on the interpretation of all surveillance colonoscopy biopsies from around the UK. It must be made clear to the public that surveillance and screening programmes carry a significant rate of histological error and that perfection cannot be expected or achieved with present methods. Copyright © 2001 John Wiley & Sons, Ltd.

[1]  J. Mayberry,et al.  How gastroenterologists screen for colonic cancer in ulcerative colitis: an analysis of performance. , 2000, Gastrointestinal endoscopy.

[2]  A. Benner Sample Size Tables For Clinical Studies. (2nd edn). David Machin, Michael J. Campbell, Peter M. Fayers and Alain P. Y. Pinol, Blackwell Science Ltd., Oxford, 1997. No. of pages: x+315. Price: £45. ISBN 0‐86542‐870‐0 , 1999 .

[3]  M. Lesna Assessing diagnostic errors: when is suspension of a pathologist justified? , 1998, Journal of clinical pathology.

[4]  P W Hamilton,et al.  Inter‐ and intra‐observer variation in the histopathological reporting of cervical squamous in traepithelial lesion susing a modified Bethesda grading system , 1998, British journal of obstetrics and gynaecology.

[5]  P N Furness,et al.  The use of digital images in pathology , 1997, The Journal of pathology.

[6]  H. Mitchell Report disclaimers and informed expectations about Papanicolaou smears: an Australian view. , 1997, Archives of pathology & laboratory medicine.

[7]  S. Itzkowitz Inflammatory bowel disease and cancer. , 1997, Gastroenterology clinics of North America.

[8]  S. Humphreys,et al.  A nationwide survey of observer variation in the diagnosis of thin cutaneous malignant melanoma including the MIN terminology. CRC Melanoma Pathology Panel. , 1997, Journal of Clinical Pathology.

[9]  David Machin,et al.  Sample Size Tables for Clinical Studies , 1997 .

[10]  R. Newcombe,et al.  Inter‐ and intra‐observer variation in the reporting of cervical smears: specialist cytopathologists versus histopathologists , 1996, Cytopathology : official journal of the British Society for Clinical Cytology.

[11]  P. Banks,et al.  Surveillance in ulcerative colitis: Is it worthwhile? does it save lives? or does it just give discontent? , 1995 .

[12]  M. Dixon,et al.  Observer variation in the assessment of chronic gastritis according to the Sydney system , 1994, Histopathology.

[13]  K. Tory,et al.  Development of papillary renal cell tumours is associated with loss of Y‐chromosome‐specific DNA sequences , 1994, The Journal of pathology.

[14]  C. Bernstein,et al.  Are we telling patients the truth about surveillance colonoscopy in ulcerative colitis? , 1994, The Lancet.

[15]  P. Munkholm,et al.  Colorectal cancer risk and mortality in patients with ulcerative colitis. , 1992, Gastroenterology.

[16]  H. Adami,et al.  Ulcerative colitis and colorectal cancer. A population-based study. , 1990, The New England journal of medicine.

[17]  J. Jass,et al.  Observer study of the grading of dysplasia in ulcerative colitis: comparison with clinical outcome. , 1989, Human pathology.

[18]  C. Florent,et al.  Dysplasia and cancer in ulcerative colitis. , 1989, Hepato-gastroenterology.

[19]  R. Newcombe,et al.  Observer variation in histopathological diagnosis and grading of cervical intraepithelial neoplasia. , 1989, BMJ.

[20]  A. Price,et al.  Observer variation in the assessment of dysplasia in ulcerative colitis , 1988, Histopathology.

[21]  J. Jass,et al.  Dysplasia and deoxyribonucleic acid aneuploidy in the assessment of precancerous changes in chronic ulcerative colitis. Observer variation and correlations. , 1988, Gastroenterology.

[22]  G Van Belle,et al.  Observer variation in the diagnosis of dysplasia in Barrett's esophagus. , 1988, Human pathology.

[23]  R. Kay,et al.  Can histopathologists reliably assess dysplasia in chronic inflammatory bowel disease? , 1987, Journal of clinical pathology.

[24]  P. Hamilton,et al.  Morphometrical analysis in ulcerative colitis with dysplasia and carcinoma , 1987, Histopathology.

[25]  A. Axon,et al.  Lectin and mucin histochemistry as an aid to cancer surveillance in ulcerative colitis , 1987, Histopathology.

[26]  P. Quirke,et al.  DNA aneuploidy in ulcerative colitis. , 1986, Gut.

[27]  N. Smeeton,et al.  Assessment of dysplasia in colorectal adenomas: an observer variation and morphometric study. , 1985, Journal of clinical pathology.

[28]  D. Allen,et al.  An immunoperoxidase study of epithelial marker antigens in ulcerative colitis with dysplasia and carcinoma. , 1985, Journal of clinical pathology.

[29]  D. Ransohoff,et al.  Dysplasia in inflammatory bowel disease: standardized classification with provisional clinical applications. , 1983, Human pathology.

[30]  J. Macartney,et al.  Cancer morbidity in ulcerative colitis. , 1982, Gut.

[31]  W. Grove Statistical Methods for Rates and Proportions, 2nd ed , 1981 .

[32]  B. Morson,et al.  Dysplasia and cancer in inflammatory bowel disease. , 1981 .

[33]  R. Fairburn PATHOGENESIS OF ULCERATIVE COLITIS , 1981, The Lancet.

[34]  B. Levin,et al.  Dysplasia-associated lesion or mass (DALM) detected by colonoscopy in long-standing ulcerative colitis: An indication for colectomy , 1981 .

[35]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[36]  J. Fleiss,et al.  Statistical methods for rates and proportions , 1973 .

[37]  B. Morson,et al.  Rectal biopsy as an aid to cancer control in ulcerative colitis. , 1967, Gut.

[38]  S. Truelove,et al.  The course and prognosis of ulcerative colitis , 1963, Gut.

[39]  J. Davies,et al.  Consistency of histopathological reporting of breast lesions detected by screening: findings of the U.K. National External Quality Assessment (EQA) Scheme. U. K. National Coordinating Group for Breast Screening Pathology. , 1994, European journal of cancer.

[40]  B. Levin,et al.  Dysplasia-associated lesion or mass (DALM) detected by colonoscopy in long-standing ulcerative colitis: an indication for colectomy. , 1981, Gastroenterology.

[41]  I. Dawson The development of carcinoma of the large intestine in ulcerative colitis. , 1959, Proceedings of the Royal Society of Medicine.