Accuracy of optical spectroscopy for the detection of cervical intraepithelial neoplasia: Testing a device as an adjunct to colposcopy

Testing emerging technologies involves the evaluation of biologic plausibility, technical efficacy, clinical effectiveness, patient satisfaction, and cost‐effectiveness. The objective of this study was to select an effective classification algorithm for optical spectroscopy as an adjunct to colposcopy and obtain preliminary estimates of its accuracy for the detection of CIN 2 or worse. We recruited 1,000 patients from screening and prevention clinics and 850 patients from colposcopy clinics at two comprehensive cancer centers and a community hospital. Optical spectroscopy was performed, and 4,864 biopsies were obtained from the sites measured, including abnormal and normal colposcopic areas. The gold standard was the histologic report of biopsies, read 2 to 3 times by histopathologists blinded to the cytologic, histopathologic, and spectroscopic results. We calculated sensitivities, specificities, receiver operating characteristic (ROC) curves, and areas under the ROC curves. We identified a cutpoint for an algorithm based on optical spectroscopy that yielded an estimated sensitivity of 1.00 [95% confidence interval (CI) = 0.92–1.00] and an estimated specificity of 0.71 [95% CI = 0.62–0.79] in a combined screening and diagnostic population. The positive and negative predictive values were 0.58 and 1.00, respectively. The area under the ROC curve was 0.85 (95% CI = 0.81–0.89). The per‐patient and per‐site performance were similar in the diagnostic and poorer in the screening settings. Like colposcopy, the device performs best in a diagnostic population. Alternative statistical approaches demonstrate that the analysis is robust and that spectroscopy works as well as or slightly better than colposcopy for the detection of CIN 2 to cancer.

[1]  M. Follen,et al.  Participant recruitment and motivation for participation in optical technology for cervical cancer screening research trials. , 2005, Gynecologic oncology.

[2]  Michele Follen,et al.  Model-based analysis of clinical fluorescence spectroscopy for in vivo detection of cervical intraepithelial dysplasia. , 2006, Journal of biomedical optics.

[3]  Marina Vannucci,et al.  A Bayesian Hierarchical Model for Classification with Selection of Functional Predictors , 2010, Biometrics.

[4]  Rebecca R. Richards-Kortum,et al.  Optimal excitation wavelengths for discrimination of cervical neoplasia , 2002, IEEE Transactions on Biomedical Engineering.

[5]  Sung K. Chang,et al.  Fluorescence spectroscopy for cervical precancer detection: Is there variance across the menstrual cycle? , 2002, Journal of biomedical optics.

[6]  Michele Follen,et al.  Spatially resolved reflectance spectroscopy for diagnosis of cervical precancer: Monte Carlo modeling and comparison to clinical measurements. , 2006, Journal of biomedical optics.

[7]  R. Richards-Kortum,et al.  Screening for squamous intraepithelial lesions with fluorescence spectroscopy. , 1999, Obstetrics and gynecology.

[8]  Kunio Miyazawa,et al.  Initial neural net construction for the detection of cervical intraepithelial neoplasia by fluorescence imaging. , 2002, American journal of obstetrics and gynecology.

[9]  Calum MacAulay,et al.  The performance of fluorescence and reflectance spectroscopy for the in vivo diagnosis of cervical neoplasia; point probe versus multispectral approaches. , 2007, Gynecologic oncology.

[10]  Thomas C. Wright,et al.  Preliminary experimental results from multi-center clinical trials for detection of cervical precancerous lesions using the Cerviscan/spl trade/ system: a novel full-field evoked tissue fluorescence based imaging instrument , 2001, 2001 Conference Proceedings of the 23rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[11]  R. Richards-Kortum,et al.  Light scattering from cervical cells throughout neoplastic progression: influence of nuclear morphology, DNA content, and chromatin texture. , 2003, Journal of biomedical optics.

[12]  A. Jemal,et al.  Global cancer statistics , 2011, CA: a cancer journal for clinicians.

[13]  Michele Follen,et al.  Calibration standards for multicenter clinical trials of fluorescence spectroscopy for in vivo diagnosis. , 2006, Journal of biomedical optics.

[14]  R. Richards-Kortum,et al.  Microanatomical and Biochemical Origins of Normal and Precancerous Cervical Autofluorescence Using Laser-scanning Fluorescence Confocal Microscopy¶ , 2003, Photochemistry and photobiology.

[15]  Rebecca Richards-Kortum,et al.  Light scattering from collagen fiber networks: micro-optical properties of normal and neoplastic stroma. , 2007, Biophysical journal.

[16]  R. Richards-Kortum,et al.  Patient distress and satisfaction with optical spectroscopy in cervical dysplasia detection. , 2003, American journal of obstetrics and gynecology.

[17]  L Burke,et al.  Identification of cervical intraepithelial neoplasia (CIN) using UV‐excited fluorescence and diffuse‐reflectance tissue spectroscopy , 2001, Lasers in surgery and medicine.

[18]  P. Satyaswaroop,et al.  Abstracts presented for the thirtieth annual meeting of the society of gynecologic oncologists , 1999, Gynecologic oncology.

[19]  Diane M Harper,et al.  Optical detection of high-grade cervical intraepithelial neoplasia in vivo: results of a 604-patient study. , 2004, American journal of obstetrics and gynecology.

[20]  Variation of fluorescence spectroscopy during the menstrual cycle. , 2002, Optics express.

[21]  Michele Follen,et al.  Reflectance spectroscopy for in vivo detection of cervical precancer. , 2002, Journal of biomedical optics.

[22]  Michele Follen,et al.  Autofluorescence Patterns in Short-Term Cultures of Normal Cervical Tissue , 2000, Photochemistry and photobiology.

[23]  George C Themelis,et al.  A clinical study of optical biopsy of the uterine cervix using a multispectral imaging system. , 2005, Gynecologic oncology.

[24]  Diane Solomon,et al.  2006 Consensus Guidelines for the Management of Women With Cervical Intraepithelial Neoplasia or Adenocarcinoma In Situ , 2007, Journal of lower genital tract disease.

[25]  M. Follen,et al.  Absolute quantitative real-time polymerase chain reaction for the measurement of human papillomavirus E7 mRNA in cervical cytobrush specimens , 2007, Infectious Agents and Cancer.

[26]  Michele Follen,et al.  Automated image analysis of digital colposcopy for the detection of cervical neoplasia. , 2008, Journal of biomedical optics.

[27]  Michele Follen,et al.  Effect of probe pressure on cervical fluorescence spectroscopy measurements. , 2004, Journal of biomedical optics.

[28]  Michele Follen,et al.  Model-based analysis of reflectance and fluorescence spectra for in vivo detection of cervical dysplasia and cancer. , 2008, Journal of biomedical optics.

[29]  L. Twiggs,et al.  Spectroscopic Imaging as a Triage Test for Cervical Disease: A Prospective Multicenter Clinical Trial , 2006, Journal of lower genital tract disease.

[30]  Michele Follen,et al.  Results of a pilot study of multispectral digital colposcopy for the in vivo detection of cervical intraepithelial neoplasia. , 2005, Gynecologic oncology.

[31]  Dennis D. Cox,et al.  A Functional Generalized Linear Model with Curve Selection in Cervical Pre-cancer Diagnosis Using Fluorescence Spectroscopy , 2009 .

[32]  Michele Follen,et al.  Design and preliminary analysis of a study to assess intra-device and inter-device variability of fluorescence spectroscopy instruments for detecting cervical neoplasia. , 2005, Gynecologic oncology.

[33]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[34]  Michele Follen,et al.  Effects of biographical variables on cervical fluorescence emission spectra. , 2003, Journal of biomedical optics.

[35]  R. Richards-Kortum,et al.  Cost‐Effectiveness Analysis of Diagnosis and Management of Cervical Squamous Intraepithelial Lesions , 1998, Obstetrics and gynecology.

[36]  Michele Follen,et al.  Detecting the Signal of the Menstrual Cycle in Fluorescence Spectroscopy of the Cervix , 2003, Applied spectroscopy.

[37]  V. Skladnev,et al.  An electronic approach to the detection of pre-cancer and cancer of the uterine cervix: a preliminary evaluation of Polarprobe , 1993, International Journal of Gynecologic Cancer.

[38]  Constantinos Pitris,et al.  Optical imaging of the cervix , 2003, Cancer.

[39]  R. Richards-Kortum,et al.  Safety Analysis: Relative Risks of Ultraviolet Exposure from Fluorescence Spectroscopy and Colposcopy Are Comparable* , 1997, Photochemistry and Photobiology.

[40]  Calum MacAulay,et al.  Kappa statistics to measure interrater and intrarater agreement for 1790 cervical biopsy specimens among twelve pathologists: qualitative histopathologic analysis and methodologic issues. , 2005, Gynecologic oncology.

[41]  Sharon Thomsen,et al.  Spectroscopic diagnosis of cervical intraepithelial neoplasia (CIN) in vivo using laser‐induced fluorescence spectra at multiple excitation wavlengths , 1996, Lasers in surgery and medicine.

[42]  A Singer,et al.  A real time optoelectronic device as an adjunct to the Pap smear for cervical screening: A multicenter evaluation , 2003, International journal of gynecological cancer : official journal of the International Gynecological Cancer Society.

[43]  The Use of Autofluorescence of Cells to Evaluate Cervical Neoplasia , 1997 .

[44]  E. Trimble,et al.  Interim Guidelines for Management of Abnormal Cervical Cytology , 1994 .

[45]  J. Ferlay,et al.  Global Cancer Statistics, 2002 , 2005, CA: a cancer journal for clinicians.

[46]  Steven Wolinsky,et al.  The use of polymerase chain reaction amplification for the detection of genital human papillomaviruses , 1989 .

[47]  R. Richards-Kortum,et al.  Optical spectroscopy for detection of neoplasia. , 2002, Current opinion in chemical biology.

[48]  Wei Xiang,et al.  Autofluorescence spectroscopy for the diagnosis of cervical intraepithelial neoplasia , 2002, BJOG : an international journal of obstetrics and gynaecology.

[49]  Sun Young Park,et al.  Methodology of a real-time quality control for the multispectral digital colposcope (MDC). , 2007, Gynecologic oncology.

[50]  N Ramanujam,et al.  Development of a multivariate statistical algorithm to analyze human cervical tissue fluorescence spectra acquired in vivo , 1996, Lasers in surgery and medicine.

[51]  Irene Georgakoudi,et al.  Trimodal spectroscopy for the detection and characterization of cervical precancers in vivo. , 2002, American journal of obstetrics and gynecology.

[52]  Maximizing the diversity of participants in a phase II clinical trial of optical technologies to detect cervical neoplasia. , 2007, Gynecologic oncology.

[53]  Xavier Castellsagué,et al.  Against which human papillomavirus types shall we vaccinate and screen? the international perspective , 2004, International journal of cancer.

[54]  R. Lotan,et al.  Autofluorescence Microscopy of Fresh Cervical-Tissue Sections Reveals Alterations in Tissue Biochemistry with Dysplasia¶ , 2001, Photochemistry and photobiology.

[55]  M F Mitchell,et al.  Fluorescence spectroscopy for diagnosis of squamous intraepithelial lesions of the cervix. , 1999, Obstetrics and gynecology.

[56]  Sung K. Chang,et al.  Multispectral digital colposcopy for in vivo detection of cervical cancer. , 2003, Optics express.

[57]  J. Beck,et al.  The Performance of Human Papillomavirus High-Risk DNA Testing in the Screening and Diagnostic Settings , 2008, Cancer Epidemiology Biomarkers & Prevention.

[58]  Gregory C. Mooradian,et al.  Hyperspectral Diagnostic Imaging of the Cervix: Report on a New Investigational Device , 2000, Journal of lower genital tract disease.

[59]  M. Pagano,et al.  Skp2, the FoxO1 hunter. , 2005, Cancer cell.

[60]  Michele Follen,et al.  Instrumentation as a source of variability in the application of fluorescence spectroscopic devices for detecting cervical neoplasia. , 2007, Journal of biomedical optics.

[61]  R Richards-Kortum,et al.  Understanding the contributions of NADH and collagen to cervical tissue fluorescence spectra: modeling, measurements, and implications. , 2001, Journal of biomedical optics.

[62]  Feng Chen,et al.  A new HPV-DNA test for cervical-cancer screening in developing regions: a cross-sectional study of clinical accuracy in rural China. , 2008, The Lancet. Oncology.

[63]  P. Qiu The Statistical Evaluation of Medical Tests for Classification and Prediction , 2005 .

[64]  N Ramanujam,et al.  Low Temperature Fluorescence Imaging of Freeze-trapped Human Cervical Tissues. , 2001, Optics express.

[65]  L Burke,et al.  Identification of squamous intraepithelial lesions: fluorescence of cervical tissue during colposcopy. , 1999, Journal of lower genital tract disease.

[66]  Y. Qiao,et al.  Shanxi Province Cervical Cancer Screening Study: a cross-sectional comparative trial of multiple techniques to detect cervical neoplasia. , 2001, Gynecologic oncology.

[67]  K. Lakshmaiah,et al.  HPV screening for cervical cancer in rural India. , 2009, The New England journal of medicine.

[68]  S. Derchain,et al.  Cervical cancer in the developing world. , 2006, Best practice & research. Clinical obstetrics & gynaecology.

[69]  A. Milbourne,et al.  Epidemiologic differentiation of diagnostic and screening populations for the assessment of cervical dysplasia using optical technologies. , 2012, Gender medicine.

[70]  J. Beck,et al.  The Accuracy of the Papanicolaou Smear in the Screening and Diagnostic Settings , 2008, Journal of lower genital tract disease.

[71]  J. L. Benedet,et al.  Organisation and results of the cervical cytology screening programme in British Columbia, 1955-85 , 1988, British medical journal.

[72]  M. Schiffman,et al.  Interim guidelines for management of abnormal cervical cytology. The 1992 National Cancer Institute Workshop. , 1994, JAMA.

[73]  Brian M. Pikkula,et al.  Multicenter clinical trials of in vivo fluorescence: are the measurements equivalent? , 2007, SPIE BiOS.

[74]  Michele Follen,et al.  The clinical effectiveness of optical spectroscopy for the in vivo diagnosis of cervical intraepithelial neoplasia: where are we? , 2007, Gynecologic oncology.

[75]  Martial Guillaud,et al.  DNA ploidy compared with human papilloma virus testing (Hybrid Capture II) and conventional cervical cytology as a primary screening test for cervical high‐grade lesions and cancer in 1555 patients with biopsy confirmation , 2006, Cancer.

[76]  D. Harper,et al.  Vaccination against human papillomavirus infection: a new paradigm in cervical cancer control. , 2005, Vaccine.

[77]  Patrick C. Walsh,et al.  American Cancer Society guidelines for the early detection of cancer. , 2002, CA: a cancer journal for clinicians.

[78]  Michele Follen,et al.  The effects of repeated spectroscopic pressure measurements on fluorescence intensity in the cervix. , 2004, American journal of obstetrics and gynecology.

[79]  A. Jemal,et al.  Global Cancer Statistics , 2011 .

[80]  Holly Janes,et al.  Practice of Epidemiology Adjusting for Covariates in Studies of Diagnostic, Screening, or Prognostic Markers: an Old Concept in a New Setting , 2022 .

[81]  D. Ferris,et al.  Multimodal Hyperspectral Imaging for the Noninvasive Diagnosis of Cervical Neoplasia , 2001, Journal of lower genital tract disease.

[82]  B. Littenberg Technology assessment in medicine , 1992, Academic medicine : journal of the Association of American Medical Colleges.

[83]  R. Richards-Kortum,et al.  Fluorescence and reflectance device variability throughout the progression of a phase II clinical trial to detect and screen for cervical neoplasia using a fiber optic probe. , 2007, Journal of biomedical optics.

[84]  N Ramanujam,et al.  Fluorescence spectroscopy: a diagnostic tool for cervical intraepithelial neoplasia (CIN). , 1994, Gynecologic oncology.

[85]  D. Ruppert The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[86]  Thomas C Wright,et al.  Effective cervical neoplasia detection with a novel optical detection system: a randomized trial. , 2007, Gynecologic oncology.

[87]  Michele Follen,et al.  Analytical model to describe fluorescence spectra of normal and preneoplastic epithelial tissue: comparison with Monte Carlo simulations and clinical measurements. , 2004, Journal of biomedical optics.

[88]  M. Toma A quality-control program for colposcopic practice , 2005 .

[89]  Judith R Mourant,et al.  In vivo light scattering measurements for detection of precancerous conditions of the cervix. , 2007, Gynecologic oncology.

[90]  Michele Follen,et al.  Combined reflectance and fluorescence spectroscopy for in vivo detection of cervical pre-cancer. , 2005, Journal of biomedical optics.