Real-time diagnosis and visualization of tumor margins in excised breast specimens using fluorescence lifetime imaging and machine learning

: Tumor-free surgical margins are critical in breast-conserving surgery. In up to 38% of the cases, however, patients undergo a second surgery since malignant cells are found at the margins of the excised resection specimen. Thus, advanced imaging tools are needed to ensure clear margins at the time of surgery. The objective of this study was to evaluate a random forest classifier that makes use of parameters derived from point-scanning label-free fluorescence lifetime imaging (FLIm) measurements of breast specimens as a means to diagnose tumor at the resection margins and to enable an intuitive visualization of a probabilistic classifier on tissue specimen. FLIm data from fresh lumpectomy and mastectomy specimens from 18 patients were used in this study. The supervised training was based on a previously developed registration technique between autofluorescence imaging data and cross-sectional histology slides. A pathologist’s histology annotations provide the ground truth to distinguish between adipose, fibrous, and tumor tissue. Current results demonstrate the ability of this approach to classify the tumor with 89% sensitivity and 93% specificity and to rapidly ( ∼ 20 frames per second) overlay the probabilistic classifier overlaid on excised breast specimens using an intuitive color scheme. Furthermore, we show an iterative imaging refinement that allows surgeons to switch between rapid scans with a customized, low spatial resolution to quickly cover the specimen and slower scans with enhanced resolution (400 µ m per point measurement) in suspicious regions where more details are required. In summary, this technique provides high diagnostic prediction accuracy, rapid acquisition, adaptive resolution, nondestructive probing, and facile interpretation of images, thus holding potential for clinical breast imaging based on label-free FLIm.

[1]  Brent W. Weyers,et al.  Fluorescence lifetime imaging for intraoperative cancer delineation in transoral robotic surgery , 2019, Translational biophotonics.

[2]  Behdad Dashtbozorg,et al.  Broadband hyperspectral imaging for breast tumor detection using spectral and spatial information. , 2019, Biomedical optics express.

[3]  Laura Marcu,et al.  Real‐time augmented reality for delineation of surgical margins during neurosurgery using autofluorescence lifetime contrast , 2019, Journal of biophotonics.

[4]  L. Marcu,et al.  Autofluorescence lifetime augmented reality as a means for real-time robotic surgery guidance in human patients , 2019, Scientific Reports.

[5]  Benno H. W. Hendriks,et al.  Towards the use of diffuse reflectance spectroscopy for real-time in vivo detection of breast cancer during surgery , 2018, Journal of Translational Medicine.

[6]  Brian W Pogue,et al.  Review of methods for intraoperative margin detection for breast conserving surgery , 2018, Journal of biomedical optics.

[7]  Laura Marcu,et al.  Electrocautery effects on fluorescence lifetime measurements: An in vivo study in the oral cavity. , 2018, Journal of photochemistry and photobiology. B, Biology.

[8]  Laura Marcu,et al.  Head and Neck Cancer Evaluation via Transoral Robotic Surgery with Augmented Fluorescence Lifetime Imaging , 2018 .

[9]  Matthew B. Blaschko,et al.  Intraoperative margin assessment of human breast tissue in optical coherence tomography images using deep neural networks , 2018, Comput. Medical Imaging Graph..

[10]  Laura Marcu,et al.  Method for accurate registration of tissue autofluorescence imaging data with corresponding histology: a means for enhanced tumor margin assessment , 2018, Journal of biomedical optics.

[11]  Laura Marcu,et al.  Label-free optical imaging technologies for rapid translation and use during intraoperative surgical and tumor margin assessment , 2017, Journal of biomedical optics.

[12]  Laura Marcu,et al.  Automated detection of breast cancer in resected specimens with fluorescence lifetime imaging , 2017, Physics in medicine and biology.

[13]  A. Mahadevan-Jansen,et al.  Evaluating feasibility of an automated 3-dimensional scanner using Raman spectroscopy for intraoperative breast margin assessment , 2017, Scientific Reports.

[14]  Laura Marcu,et al.  In vivo label-free structural and biochemical imaging of coronary arteries using an integrated ultrasound and multispectral fluorescence lifetime catheter system , 2017, Scientific Reports.

[15]  Laura Marcu,et al.  Three-dimensional online surface reconstruction of augmented fluorescence lifetime maps using photometric stereo (Conference Presentation) , 2017, BiOS.

[16]  Tomas Pfister,et al.  Learning from Simulated and Unsupervised Images through Adversarial Training , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Juan Shan,et al.  Computer-Aided Diagnosis for Breast Ultrasound Using Computerized BI-RADS Features and Machine Learning Methods. , 2016, Ultrasound in medicine & biology.

[18]  Laura Marcu,et al.  Real-Time Visualization of Tissue Surface Biochemical Features Derived From Fluorescence Lifetime Measurements , 2016, IEEE Transactions on Medical Imaging.

[19]  Guolan Lu,et al.  Framework for hyperspectral image processing and quantification for cancer detection during animal tumor surgery , 2015, Journal of biomedical optics.

[20]  Kelsey M. Kennedy,et al.  Quantitative micro-elastography: imaging of tissue elasticity using compression optical coherence elastography , 2015, Scientific Reports.

[21]  Nathan D. Shemonski,et al.  Real-time Imaging of the Resection Bed Using a Handheld Probe to Reduce Incidence of Microscopic Positive Margins in Cancer Surgery. , 2015, Cancer research.

[22]  S. Achilefu,et al.  Binocular Goggle Augmented Imaging and Navigation System provides real-time fluorescence image guidance for tumor resection and sentinel lymph node mapping , 2015, Scientific Reports.

[23]  J. Wesseling,et al.  Fat/water ratios measured with diffuse reflectance spectroscopy to detect breast tumor boundaries , 2015, Breast Cancer Research and Treatment.

[24]  Rui Li,et al.  Assessing breast tumor margin by multispectral photoacoustic tomography. , 2015, Biomedical optics express.

[25]  Christine S. Mulvey,et al.  A Quantitative Diffuse Reflectance Imaging (QDRI) System for Comprehensive Surveillance of the Morphological Landscape in Breast Tumor Margins , 2015, PloS one.

[26]  Laura Marcu,et al.  Technique for real-time tissue characterization based on scanning multispectral fluorescence lifetime spectroscopy (ms-TRFS). , 2015, Biomedical optics express.

[27]  A. Jemal,et al.  Global cancer statistics, 2012 , 2015, CA: a cancer journal for clinicians.

[28]  Laura Marcu,et al.  Design and evaluation of a device for fast multispectral time-resolved fluorescence spectroscopy and imaging. , 2014, The Review of scientific instruments.

[29]  Yan Peng,et al.  Auto-fluorescence lifetime and light reflectance spectroscopy for breast cancer diagnosis: potential tools for intraoperative margin detection , 2012, Biomedical optics express.

[30]  Laura Marcu,et al.  A novel method for fast and robust estimation of fluorescence decay dynamics using constrained least-squares deconvolution with Laguerre expansion , 2017, Physics in medicine and biology.

[31]  Matthew D. Keller,et al.  Development of a spatially offset Raman spectroscopy probe for breast tumor surgical margin evaluation. , 2011, Journal of biomedical optics.

[32]  Bernard Choi,et al.  Noninvasive assessment of burn wound severity using optical technology: a review of current and future modalities. , 2011, Burns : journal of the International Society for Burn Injuries.

[33]  Laura Marcu,et al.  Fluorescence lifetime spectroscopy for guided therapy of brain tumors , 2011, NeuroImage.

[34]  Wenfeng Xia,et al.  Photoacoustic Imaging of the Breast Using the Twente Photoacoustic Mammoscope: Present Status and Future Perspectives , 2010, IEEE Journal of Selected Topics in Quantum Electronics.

[35]  Anita Mahadevan-Jansen,et al.  Autofluorescence and diffuse reflectance spectroscopy and spectral imaging for breast surgical margin analysis , 2010, Lasers in surgery and medicine.

[36]  Koby Crammer,et al.  A theory of learning from different domains , 2010, Machine Learning.

[37]  Freddy T. Nguyen,et al.  Intraoperative evaluation of breast tumor margins with optical coherence tomography. , 2009, Cancer research.

[38]  Henrik Boström,et al.  Calibrating Random Forests , 2008, 2008 Seventh International Conference on Machine Learning and Applications.

[39]  Chen-Yuan Dong,et al.  Evaluation of dermal thermal damage by multiphoton autofluorescence and second-harmonic-generation microscopy. , 2006, Journal of biomedical optics.

[40]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[41]  A. Jemal,et al.  Global cancer statistics , 2011, CA: a cancer journal for clinicians.

[42]  John Platt,et al.  Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods , 1999 .

[43]  L. Pitts,et al.  Comparison of response amplitude versus stimulation threshold in predicting early postoperative facial nerve function after acoustic neuroma resection. , 1998, The American journal of otology.

[44]  I. Gage,et al.  Pathologic margin involvement and the risk of recurrence in patients treated with breast-conserving therapy. , 1996, Cancer.

[45]  B. Matthews Comparison of the predicted and observed secondary structure of T4 phage lysozyme. , 1975, Biochimica et biophysica acta.