Hyperspectral imaging for cancer surgical margin delineation: registration of hyperspectral and histological images

The determination of tumor margins during surgical resection remains a challenging task. A complete removal of malignant tissue and conservation of healthy tissue is important for the preservation of organ function, patient satisfaction, and quality of life. Visual inspection and palpation is not sufficient for discriminating between malignant and normal tissue types. Hyperspectral imaging (HSI) technology has the potential to noninvasively delineate surgical tumor margin and can be used as an intra-operative visual aid tool. Since histological images provide the ground truth of cancer margins, it is necessary to warp the cancer regions in ex vivo histological images back to in vivo hyperspectral images in order to validate the tumor margins detected by HSI and to optimize the imaging parameters. In this paper, principal component analysis (PCA) is utilized to extract the principle component bands of the HSI images, which is then used to register HSI images with the corresponding histological image. Affine registration is chosen to model the global transformation. A B-spline free form deformation (FFD) method is used to model the local non-rigid deformation. Registration experiment was performed on animal hyperspectral and histological images. Experimental results from animals demonstrated the feasibility of the hyperspectral imaging method for cancer margin detection.

[1]  Ioannis Sechopoulos,et al.  Breast tissue classification in digital tomosynthesis images based on global gradient minimization and texture features , 2014, Medical Imaging.

[2]  Baowei Fei,et al.  Automatic segmentation of right ventricular ultrasound images using sparse matrix transform and a level set , 2013, Physics in medicine and biology.

[3]  Sung Yong Shin,et al.  Scattered Data Interpolation with Multilevel B-Splines , 1997, IEEE Trans. Vis. Comput. Graph..

[4]  M. Varvares,et al.  Surgical margin determination in head and neck oncology: Current clinical practice. The results of an International American Head and Neck Society Member Survey , 2005, Head & neck.

[5]  R. Gandour-Edwards,et al.  Accuracy of intraoperative frozen section diagnosis in head and neck surgery: Experience at a university medical center , 1993, Head & neck.

[6]  Daniel Rueckert,et al.  Nonrigid registration using free-form deformations: application to breast MR images , 1999, IEEE Transactions on Medical Imaging.

[7]  A. Jemal,et al.  Cancer statistics, 2013 , 2013, CA: a cancer journal for clinicians.

[8]  Dongsheng Wang,et al.  A minimum spanning forest based hyperspectral image classification method for cancerous tissue detection , 2014, Medical Imaging.

[9]  Amnon Shashua,et al.  Linear image coding for regression and classification using the tensor-rank principle , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[10]  Xulei Qin,et al.  Measuring Body-Cover Vibration of Vocal Folds Based on High-Frame-Rate Ultrasonic Imaging and High-Speed Video , 2011, IEEE Transactions on Biomedical Engineering.

[11]  W. Jerjes,et al.  Optical techniques in diagnosis of head and neck malignancy. , 2006, Oral oncology.

[12]  Xulei Qin,et al.  Automatic segmentation of right ventricle on ultrasound images using sparse matrix transform and level set , 2013, Medical Imaging.

[13]  Guolan Lu,et al.  Spectral-spatial classification using tensor modeling for cancer detection with hyperspectral imaging , 2014, Medical Imaging.

[14]  David L Wilson,et al.  A comparative study of warping and rigid body registration for the prostate and pelvic MR volumes. , 2003, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[15]  Simon K. Warfield,et al.  Efficient multi-modal dense field non-rigid registration: alignment of histological and section images , 2005, Medical Image Anal..

[16]  D. Faller,et al.  Medical hyperspectral imaging to facilitate residual tumor identification during surgery , 2007, Cancer biology & therapy.

[17]  David L. Wilson,et al.  Semiautomatic nonrigid registration for the prostate and pelvic MR volumes. , 2005, Academic radiology.

[18]  David L Wilson,et al.  Automatic 3D registration for interventional MRI-guided treatment of prostate cancer. , 2002, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[19]  David L. Wilson,et al.  Automatic MR volume registration and its evaluation for the pelvis and prostate. , 2002, Physics in medicine and biology.

[20]  Jay B. West,et al.  The distribution of target registration error in rigid-body point-based registration , 2001, IEEE Transactions on Medical Imaging.

[21]  Baowei Fei,et al.  Nonrigid point registration for 2D curves and 3D surfaces and its various applications , 2013, Physics in medicine and biology.

[22]  Jonathan S. Lewin,et al.  Slice-to-volume registration and its potential application to interventional MRI-guided radio-frequency thermal ablation of prostate cancer , 2003, IEEE Transactions on Medical Imaging.

[23]  Xulei Qin,et al.  Improving Reliability and Accuracy of Vibration Parameters of Vocal Folds Based on High-Speed Video and Electroglottography , 2009, IEEE Transactions on Biomedical Engineering.

[24]  R. Spiro,et al.  Pattern of invasion and margin assessment in patients with oral tongue cancer , 1999, Head & neck.

[25]  P. Colarusso,et al.  Infrared Spectroscopic Imaging: From Planetary to Cellular Systems , 1998 .

[26]  Xiaodong Zhang,et al.  Mapping cardiac fiber orientations from high-resolution DTI to high-frequency 3D ultrasound , 2014, Medical Imaging.

[27]  V. Bagnato,et al.  Head & neck optical diagnostics: vision of the future of surgery , 2009, Head & neck oncology.

[28]  D. Peck,et al.  Registration and warping of magnetic resonance images to histological sections. , 1999, Medical physics.

[29]  Ling Su,et al.  Understanding metastatic SCCHN cells from unique genotypes to phenotypes with the aid of an animal model and DNA microarray analysis , 2006, Clinical & Experimental Metastasis.

[30]  Baowei Fei,et al.  Extracting cardiac myofiber orientations from high frequency ultrasound images , 2013, Medical Imaging.

[31]  Xiaofeng Yang,et al.  MR∕PET quantification tools: registration, segmentation, classification, and MR-based attenuation correction. , 2012, Medical physics.

[32]  Baowei Fei,et al.  A modified fuzzy C-means classification method using a multiscale diffusion filtering scheme , 2009, Medical Image Anal..

[33]  Guolan Lu,et al.  Medical hyperspectral imaging: a review , 2014, Journal of biomedical optics.

[34]  N. Dubrawsky.  Cancer statistics , 1989, CA: a cancer journal for clinicians.

[35]  Guozheng Yan,et al.  Bleeding detection in wireless capsule endoscopy images based on color invariants and spatial pyramids using support vector machines , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[36]  David L. Wilson,et al.  Deformable and rigid registration of MRI and microPET images for photodynamic therapy of cancer in mice. , 2006, Medical physics.